Back to Volume
Paper: Virtual Astronomical Pipelines
Volume: 376, Astronomical Data Analysis Software and Systems XVI
Page: 253
Authors: Dave, R.; Protopapas, P.; Lehner, M.
Abstract: The sheer magnitude of databases and data rates in new surveys makes it hard to develop pipelines to enable both the analysis of data and the federation of these databases for correlation and followup. There is thus a compelling need to facilitate the creation and management of dynamic workflow pipelines that enable correlating data between separate, parallel streams; changing the workflow in response to an event; using the NVO to obtain additional needed information from databases; and modifying the observing program of a primary survey to follow-up a transient or moving object. This paper describes such a Virtual Astronomical Pipeline (VAP) system which is running in the TAOS project. The software enables components in the pipeline to react to events encapsulated in XML messages, modifying and subsequently routing these messages to multiple other components. This architecture allows for the bootstrapping of components individually in the development process and for dynamic reconfiguration of the pipeline as a response to external and internal events. The software will be extended for future work in combining the results of surveys and followups into a global virtual pipeline.
Back to Volume