Back to Volume
Paper: Data Management Challenges in Gaia
Volume: 495, Astronomical Data Analysis Software and Systems XXIV (ADASS XXIV)
Page: 47
Authors: Hernandez, J.; Hutton, A.
Abstract: Gaia was launched this past December from French Guiana. After the Payload was switched on in January, Gaia started observing the sky and has been sending us its observations. On a regular day Gaia sends down to earth 30 million observations. The raw data gets processed daily at ESAC and then different sets get sent to 5 other data processing centers. Ensuring the correct processing and tracking of all the data through the processing pipelines represents a formidable challenge and requires new ways of doing the data management. The processing of the data will be iterative and will last more than 5 years, each data processing center will perform one part of the data reduction. We outline how we manage the data flow between the different pipelines running in each center.
Back to Volume