Back to Volume
Paper: Architecture of Processing and Analysis Systems for Big Astronomical Data
Volume: 521, Astronomical Data Analysis Software and Systems XXVI
Page: 428
Authors: Kolosov, I.; Gerasimov, S.; Meshcheryakov, A.
Abstract: This work explores the use of big data technologies deployed in the cloud for processing of astronomical data. We have applied Hadoop and Spark to the task of co-adding astronomical images. We compared the overhead and execution time of these frameworks. We conclude that the performance of both frameworks is generally on par. The Spark API is more flexible, which allows one to easily construct astronomical data processing pipelines.
Back to Volume