Back to Volume
Paper: Towards a Self-healing Archive
Volume: 521, Astronomical Data Analysis Software and Systems XXVI
Page: 16
Authors: Witz, S.; Lyons, D. K.; Plank, J.; Hausman, C.; Lively, R.; Arora, J.; Benson, J.
Abstract: The new NRAO Archive encompasses data from the Jansky VLA, the legacy VLA, the Green Bank Telescope and the VLBA while additionally providing access to ALMA data stored and managed separately. Astronomical data is generally self-describing and generated independently by each instrument. The archive database contains metadata extracted and maintained centrally. Errors in metadata generation and extraction are unavoidable, but after fixing the bug, how do you correct the data? This paper introduces a self-healing approach that leverages otherwise idle archive storage nodes by having them continuously reingest stored metadata with the latest software. Upon detecting a difference, the reingestion system can make decisions about whether to update incorrect records in the searchable metadata database.
Back to Volume