Back to Volume
Paper: Aggregating Metadata from Multiple Archives: a Non-VO Approach
Volume: 495, Astronomical Data Analysis Software and Systems XXIV (ADASS XXIV)
Page: 413
Authors: Gwyn, S. D. J.
Abstract: The Solar System Object Image Search (SSOIS) tool at the Canadian Astronomy Data Centre allows users to search for images of moving objects taken with a large number of ground-based and space-based telescopes. (Gwyn et al. 2012). The ever-growing list of telescopes includes HST, Subaru, CFHT, Gemini, SDSS, AAT, NEAT, NOAO, WISE and the ING and ESO telescopes. The first step in constructing SSOIS is to agregate the metadata from the various archives. An effective search requires the RA, Dec, and time of the exposure, and the field of view of the instrument. The archives are extremely hetergeneous; in some cases the interface dates back to the 1990s. After scraping these archives, four lessons have been learned: 1) The more primitive the archive, the easier it is to scrape. 2) Simple Image Access Protocol (SIAP) is not an effective means of scraping archives. 3) When scraping an archive with multiple queries, the queries should be done by time rather by than sky position. 4) Retrieving the metadata is relatively easy, the hard work is in the quality control and understanding each telescope/instrument.
Back to Volume