| |
 |
| Paper: |
Processing Large Radio Astronomy Data Cubes within an Objectstore |
| Volume: |
541, ADASS XXXIII |
| Page: |
373 |
| Authors: |
G. W. H. German |
| DOI: |
10.26624/FCFS2348 |
| Abstract: |
Typical radio astronomy (RA) data cubes can now be on the scale of
a terabyte or so; future telescopes will produce data cubes larger by two orders of
magnitude or more. The shift to using Objectstores rather than POSIX file systems
poses issues in reading these cubes efficiently. Simply ‘staging in’ the data cube to a
temporary POSIX file system results in double-handling of the data. This is not a trivial
exercise; staging multi-terabyte data sets may take several hours to days. Here I present
an alternative methodology to avoid this. |
|
|
|
|
|
