| |
 |
| Paper: |
Analyzing Large Data with Mappable Vector Library |
| Volume: |
538, ADASS XXXII |
| Page: |
182 |
| Authors: |
Vladimir Dergachev |
| DOI: |
10.26624/GAOZ9558 |
| Abstract: |
A common problem when working with large data sets is that one is
limited at looking at snippets of the whole of the data, because retrieving the entire
data set from a database is ineļ¬cient. The solution is to bring the data closer to the
user, allowing interactive exploration at the speed of the underlying storage medium.
Mappable Vector Library (MVL) accomplishes this by memory mapping the entire data
set, allowing direct access from R using the RMVL package (a C library is also available).
We introduce MVL and illustrate its capabilities using 1 TB of Gaia data. |
|
|
|
|
|
