There are the DR2 .csv files on lsst-dev here: /project/shared/data/gaia_dr2/gaia_source/csv
and a Parquet version here: /project/shared/data/gaia_dr2/gaia_source.parquet
meas_algorithms has IngestIndexReferenceTask, which I've been told is very slow. Eli Rykoff suggested using fgcmOutputProduct._outputStandardStars from fgcmcal, but it does not handle proper motion or parallax or many of the other fields. I should run some simple tests to see just how slow the "standard" code is and make some guesses as to what might be necessary to speed it up. And similarly, compare it with Eli Rykoff's code and decide whether we should just use something like that. As part of this, I should look at reading Parquet vs. CSV.
|Status||To Do [ 10001 ]||In Progress [ 3 ]|
|Sprint||AP S19-5 [ 833 ]||AP S19-5, AP S19-6 [ 833, 834 ]|
|Resolution||Done [ 10000 ]|
|Status||In Progress [ 3 ]||Done [ 10002 ]|