Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: meas_algorithms
-
Labels:
-
Story Points:8
-
Epic Link:
-
Sprint:AP S19-6, AP F19-1
-
Team:Alert Production
Description
In order to be able to generate a Gaia (or PS1-DR2) reference catalog in a reasonable amount of time, we need a way to process files in parallel. The existing IngestIndexReferenceObjectsTask is not capable of running in parallel. One approach that should be fairly simple is to use multiprocessing plus file locking: lock each output catalog before appending.
Everything largely looked fine to me, except for some style issues. For the moved code, I checked the PR versions, and then spot checked that they matched the removed versions (method signatures, etc).