Details
-
Type:
Epic
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: None
-
Labels:
-
Epic Name:Production-style processing of simulated imsim LSSTCam data
-
Story Points:40
-
WBS:02C.07.06.01
-
Team:Data Facility
-
Cycle:Fall 2018
Description
Process a small set of imsim LSST simulated data, including setup, update, testing, execution, and debugging, and produce data products from a selected set of DRP pipelines of a stable Stack version. Use DESDM framework if possible but the DESDM framework is not required as the way to generate the data outputs.
Attachments
| Key | Summary | Story Points | Assignee | Status | |
|---|---|---|---|---|---|
|
|
9.9 | Hsin-Fang Chiang | Done | ||
|
|
0.1 | Hsin-Fang Chiang | Done | ||
|
|
1.5 | Hsin-Fang Chiang | Done | ||
|
|
1 | Hsin-Fang Chiang | Done | ||
|
|
2 | Mikolaj Kowalik | Done | ||
|
|
0.5 | Hsin-Fang Chiang | Done | ||
|
|
manually test run DRP pipelines with a small set of imsim data |
8 | Hsin-Fang Chiang | Done | |
|
|
2 | Hsin-Fang Chiang | Done | ||
|
|
10 | Hsin-Fang Chiang | Done | ||
|
|
0 | Unassigned | Won't Fix | ||
|
|
5 | Unassigned | Won't Fix |
Activity
DM-16554 is the work on astro_metadata_translator. I've done Phosim and was working on TS8 today.
My understanding is the uncertainty of work needed on the DESDM side after astro_metadata_translator is ready can also be a concern.
Hsin-Fang Chiang
added a comment - My understanding is the uncertainty of work needed on the DESDM side after astro_metadata_translator is ready can also be a concern. Planned work has been completed. Datasets are in /datasets/DC2/repo/rerun/w49multiband/
See DM-16956.
In terms of ingesting data files into the DBB of the DESDM framework, the as-is packages were written for the HSC data specifically. Therefore we cannot ingest the imsim data (
DM-16115) which blocks processing any imsim data in the DESDM framework.Michelle Gower was planning to use the new astro_metadata_translator for reading headers, and modify desdmfw_lsst_plugins or other packages so to allow imsim data ingestion. That work is waiting on the BG3 development. In the Batch Production Steering meeting on Nov 28 (with Margaret Gelman Michelle Butler [X] Joel Plutchak Rob Kooper [X] and many more) it was decided that DESDM is not required to perform this processing for this epic. I'll update the stories here in this epic according to this decision.