Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14568

Transform DRP pipeline outputs to DPDD-specified format in F18

    XMLWordPrintable

Details

    • Epic
    • Status: Done
    • Resolution: Done
    • None
    • None
    • None
    • f18-drp-dpdd
    • 42
    • 02C.04.07
    • Data Release Production
    • Spring 2019

    Description

      Post-processing DRP catalog outputs to match definitions in DPDD.

      Success criteria: qserv team can ingest HSC data and meet milestone DM-DAX-5

      Attachments

        Issue Links

          Stories in Epic (Custom Issue Matrix)

          Activity

            yusra Yusra AlSayyad added a comment - - edited

            Design and background presented to DMLT (2018): https://github.com/yalsayyad/dm_notebooks/blob/master/object-table/DPDD.ipynb

            Conclusion presented to DMLT (2019): https://docs.google.com/presentation/d/1kTz91UGMzxV_TA5_vXc-8vGhWifnLI2DZWBatf9qZME/edit#slide=id.g70708e1de4_0_11

            on this epic we Implemented tasks to match catalogs, write parquet tables, and transform units/quantities, concatenate full tract. This enabled the ingestion of a transformed  DRP Object Table to qserv. 

            yusra Yusra AlSayyad added a comment - - edited Design and background presented to DMLT (2018):  https://github.com/yalsayyad/dm_notebooks/blob/master/object-table/DPDD.ipynb Conclusion presented to DMLT (2019):  https://docs.google.com/presentation/d/1kTz91UGMzxV_TA5_vXc-8vGhWifnLI2DZWBatf9qZME/edit#slide=id.g70708e1de4_0_11 on this epic we Implemented tasks to match catalogs, write parquet tables, and transform units/quantities, concatenate full tract. This enabled the ingestion of a transformed  DRP Object Table to qserv. 

            People

              yusra Yusra AlSayyad
              yusra Yusra AlSayyad
              Fritz Mueller, Hsin-Fang Chiang, John Swinbank, Xiuqin Wu [X] (Inactive), Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.