Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21016

Handle DECam instrument signature data in gen3

    XMLWordPrintable

    Details

    • Story Points:
      8
    • Epic Link:
    • Sprint:
      AP F19-6 (November), AP S20-1 (December), AP S20-2 (January), AP S20-3 (February), AP S20-4 (March)
    • Team:
      Alert Production

      Description

      DM-20763 dealt with ingesting DECam data, but punted on managing the instrument signature data. This will require at-minimum implementing writeCuratedCalibrations.

      I've linked a variety of DECam calibration-related tickets as "related', since we can maybe close some of those as won't fix once this is done (since they might be gen2-specific).

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21915 Support Gen 3 ingestion of ap_verify datasets

          • Done
          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21155 Implement QE curve interface as described in RFC-625

          • Done
          is child task of

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21862 Extend Gen3 butler support for obs_decam

          • Done
          is triggered by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-20763 Add initial support for Gen3 Butler to obs_decam

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-22794 obs_base tests should not use daf_butler test configs

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-22370 Support Gen 3 ingestion of image-type calibs

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23230 Make writeCuratedCalibrations returns the DatasetRefs it wrote

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-7286 Please test ingesting DECam raw data and calibration data

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23976 Move gen3 generic curated calibrations ingest code to obs_base

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23980 Standardize Gen3 instrument class names and location

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17538 Generate stack-produced (rather than CP) calibration products for DECam

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-7287 Please test obs_decam with the LSST-produced calibration data

          • Invalid

          Improvement - An improvement or enhancement to an existing feature or task. DM-6495 Please add raw data and calibration data to validation_data_decam

          • To Do

            Activity

            Ascending order - Click to sort in descending order
            Parejkoj John Parejko created issue -
            Parejkoj John Parejko made changes -
            Field Original Value New Value
            Link This issue relates to DM-7286 [ DM-7286 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-7287 [ DM-7287 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-6495 [ DM-6495 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-17538 [ DM-17538 ]
            Parejkoj John Parejko made changes -
            Link This issue is triggered by DM-20763 [ DM-20763 ]
            swinbank John Swinbank made changes -
            Labels SciencePipelines
            swinbank John Swinbank made changes -
            Epic Link DM-21442 [ 423049 ]
            swinbank John Swinbank made changes -
            Team Alert Production [ 10300 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue blocks DM-21915 [ DM-21915 ]
            Parejkoj John Parejko made changes -
            Link This issue is child task of DM-21862 [ DM-21862 ]
            Parejkoj John Parejko made changes -
            Labels gen2-deprecation-blocker gen3-middleware
            Parejkoj John Parejko made changes -
            Assignee John Parejko [ parejkoj ]
            Parejkoj John Parejko made changes -
            Watchers Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Tim Jenness [ Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Tim Jenness ] Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Tim Jenness [ Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Tim Jenness ]
            ebellm Eric Bellm made changes -
            Sprint AP F19-6 (November) [ 958 ]
            Story Points 8
            Parejkoj John Parejko made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-22370 [ DM-22370 ]
            Parejkoj John Parejko made changes -
            Summary Handle DECam calibrations in gen3 Handle DECam instrument signature data in gen3
            Parejkoj John Parejko made changes -
            Description DM-20763 dealt with ingesting DECam data, but punted on managing the calibration data. This is probably best done with a {{gen2convert}}-style script, and will require at-minimum implementing {{writeCuratedCalibrations}}.

            I've linked a variety of DECam calibration-related tickets as "related', since we can maybe close some of those as won't fix once this is done (since they might be gen2-specific).             		DM-20763 dealt with ingesting DECam data, but punted on managing the instrument signature data. This is probably best done with a {{gen2convert}}-style script, and will require at-minimum implementing {{writeCuratedCalibrations}}.

            I've linked a variety of DECam calibration-related tickets as "related', since we can maybe close some of those as won't fix once this is done (since they might be gen2-specific).
            Parejkoj John Parejko made changes -
            Link This issue is blocked by DM-21155 [ DM-21155 ]
            swinbank John Swinbank made changes -
            Sprint AP F19-6 (November) [ 958 ] AP F19-6 (November), AP S20-1 (December) [ 958, 981 ]
            swinbank John Swinbank made changes -
            Epic Link DM-21442 [ 423049 ] DM-22633 [ 427742 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-22794 [ DM-22794 ]
            swinbank John Swinbank made changes -
            Description DM-20763 dealt with ingesting DECam data, but punted on managing the instrument signature data. This is probably best done with a {{gen2convert}}-style script, and will require at-minimum implementing {{writeCuratedCalibrations}}.

            I've linked a variety of DECam calibration-related tickets as "related', since we can maybe close some of those as won't fix once this is done (since they might be gen2-specific).             		DM-20763 dealt with ingesting DECam data, but punted on managing the instrument signature data. This will require at-minimum implementing {{writeCuratedCalibrations}}.

            I've linked a variety of DECam calibration-related tickets as "related', since we can maybe close some of those as won't fix once this is done (since they might be gen2-specific).
            swinbank John Swinbank made changes -
            Sprint AP F19-6 (November), AP S20-1 (December) [ 958, 981 ] AP F19-6 (November), AP S20-1 (December), AP S20-2 (January) [ 958, 981, 983 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-23230 [ DM-23230 ]
            swinbank John Swinbank made changes -
            Sprint AP F19-6 (November), AP S20-1 (December), AP S20-2 (January) [ 958, 981, 983 ] AP F19-6 (November), AP S20-1 (December), AP S20-2 (January), AP S20-3 (February) [ 958, 981, 983, 984 ]
            tjenness Tim Jenness made changes -
            Component/s obs_lsst [ 16504 ]
            Component/s obs_subaru [ 10747 ]
            Component/s daf_butler [ 11300 ]
            swinbank John Swinbank made changes -
            Sprint AP F19-6 (November), AP S20-1 (December), AP S20-2 (January), AP S20-3 (February) [ 958, 981, 983, 984 ] AP F19-6 (November), AP S20-1 (December), AP S20-2 (January), AP S20-3 (February), AP S20-4 (March) [ 958, 981, 983, 984, 985 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-23976 [ DM-23976 ]
            tjenness Tim Jenness made changes -
            Watchers Christopher Waters, Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Tim Jenness [ Christopher Waters, Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Tim Jenness ] Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Simon Krughoff, Tim Jenness [ Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Simon Krughoff, Tim Jenness ]
            tjenness Tim Jenness made changes -
            Watchers Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Simon Krughoff, Tim Jenness [ Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Simon Krughoff, Tim Jenness ] Christopher Waters, Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Simon Krughoff, Tim Jenness [ Christopher Waters, Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Simon Krughoff, Tim Jenness ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-23980 [ DM-23980 ]
            Parejkoj John Parejko made changes -
            Resolution Done [ 10000 ]
            Status In Progress [ 3 ] Done [ 10002 ]
            swinbank John Swinbank made changes -
            Epic Link DM-22633 [ 427742 ] DM-24341 [ 433028 ]

              People

              Assignee:
              Parejkoj John Parejko
              Reporter:
              Parejkoj John Parejko
              Watchers:
              Christopher Waters, Eric Bellm, Jim Bosch, John Parejko, John Swinbank, Krzysztof Findeisen, Meredith Rawls, Simon Krughoff, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.