Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21865

Extend Gen3 butler support for obs_cfht

    XMLWordPrintable

    Details

    • Story Points:
      6
    • Team:
      Data Release Production

      Description

      DM-21860 adds basic Gen3 butler support for obs_cfht (sufficient for ingest), but we'll need to expand that to get to the point where we can run single-frame processing (IsrTask, CharacterizeImageTask, and CalibrateTask) via Gen3 on it.  That will include, at least:

      • implementing writeCuratedCalibrations in the instrument class;
      • specializing (and modifying, as necessary) the instrument-specific hooks for the gen2to3 tool, at least to the point where we can write scripts like the ones in ci_hsc_gen3/bin.src to make a fully-usable Gen3 repo.

       

        Attachments

          Issue Links

            Activity

            No builds found.
            jbosch Jim Bosch created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Link This issue is blocked by DM-21860 [ DM-21860 ]
            jbosch Jim Bosch made changes -
            Labels gen3-middleware gen2-deprecation-blocker gen3-middleware
            swinbank John Swinbank made changes -
            Team Data Release Production [ 10301 ]
            Parejkoj John Parejko made changes -
            Link This issue is blocked by DM-22655 [ DM-22655 ]
            tjenness Tim Jenness made changes -
            Watchers Jim Bosch [ Jim Bosch ] Christopher Waters, Jim Bosch, Simon Krughoff [ Christopher Waters, Jim Bosch, Simon Krughoff ]
            tjenness Tim Jenness made changes -
            Watchers Christopher Waters, Jim Bosch, Simon Krughoff [ Christopher Waters, Jim Bosch, Simon Krughoff ] Christopher Waters, Dominique Boutigny, Jim Bosch, Simon Krughoff [ Christopher Waters, Dominique Boutigny, Jim Bosch, Simon Krughoff ]
            Hide
            tjenness Tim Jenness added a comment -

            There are a couple of issues associated with this ticket.

            • There is no obs_cfht_data repo so I'm guessing a ticket has to be created to convert all the FITS defects files into standard text files in obs_cfht_data. That would fix the write-curated-calibrations problem immediately. This shouldn't be much work for someone since there is gen2 bypass code for reading the defects. Are there any special curated calibrations for MegaPrime?
            • The bias/flat/fringe files I have found lying around in CFHT repositories are all multi-extension and won't have been created by LSST software. Someone needs to confirm that this is always true for MegaPrime and that they are just like cpFlat, cpBias frames for DECam. It should be fairly simple to use the same technique as we use for DECam to ingest them in 2to3 conversion.
            Show
            tjenness Tim Jenness added a comment - There are a couple of issues associated with this ticket. There is no obs_cfht_data repo so I'm guessing a ticket has to be created to convert all the FITS defects files into standard text files in obs_cfht_data. That would fix the write-curated-calibrations problem immediately. This shouldn't be much work for someone since there is gen2 bypass code for reading the defects. Are there any special curated calibrations for MegaPrime? The bias/flat/fringe files I have found lying around in CFHT repositories are all multi-extension and won't have been created by LSST software. Someone needs to confirm that this is always true for MegaPrime and that they are just like cpFlat, cpBias frames for DECam. It should be fairly simple to use the same technique as we use for DECam to ingest them in 2to3 conversion.
            gruendl Robert Gruendl [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 25787 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-29535 [ DM-29535 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-32584 [ DM-32584 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-33523 [ DM-33523 ]
            tjenness Tim Jenness made changes -
            Link This issue blocks DM-34973 [ DM-34973 ]
            tjenness Tim Jenness made changes -
            Link This issue blocks DM-35039 [ DM-35039 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-26681 [ DM-26681 ]

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Christopher Waters, Dominique Boutigny, Jim Bosch, John Parejko, Simon Krughoff, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:

                  Jenkins Builds

                  No builds found.