Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-35322

ForcedPhotCcdFromDataFrameTask needs local calib plugins

    XMLWordPrintable

    Details

    • Team:
      DM Science
    • Urgent?:
      No

      Description

      ForcedPhotCcdFromDataFrameTask overwrites the measurement plugins used by the parent class, which removes base_LocalPhotoCalib and base_LocalWcs. These tasks are necessary for calibration of the parquet files downstream of this task, and should be re-added.

        Attachments

          Activity

          No builds found.
          ctslater Colin Slater created issue -
          ctslater Colin Slater made changes -
          Field Original Value New Value
          Assignee Colin Slater [ ctslater ]
          ctslater Colin Slater made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          ctslater Colin Slater made changes -
          Attachment image-2022-07-15-13-59-57-442.png [ 62532 ]
          Hide
          ctslater Colin Slater added a comment -

          Added the two plugins plus base_LocalBackground. When I now run DRP.yaml#forcedPhotCcdOnDiaObjects,forcedPhotDiffOnDiaObjects,writeForcedSourceOnDiaObjectTable, I get all of the calib columns in mergedForcedSourceOnDiaObject.

           

          Show
          ctslater Colin Slater added a comment - Added the two plugins plus base_LocalBackground. When I now run DRP.yaml#forcedPhotCcdOnDiaObjects,forcedPhotDiffOnDiaObjects,writeForcedSourceOnDiaObjectTable, I get all of the calib columns in mergedForcedSourceOnDiaObject.  
          Hide
          ctslater Colin Slater added a comment -

          Ready for review. I'm expecting that DM-35538 will make missing columns throw an exception in general, so I've kept this to just the fix itself and didn't add a test. Jenkins is running.

          Show
          ctslater Colin Slater added a comment - Ready for review. I'm expecting that DM-35538 will make missing columns throw an exception in general, so I've kept this to just the fix itself and didn't add a test. Jenkins is running .
          ctslater Colin Slater made changes -
          Reviewers Yusra AlSayyad [ yusra ]
          Status In Progress [ 3 ] In Review [ 10004 ]
          ctslater Colin Slater made changes -
          Labels backport-v23
          Hide
          yusra Yusra AlSayyad added a comment -

          I'm still going to add something to ci_hsc and ci_imsim that check to see if all rows are NaN for any columns, but it doesn't have to be done on this ticket.

          Show
          yusra Yusra AlSayyad added a comment - I'm still going to add something to ci_hsc and ci_imsim that check to see if all rows are NaN for any columns, but it doesn't have to be done on this ticket.
          yusra Yusra AlSayyad made changes -
          Status In Review [ 10004 ] Reviewed [ 10101 ]
          Hide
          ctslater Colin Slater added a comment -

          ci_imsim rightfully complained the local calib flag columns are listed as doubles in sdm_schemas, instead of bools. Added commits to correct the schemas and started a new jenkins run.

          Show
          ctslater Colin Slater added a comment - ci_imsim rightfully complained the local calib flag columns are listed as doubles in sdm_schemas, instead of bools. Added commits to correct the schemas and started a new jenkins run .
          ctslater Colin Slater made changes -
          Labels backport-v23 backport-approved backport-done backport-v23
          ctslater Colin Slater made changes -
          Resolution Done [ 10000 ]
          Status Reviewed [ 10101 ] Done [ 10002 ]
          yusra Yusra AlSayyad made changes -
          Team Data Release Production [ 10301 ] DM Science [ 12218 ]

            People

            Assignee:
            ctslater Colin Slater
            Reporter:
            ctslater Colin Slater
            Reviewers:
            Yusra AlSayyad
            Watchers:
            Colin Slater, Yusra AlSayyad
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.