Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-28346

Gen2 defects no longer ingestable as a curated calibration

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: In Progress
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: cp_pipe
    • Labels:
      None

      Description

      It did in fact used to work correctly in that ingestCuratedCalibs.py could read the output of findDefects.py. I pulled up the w_2020_40 code, and there was a function in cp/pipe/defects.py called _writeData that got called at the end of the FindDefectTask. This wrote things out with the correct file structure so that ingestCuratedCalibs.py could read it. I looked at an output file from that time frame and there is a statement at the end of findDefects.py that says:
      findDefects INFO: Writing defects to /project/shared/BOT/rerun/cslage/PTC_LSSTCAM_12638/calibrations/LSSTCam/defects/r01_s00/2020-10-13T01:07:04.651000 in format: BOTH
      This is the directory structure that ingestCuratedCalibs.py is looking for. When I pull up the current code, that _writeData function is gone, so the output gets written into the defects directory and ingestCuratedCalibs.py fails when it tries to read it. Perhaps I'm going about things the wrong way. I'm happy to do things a different way if you can point me in the right direction.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              czw Christopher Waters
              Reporter:
              czw Christopher Waters
              Watchers:
              Andrés Alejandro Plazas Malagón, Christopher Waters, Craig Lage
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated: