Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-26047

Defect calibration product filename collision

    XMLWordPrintable

    Details

      Description

      I have been creating defect calibration products to use when running measurePhotonTransferCurve.py.  After ingestion, the defect calibration product filenames have the sensor number (Sxx) but not the raft number (Rxx) or detector number, and so are not unique.  An example filename is CALIB/defects/2019-10-12T15\:02\:16.071000/defects-2019-10-12T15\:02\:16.071000-S11.fits.  When running BOT data, both detector 40 (R11_S11) and detector 85 (R21_S11) ended up with the same filename.  

      The defect files were created with:

      findDefects.py /project/shared/BOT --calib /project/shared/BOT/rerun/cslage/CALIB --rerun /project/shared/BOT/rerun/cslage/E2V_6790D_40^85 --id detector=40^85 --visitList=3019101200480 -c mode=MASTER writeAs=BOTH badOnAndOffPixelColumnThreshold=500
      

      and ingested with:

      ingestCuratedCalibs.py /project/shared/BOT /project/shared/BOT/rerun/cslage/E2V_6790D_40^85/calibrations/lsstCam/defects --calib /project/shared/BOT/rerun/cslage/CALIB --config clobber=True --ignore-ingested
      

        Attachments

          Activity

          Hide
          tjenness Tim Jenness added a comment -

          This is possibly because the file template in gen2 was only tested for LATISS.

          Show
          tjenness Tim Jenness added a comment - This is possibly because the file template in gen2 was only tested for LATISS.
          Hide
          mfisherlevine Merlin Fisher-Levine added a comment -

          It is indeed almost certainly that. Looks like a quick user branch fix I made for Craig as a temp fix is working so I'll likely just migrate that to be this ticket.

          Show
          mfisherlevine Merlin Fisher-Levine added a comment - It is indeed almost certainly that. Looks like a quick user branch fix I made for Craig as a temp fix is working so I'll likely just migrate that to be this ticket.
          Hide
          czw Christopher Waters added a comment -

          Looks fine if Jenkins comes back clean.

          Show
          czw Christopher Waters added a comment - Looks fine if Jenkins comes back clean.
          Hide
          swinbank John Swinbank added a comment -

          Merlin Fisher-Levine: You MUST add story points before you close a ticket. I'll reopen this one; please take care of it.

          Show
          swinbank John Swinbank added a comment - Merlin Fisher-Levine : You MUST add story points before you close a ticket. I'll reopen this one; please take care of it.
          Hide
          mfisherlevine Merlin Fisher-Levine added a comment -

          Sorry

          Show
          mfisherlevine Merlin Fisher-Levine added a comment - Sorry

            People

            Assignee:
            mfisherlevine Merlin Fisher-Levine
            Reporter:
            cslage Craig Lage
            Reviewers:
            Christopher Waters
            Watchers:
            Christopher Waters, Craig Lage, John Swinbank, Merlin Fisher-Levine, Tim Jenness
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: