Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-18621

`Too many CR pixels (max 500000)` when running `constructDark.py` on auxTel dark

    XMLWordPrintable

    Details

      Description

      When running `constructDark.py` on an auxtel dark (2019030800135, see below), the following error appears: 

       

      lsst::pex::exceptions::LengthError: 'Too many CR pixels (max 500000)'

       

      Visual inspection of 

      "AT_O_20190308_000135-ats-wfs_ccd.fits" (see directory below) shows that there are not as many CR's.

      -Data (see IMGTYPE in headers for types, which follows the entry in https://confluence.lsstcorp.org/pages/viewpage.action?spaceKey=SYSENG&title=LogBook+for+AuxTel+camera+diagnostic+data+taking under MAR08, 2019): 

      /project/plazas/data/auxtel_DMCS_images_2019-03-08/cal

      -ID: 

      WARN: Unable to process DataId(initialdata={'imageType': 'DARK', 'dayObs': '2019-03-08', 'visit': 2019030800135, 'detector': 0, 'detectorName': 'S00'}

      -Command run: 

      • constructDark.py /project/plazas/calibrations_auxtel_mar20_REPO --calib /project/plazas/calibrations_auxtel_mar20_CALIB/ --output /project/plazas/calibrations_auxtel_mar20_OUTPUT/ --id imageType='DARK' --batch-type none --clobber-config

      stack: "w_2019_11" with branch "tickets/DM-18051" of "obs_lsst"

        Attachments

          Issue Links

          is child task of

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-17490 Identify defects in TS8 and AuxTel data

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-18051 Get defect machinery working for the AuxTel

          • Done

            Activity

            Ascending order - Click to sort in descending order
            No builds found.
            plazas Andrés Alejandro Plazas Malagón created issue -
            plazas Andrés Alejandro Plazas Malagón made changes -
            Field Original Value New Value
            Link This issue is child task of DM-17490 [ DM-17490 ]
            plazas Andrés Alejandro Plazas Malagón made changes -
            Link This issue is child task of DM-18051 [ DM-18051 ]
            plazas Andrés Alejandro Plazas Malagón made changes -
            Description When running `constructDark.py` on an auxtel dark (2019030800135, see below), the following error appears: 

             

            lsst::pex::exceptions::LengthError: 'Too many CR pixels (max 500000)'

             

            Visual inspection of 

            "AT_O_20190308_000135-ats-wfs_ccd.fits" (see directory below) shows that there are not as many CR's. 
             - Data (see IMGTYPE in headers for types, which follow the entry in  under MAR08, 2019): 

            /project/plazas/data/auxtel_DMCS_images_2019-03-08/cal
             - ID: 

            WARN: Unable to process DataId(initialdata=\{'imageType': 'DARK', 'dayObs': '2019-03-08', 'visit': 2019030800135, 'detector': 0, 'detectorName': 'S00'}

            -Command run: 
             * constructDark.py /project/plazas/calibrations_auxtel_mar20_REPO --calib /project/plazas/calibrations_auxtel_mar20_CALIB/ --output /project/plazas/calibrations_auxtel_mar20_OUTPUT/ --id imageType='DARK' --batch-type none --clobber-config

            stack: "w_2019_11" with branch "tickets/DM-18051" of "obs_lsst"             		When running `constructDark.py` on an auxtel dark (2019030800135, see below), the following error appears: 

             

            lsst::pex::exceptions::LengthError: 'Too many CR pixels (max 500000)'

             

            Visual inspection of 

            "AT_O_20190308_000135-ats-wfs_ccd.fits" (see directory below) shows that there are not as many CR's. 
             - Data (see IMGTYPE in headers for types, which follows the entry in [https://confluence.lsstcorp.org/pages/viewpage.action?spaceKey=SYSENG&title=LogBook+for+AuxTel+camera+diagnostic+data+taking] under MAR08, 2019): 

            /project/plazas/data/auxtel_DMCS_images_2019-03-08/cal
             - ID: 

            WARN: Unable to process DataId(initialdata=\{'imageType': 'DARK', 'dayObs': '2019-03-08', 'visit': 2019030800135, 'detector': 0, 'detectorName': 'S00'}

            -Command run: 
             * constructDark.py /project/plazas/calibrations_auxtel_mar20_REPO --calib /project/plazas/calibrations_auxtel_mar20_CALIB/ --output /project/plazas/calibrations_auxtel_mar20_OUTPUT/ --id imageType='DARK' --batch-type none --clobber-config

            stack: "w_2019_11" with branch "tickets/DM-18051" of "obs_lsst"
            plazas Andrés Alejandro Plazas Malagón made changes -
            Description When running `constructDark.py` on an auxtel dark (2019030800135, see below), the following error appears: 

             

            lsst::pex::exceptions::LengthError: 'Too many CR pixels (max 500000)'

             

            Visual inspection of 

            "AT_O_20190308_000135-ats-wfs_ccd.fits" (see directory below) shows that there are not as many CR's. 
             - Data (see IMGTYPE in headers for types, which follows the entry in [https://confluence.lsstcorp.org/pages/viewpage.action?spaceKey=SYSENG&title=LogBook+for+AuxTel+camera+diagnostic+data+taking] under MAR08, 2019): 

            /project/plazas/data/auxtel_DMCS_images_2019-03-08/cal
             - ID: 

            WARN: Unable to process DataId(initialdata=\{'imageType': 'DARK', 'dayObs': '2019-03-08', 'visit': 2019030800135, 'detector': 0, 'detectorName': 'S00'}

            -Command run: 
             * constructDark.py /project/plazas/calibrations_auxtel_mar20_REPO --calib /project/plazas/calibrations_auxtel_mar20_CALIB/ --output /project/plazas/calibrations_auxtel_mar20_OUTPUT/ --id imageType='DARK' --batch-type none --clobber-config

            stack: "w_2019_11" with branch "tickets/DM-18051" of "obs_lsst"             		When running `constructDark.py` on an auxtel dark (2019030800135, see below), the following error appears: 

             

            lsst::pex::exceptions::LengthError: 'Too many CR pixels (max 500000)'

             

            Visual inspection of 

            "AT_O_20190308_000135-ats-wfs_ccd.fits" (see directory below) shows that there are not as many CR's. 

            - Data (see IMGTYPE in headers for types, which follows the entry in [https://confluence.lsstcorp.org/pages/viewpage.action?spaceKey=SYSENG&title=LogBook+for+AuxTel+camera+diagnostic+data+taking] under MAR08, 2019): 

            /project/plazas/data/auxtel_DMCS_images_2019-03-08/cal

            -ID: 

            WARN: Unable to process DataId(initialdata=\{'imageType': 'DARK', 'dayObs': '2019-03-08', 'visit': 2019030800135, 'detector': 0, 'detectorName': 'S00'}

            -Command run: 
             * constructDark.py /project/plazas/calibrations_auxtel_mar20_REPO --calib /project/plazas/calibrations_auxtel_mar20_CALIB/ --output /project/plazas/calibrations_auxtel_mar20_OUTPUT/ --id imageType='DARK' --batch-type none --clobber-config

            stack: "w_2019_11" with branch "tickets/DM-18051" of "obs_lsst"
            plazas Andrés Alejandro Plazas Malagón made changes -
            Description When running `constructDark.py` on an auxtel dark (2019030800135, see below), the following error appears: 

             

            lsst::pex::exceptions::LengthError: 'Too many CR pixels (max 500000)'

             

            Visual inspection of 

            "AT_O_20190308_000135-ats-wfs_ccd.fits" (see directory below) shows that there are not as many CR's. 

            - Data (see IMGTYPE in headers for types, which follows the entry in [https://confluence.lsstcorp.org/pages/viewpage.action?spaceKey=SYSENG&title=LogBook+for+AuxTel+camera+diagnostic+data+taking] under MAR08, 2019): 

            /project/plazas/data/auxtel_DMCS_images_2019-03-08/cal

            -ID: 

            WARN: Unable to process DataId(initialdata=\{'imageType': 'DARK', 'dayObs': '2019-03-08', 'visit': 2019030800135, 'detector': 0, 'detectorName': 'S00'}

            -Command run: 
             * constructDark.py /project/plazas/calibrations_auxtel_mar20_REPO --calib /project/plazas/calibrations_auxtel_mar20_CALIB/ --output /project/plazas/calibrations_auxtel_mar20_OUTPUT/ --id imageType='DARK' --batch-type none --clobber-config

            stack: "w_2019_11" with branch "tickets/DM-18051" of "obs_lsst"             		When running `constructDark.py` on an auxtel dark (2019030800135, see below), the following error appears: 

             

            lsst::pex::exceptions::LengthError: 'Too many CR pixels (max 500000)'

             

            Visual inspection of 

            "AT_O_20190308_000135-ats-wfs_ccd.fits" (see directory below) shows that there are not as many CR's.

            -Data (see IMGTYPE in headers for types, which follows the entry in [https://confluence.lsstcorp.org/pages/viewpage.action?spaceKey=SYSENG&title=LogBook+for+AuxTel+camera+diagnostic+data+taking] under MAR08, 2019): 

            /project/plazas/data/auxtel_DMCS_images_2019-03-08/cal

            -ID: 

            WARN: Unable to process DataId(initialdata=\{'imageType': 'DARK', 'dayObs': '2019-03-08', 'visit': 2019030800135, 'detector': 0, 'detectorName': 'S00'}

            -Command run: 
             * constructDark.py /project/plazas/calibrations_auxtel_mar20_REPO --calib /project/plazas/calibrations_auxtel_mar20_CALIB/ --output /project/plazas/calibrations_auxtel_mar20_OUTPUT/ --id imageType='DARK' --batch-type none --clobber-config

            stack: "w_2019_11" with branch "tickets/DM-18051" of "obs_lsst"
            Hide
            Permalink
            mfisherlevine Merlin Fisher-Levine added a comment -

            This ticket has necessitated implementing defect generation, retrieval and masking for AuxTel, which also now paves the way for this to be done for the rest of obs_lsst.

            Show
            mfisherlevine Merlin Fisher-Levine added a comment - This ticket has necessitated implementing defect generation, retrieval and masking for AuxTel, which also now paves the way for this to be done for the rest of obs_lsst.
            Hide
            Permalink
            mfisherlevine Merlin Fisher-Levine added a comment -

            Overlap with work already done for this ticket on DM-18051 meant that, rather tying myself and others in git-knots, I just did the work for this on that ticket.

            Show
            mfisherlevine Merlin Fisher-Levine added a comment - Overlap with work already done for this ticket on DM-18051 meant that, rather tying myself and others in git-knots, I just did the work for this on that ticket.
            mfisherlevine Merlin Fisher-Levine made changes -
            Component/s atmospec [ 15702 ]
            Component/s obs_base [ 10719 ]
            Component/s obs_lsst [ 16504 ]
            Reviewers Merlin Fisher-Levine [ mfisherlevine ]
            Story Points 5
            mfisherlevine Merlin Fisher-Levine made changes -
            Status To Do [ 10001 ] To Do [ 10001 ]
            mfisherlevine Merlin Fisher-Levine made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            Hide
            Permalink
            mfisherlevine Merlin Fisher-Levine added a comment -

            Code for this is on DM-18051, so just marking this as Done for the story points I spent doing the coding on that ticket.

            Show
            mfisherlevine Merlin Fisher-Levine added a comment - Code for this is on DM-18051 , so just marking this as Done for the story points I spent doing the coding on that ticket.
            mfisherlevine Merlin Fisher-Levine made changes -
            Resolution Done [ 10000 ]
            Status In Progress [ 3 ] Done [ 10002 ]
            swinbank John Swinbank made changes -
            Epic Link DM-16686 [ 235248 ]

              People

              Assignee:
              mfisherlevine Merlin Fisher-Levine
              Reporter:
              plazas Andrés Alejandro Plazas Malagón
              Reviewers:
              Merlin Fisher-Levine
              Watchers:
              Andrés Alejandro Plazas Malagón, Merlin Fisher-Levine
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.