Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4191

Initial code change to run ISR with DECam raw data

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: obs_decam, pipe_tasks
    • Labels:
      None

      Description

      This ticket is for implementing changes in obs_decam in order to run processCcd with raw DECam data.

      Changes are mostly in DecamMapper and a new class DecamIsrTask is added. A test to retrieve defects with Butler is also added. (testdata_decam is at lsst-dev /lsst8/testdata_decam/ )

      The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into obs_decam repository so they are treated similarly as other calibration products.

      With the changes of this ticket, the following ingest defects files into calibRegistry:

      ingestCalibs.py . --calibType defect path-to-bpm/*fits

      and the following should run past ISR:

      processCcd.py .  --config isr.doFringe=False isr.assembleCcd.setGain=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"

      Running fringe correction with DECam raw data will be in future tickets (DM-4223 and possibly more). Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).

        Attachments

          Issue Links

          is triggering

          Bug - A problem which impairs or prevents the functions of the product. DM-4297 obs_decam tests/getId.py fails

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-357 Include obs_decam into official LSST repositories

          • Done

            Activity

            Ascending order - Click to sort in descending order
            hchiang2 Hsin-Fang Chiang created issue -
            hchiang2 Hsin-Fang Chiang made changes -
            Field Original Value New Value
            Epic Link DM-3750 [ 19973 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Description This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data. This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
               {{ingestCalibs.py . --calibType defect path-to-bpm/*fits}}

            and the following should run past ISR:
                {{processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment" }}
            hchiang2 Hsin-Fang Chiang made changes -
            Description This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
               {{ingestCalibs.py . --calibType defect path-to-bpm/*fits}}

            and the following should run past ISR:
                {{processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment" }}
            		This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
                ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            hchiang2 Hsin-Fang Chiang made changes -
            Description This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
                ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            		This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            hchiang2 Hsin-Fang Chiang made changes -
            Description This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            		This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            Running fringe correction with DECam raw data will be in a future ticket. Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).
            hchiang2 Hsin-Fang Chiang made changes -
            Description This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            Running fringe correction with DECam raw data will be in a future ticket. Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).
            		This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            Running fringe correction with DECam raw data will be in a future ticket (DM-4223). Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).
            hchiang2 Hsin-Fang Chiang made changes -
            Description This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            Running fringe correction with DECam raw data will be in a future ticket (DM-4223). Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).
            		This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            Changes are mostly in {{DecamMapper}} and a new class {{DecamIsrTask}} is added. A test to retrieve defects with Butler is also added.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            Running fringe correction with DECam raw data will be in future tickets (DM-4223 and possibly more). Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).
            hchiang2 Hsin-Fang Chiang made changes -
            Reviewers Russell Owen [ rowen ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Component/s pipe_tasks [ 10726 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Description This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            Changes are mostly in {{DecamMapper}} and a new class {{DecamIsrTask}} is added. A test to retrieve defects with Butler is also added.

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            Running fringe correction with DECam raw data will be in future tickets (DM-4223 and possibly more). Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).
            		This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            Changes are mostly in {{DecamMapper}} and a new class {{DecamIsrTask}} is added. A test to retrieve defects with Butler is also added. ({{testdata_decam}} is at lsst-dev /lsst8/testdata_decam/ )

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            Running fringe correction with DECam raw data will be in future tickets (DM-4223 and possibly more). Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).
            rowen Russell Owen made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Description This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            Changes are mostly in {{DecamMapper}} and a new class {{DecamIsrTask}} is added. A test to retrieve defects with Butler is also added. ({{testdata_decam}} is at lsst-dev /lsst8/testdata_decam/ )

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            Running fringe correction with DECam raw data will be in future tickets (DM-4223 and possibly more). Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).
            		This ticket is for implementing changes in {{obs_decam}} in order to run {{processCcd}} with raw DECam data.

            Changes are mostly in {{DecamMapper}} and a new class {{DecamIsrTask}} is added. A test to retrieve defects with Butler is also added. ({{testdata_decam}} is at lsst-dev /lsst8/testdata_decam/ )

            The pixels with bit 1 (bad, hot/dead pixel/column) from the Community Pipeline Bad Pixel Masks are used as bad pixels. The CP BPM fits files are directly used as defect files. Due to their large size, they probably should not go into {{obs_decam}} repository so they are treated similarly as other calibration products.

            With the changes of this ticket, the following ingest defects files into {{calibRegistry}}:
            {code:java}
            ingestCalibs.py . --calibType defect path-to-bpm/*fits
            {code}

            and the following should run past ISR:
            {code:java}
            processCcd.py . --config isr.doFringe=False isr.assembleCcd.setGain=False calibrate.doPhotoCal=False calibrate.doAstrometry=False calibrate.measurePsf.starSelector.name="secondMoment"
            {code}

            Running fringe correction with DECam raw data will be in future tickets (DM-4223 and possibly more). Also this ticket does not cover implementing or porting new ISR functionalities that haven't yet been included in ip_isr (such as crosstalk).
            hchiang2 Hsin-Fang Chiang made changes -
            Story Points 14
            hchiang2 Hsin-Fang Chiang made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Link This issue is triggering DM-4297 [ DM-4297 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-357 [ DM-357 ]
            jbecla Jacek Becla made changes -
            Team Process Middleware [ 10206 ]
            frossie Frossie Economou made changes -
            Team Process Middleware [ 10206 ] Data Facility [ 12219 ]

              People

              Assignee:
              hchiang2 Hsin-Fang Chiang
              Reporter:
              hchiang2 Hsin-Fang Chiang
              Reviewers:
              Russell Owen
              Watchers:
              Hsin-Fang Chiang, Paul Price, Russell Owen
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.