Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-30651

Switch DECam overscan correction to median per row

    XMLWordPrintable

    Details

      Description

      update Jan 2022

      Original ticket title: Investigate amp background level offsets in DECam postISRCCDs

      This ticket updates the DECam ISR overscan correction config parameter fitType='MEDIAN_PER_ROW'. A large body of evidence (see comments below) point towards this being a superior approach at handling overscan corrections with DECam. This also brings Science Pipelines data processing in-line with the DECam Community Pipeline, which also fits per row.

      Original ticket efforts by Kenneth Herner, original description below:

      If you scroll through here, the problem is immediately apparent

      https://lsst.ncsa.illinois.edu/~lskelvin/hits2014/

      Hat-tip to Lee Kelvin for noticing this problem and plotting the images. This feels very familiar to when ISR order of operations was inconsistent regarding when assembleCcd happens, but I don't remember the resolution.

      Possibly relevant and/or wrong: https://community.lsst.org/t/a-change-to-the-order-of-operations-for-isr/3060 

        Attachments

        1. merian_bias_01.png
          merian_bias_01.png
          821 kB
        2. merian_bias_35.png
          merian_bias_35.png
          909 kB
        3. merian_bias_45.png
          merian_bias_45.png
          800 kB
        4. merian_flat_01.png
          merian_flat_01.png
          2.97 MB
        5. merian_flat_05.png
          merian_flat_05.png
          2.60 MB
        6. merian_flat_25.png
          merian_flat_25.png
          3.07 MB
        7. merian_flat_35.png
          merian_flat_35.png
          4.36 MB
        8. merian_flat_45.png
          merian_flat_45.png
          2.66 MB
        9. merian_flat_55.png
          merian_flat_55.png
          3.99 MB

          Issue Links

            Activity

            mrawls Meredith Rawls created issue -
            mrawls Meredith Rawls made changes -
            Field Original Value New Value
            Link This issue relates to DM-30495 [ DM-30495 ]
            mrawls Meredith Rawls made changes -
            Link This issue relates to DM-15152 [ DM-15152 ]
            sullivan Ian Sullivan made changes -
            Labels SciencePipelines SciencePipelines ap-analysis
            sullivan Ian Sullivan made changes -
            Assignee Meredith Rawls [ mrawls ]
            sullivan Ian Sullivan made changes -
            Assignee Meredith Rawls [ mrawls ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_bias_01.png [ 50087 ]
            Attachment merian_bias_35.png [ 50088 ]
            Attachment merian_bias_45.png [ 50089 ]
            mrawls Meredith Rawls made changes -
            Link This issue relates to DM-30703 [ DM-30703 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_01.png [ 50158 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_05.png [ 50159 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_25.png [ 50160 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_35.png [ 50161 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_45.png [ 50162 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_55.png [ 50163 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_01.png [ 50158 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_05.png [ 50159 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_25.png [ 50160 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_35.png [ 50161 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_45.png [ 50162 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_55.png [ 50163 ]
            lskelvin Lee Kelvin made changes -
            Attachment merian_flat_01.png [ 50164 ]
            Attachment merian_flat_05.png [ 50165 ]
            Attachment merian_flat_25.png [ 50166 ]
            Attachment merian_flat_35.png [ 50167 ]
            Attachment merian_flat_45.png [ 50168 ]
            Attachment merian_flat_55.png [ 50169 ]
            sullivan Ian Sullivan made changes -
            Assignee Meredith Rawls [ mrawls ]
            sullivan Ian Sullivan made changes -
            Assignee Meredith Rawls [ mrawls ] Kenneth Herner [ kherner ]
            sullivan Ian Sullivan made changes -
            Epic Link DM-30436 [ 504824 ]
            Sprint AP F21-2 (July) [ 1102 ]
            Team Alert Production [ 10300 ]
            sullivan Ian Sullivan made changes -
            Sprint AP F21-2 (July) [ 1102 ] AP F21-3 (August) [ 1109 ]
            sullivan Ian Sullivan made changes -
            Rank Ranked higher
            sullivan Ian Sullivan made changes -
            Sprint AP F21-3 (August) [ 1109 ] AP F21-4 (September) [ 1113 ]
            sullivan Ian Sullivan made changes -
            Rank Ranked higher
            sullivan Ian Sullivan made changes -
            Sprint AP F21-4 (September) [ 1113 ] AP F21-5 (October) [ 1119 ]
            sullivan Ian Sullivan made changes -
            Rank Ranked higher
            sullivan Ian Sullivan made changes -
            Epic Link DM-30436 [ 504824 ] DM-30501 [ 510159 ]
            sullivan Ian Sullivan made changes -
            Sprint AP F21-5 (October) [ 1119 ] AP F21-6 (November) [ 1124 ]
            sullivan Ian Sullivan made changes -
            Rank Ranked lower
            sullivan Ian Sullivan made changes -
            Sprint AP F21-6 (November) [ 1124 ] AP S22-1 (December) [ 1126 ]
            sullivan Ian Sullivan made changes -
            Rank Ranked lower
            sullivan Ian Sullivan made changes -
            Epic Link DM-30501 [ 510159 ] DM-30502 [ 510160 ]
            sullivan Ian Sullivan made changes -
            Sprint AP S22-1 (December) [ 1126 ] AP S22-2 (January) [ 1130 ]
            sullivan Ian Sullivan made changes -
            Rank Ranked lower
            lskelvin Lee Kelvin made changes -
            Link This issue relates to DM-33096 [ DM-33096 ]
            lskelvin Lee Kelvin made changes -
            Link This issue relates to DM-33096 [ DM-33096 ]
            lskelvin Lee Kelvin made changes -
            Epic Link DM-30502 [ 510160 ] DM-30543 [ 511201 ]
            Sprint AP S22-2 (January) [ 1130 ]
            Story Points 2 4
            Team Alert Production [ 10300 ] Data Release Production [ 10301 ]
            Assignee Kenneth Herner [ kherner ] Lee Kelvin [ lskelvin ]
            Description If you scroll through here, the problem is immediately apparent

            [https://lsst.ncsa.illinois.edu/~lskelvin/hits2014/]

            Hat-tip to [~lskelvin] for noticing this problem and plotting the images. This feels very familiar to when ISR order of operations was inconsistent regarding when assembleCcd happens, but I don't remember the resolution.

            Possibly relevant and/or wrong: [https://community.lsst.org/t/a-change-to-the-order-of-operations-for-isr/3060
            {panel:title=update}
            Original ticket title: Investigate amp background level offsets in DECam postISRCCDs

            This ticket updates the DECam ISR overscan correction config parameter {{fitType='MEDIAN_PER_ROW'}}. A large body of evidence (see comments below) point towards this being a superior approach at handling overscan corrections with DECam. This also brings Science Pipelines data processing in-line with the DECam Community Pipeline, which also fits per row.

            Original ticket efforts by [~kherner], original description below:
            {panel}

            If you scroll through here, the problem is immediately apparent

            [https://lsst.ncsa.illinois.edu/~lskelvin/hits2014/]

            Hat-tip to [~lskelvin] for noticing this problem and plotting the images. This feels very familiar to when ISR order of operations was inconsistent regarding when assembleCcd happens, but I don't remember the resolution.

            Possibly relevant and/or wrong: [https://community.lsst.org/t/a-change-to-the-order-of-operations-for-isr/3060
            Issue Type Bug [ 1 ] Story [ 10001 ]
            Summary Investigate amp background level offsets in DECam postISRCCDs Switch DECam overscan correction to median per row
            lskelvin Lee Kelvin made changes -
            Reviewers Kenneth Herner [ kherner ]
            lskelvin Lee Kelvin made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            lskelvin Lee Kelvin made changes -
            Description {panel:title=update}
            Original ticket title: Investigate amp background level offsets in DECam postISRCCDs

            This ticket updates the DECam ISR overscan correction config parameter {{fitType='MEDIAN_PER_ROW'}}. A large body of evidence (see comments below) point towards this being a superior approach at handling overscan corrections with DECam. This also brings Science Pipelines data processing in-line with the DECam Community Pipeline, which also fits per row.

            Original ticket efforts by [~kherner], original description below:
            {panel}

            If you scroll through here, the problem is immediately apparent

            [https://lsst.ncsa.illinois.edu/~lskelvin/hits2014/]

            Hat-tip to [~lskelvin] for noticing this problem and plotting the images. This feels very familiar to when ISR order of operations was inconsistent regarding when assembleCcd happens, but I don't remember the resolution.

            Possibly relevant and/or wrong: [https://community.lsst.org/t/a-change-to-the-order-of-operations-for-isr/3060
            {panel:title=update Jan 2022}
            Original ticket title: Investigate amp background level offsets in DECam postISRCCDs

            This ticket updates the DECam ISR overscan correction config parameter {{fitType='MEDIAN_PER_ROW'}}. A large body of evidence (see comments below) point towards this being a superior approach at handling overscan corrections with DECam. This also brings Science Pipelines data processing in-line with the DECam Community Pipeline, which also fits per row.

            Original ticket efforts by [~kherner], original description below:
            {panel}

            If you scroll through here, the problem is immediately apparent

            [https://lsst.ncsa.illinois.edu/~lskelvin/hits2014/]

            Hat-tip to [~lskelvin] for noticing this problem and plotting the images. This feels very familiar to when ISR order of operations was inconsistent regarding when assembleCcd happens, but I don't remember the resolution.

            Possibly relevant and/or wrong: [https://community.lsst.org/t/a-change-to-the-order-of-operations-for-isr/3060
            lskelvin Lee Kelvin made changes -
            Status In Progress [ 3 ] In Review [ 10004 ]
            lskelvin Lee Kelvin made changes -
            Link This issue relates to DM-33096 [ DM-33096 ]
            kherner Kenneth Herner made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            kherner Kenneth Herner made changes -
            Link This issue split to DM-33126 [ DM-33126 ]
            lskelvin Lee Kelvin made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            lskelvin Lee Kelvin made changes -
            Link This issue relates to DM-35252 [ DM-35252 ]

              People

              Assignee:
              lskelvin Lee Kelvin
              Reporter:
              mrawls Meredith Rawls
              Reviewers:
              Kenneth Herner
              Watchers:
              Christopher Waters, Dino Bektesevic, Eric Bellm, Ian Sullivan, Kenneth Herner, Lee Kelvin, Meredith Rawls
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins Builds

                  No builds found.