Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-26350

Run Camera code at NCSA to replicate results

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We would like to run Camera code and scripts regarding sensor characterization at NCSA.

      The list of detector effects is long (c.f., https://confluence.lsstcorp.org/display/DM/Sensor+Characterization+and+ISR#/) but we can come up in this ticket with priorities (e..g, CTI correction, NL-crosstalk, bias instability, etc.) This ticket will serve as a parent ticket to other tickets related to this work.

      We should identify the data that is needed (and if that data is already at NCSA), and the code/scripts needed to run it.

        Attachments

          Issue Links

            Activity

            Hide
            plazas Andrés Alejandro Plazas Malagón added a comment - - edited

            On the CCP stand-up meeting today (https://confluence.lsstcorp.org/display/DM/2020-08-17+Calibration+Products+Standup), we agreed that the CTI correction work by Adam Snyder and colleagues at SLAC should be a priority (ticket: DM-26352) Robert has been working recently on reproducing the analysts on bias stability by J. Chiang, S. Digel, A. Roodman, and others at SLAC on ComCam data (e.g., https://lsstc.slack.com/archives/CQ4SMS3QQ/p1596835699261700 and https://lsstc.slack.com/archives/CBV7K0DK6/p1597414740316900 ).

            Show
            plazas Andrés Alejandro Plazas Malagón added a comment - - edited On the CCP stand-up meeting today ( https://confluence.lsstcorp.org/display/DM/2020-08-17+Calibration+Products+Standup ), we agreed that the CTI correction work by Adam Snyder and colleagues at SLAC should be a priority (ticket: DM-26352 ) Robert has been working recently on reproducing the analysts on bias stability by J. Chiang, S. Digel, A. Roodman, and others at SLAC on ComCam data (e.g., https://lsstc.slack.com/archives/CQ4SMS3QQ/p1596835699261700 and https://lsstc.slack.com/archives/CBV7K0DK6/p1597414740316900 ).
            Show
            plazas Andrés Alejandro Plazas Malagón added a comment - - edited Data: Every file that has been transferred to NCSA: https://confluence.lsstcorp.org/pages/viewpage.action?spaceKey=~emorganson&title=File+Transfer+and+Ingest+Pages SLAC data: Runs of Interest: Nine Science and Four Corner Raft EO Runs: https://confluence.slac.stanford.edu/pages/viewpage.action?spaceKey=LSSTCAM&title=Nine+Science+and+Four+Corner+Raft+EO+Runs Run 4: https://confluence.slac.stanford.edu/display/LSSTCAM/Full+Focal+Plane+Data+Taking+-+Run4 For I&T TS8 single raft data: https://confluence.slac.stanford.edu/display/LSSTCAM/List+of+Good+Runs for the list of Good Runs for each Raft.
            Hide
            plazas Andrés Alejandro Plazas Malagón added a comment - - edited

            List of measurements to replicate:

            • Serial CTI measurement and correction (Snyder+19, Snyder+20(in prep.): PUB-109): DM-26352
            • Crosstalk measurements: Adam Snyder is working on changing/improving their current xtalk algorithm; they will produce new analyses, so it is recommended to wait until then: DM-26542
            • Bias instabilities: Robert has been looking into this with recent BOT and ComCam data
            • Fe55 analyses (e.g., gain): DM-26468
            • Read Noise DM-26484
            • Bright Pixels: DM-26481
            • Dark Current: DM-26487
            • Parallel, serial CTI: DM-26516
            • Blooming Full well
            • Nonlinearity
            • Pixel Response Non-Uniformity
            • Quantum Efficiency (ugrizy)
            Show
            plazas Andrés Alejandro Plazas Malagón added a comment - - edited List of measurements to replicate: Serial CTI measurement and correction (Snyder+19, Snyder+20(in prep.): PUB-109): DM-26352 Crosstalk measurements: Adam Snyder is working on changing/improving their current xtalk algorithm; they will produce new analyses, so it is recommended to wait until then: DM-26542 Bias instabilities: Robert has been looking into this with recent BOT and ComCam data Fe55 analyses (e.g., gain): DM-26468 Read Noise DM-26484 Bright Pixels: DM-26481 Dark Current: DM-26487 Parallel, serial CTI: DM-26516 Blooming Full well Nonlinearity Pixel Response Non-Uniformity Quantum Efficiency (ugrizy)
            Hide
            mfisherlevine Merlin Fisher-Levine added a comment -

            Just in case you're about to work on it, I just wanted to say I don't think the Quantum Efficiency (ugrizy) one is worth doing. There may be others, too, but that's the main one I'd drop.

            Show
            mfisherlevine Merlin Fisher-Levine added a comment - Just in case you're about to work on it, I just wanted to say I don't think the Quantum Efficiency (ugrizy) one is worth doing. There may be others, too, but that's the main one I'd drop.
            Hide
            swinbank John Swinbank added a comment -

            Let's ticket the crosstalk work, even if we're not currently able to work on it. I'll do so.

            Show
            swinbank John Swinbank added a comment - Let's ticket the crosstalk work, even if we're not currently able to work on it. I'll do so.
            Hide
            plazas Andrés Alejandro Plazas Malagón added a comment -

            From conversations with Jim Chiang: eotest was started around 2012, and the idea was to use the DM stack as much as possible. They ended up using mostly the low-level primitives.

            LCA-10103 describes the algorithms that are implemented in eotest: LCA-10103-A-APPROVED_%28CCD_EOTest_Methods%29 copy.pdf

            Show
            plazas Andrés Alejandro Plazas Malagón added a comment - From conversations with Jim Chiang: eotest was started around 2012, and the idea was to use the DM stack as much as possible. They ended up using mostly the low-level primitives. LCA-10103 describes the algorithms that are implemented in eotest: LCA-10103-A-APPROVED_%28CCD_EOTest_Methods%29 copy.pdf

              People

              Assignee:
              plazas Andrés Alejandro Plazas Malagón
              Reporter:
              plazas Andrés Alejandro Plazas Malagón
              Reviewers:
              Christopher Waters
              Watchers:
              Andrés Alejandro Plazas Malagón, Christopher Waters, John Swinbank, Merlin Fisher-Levine, Robert Lupton
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.