Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-17490

Identify defects in TS8 and AuxTel data

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      20
    • Epic Link:
    • Sprint:
      DRP S19-2, DRP S19-3, DRP S19-4, DRP S19-5, DRP S19-6a, DRP S19-6b, DRP F19-1, DRP F19-2, DRP F19-4
    • Team:
      Data Release Production

      Description

      The goal of this ticket is to take a first pass at identifying defects identified on TS8 & AuxTel data.

      Specifically, working on the LSST Science Platform (nb.lsst.io):

      • Make sure you have access to flats & darks from TS8 and AuxTel;
      • Check that the cosmic rays have been removed;
      • Experiment with detection code to identify n-sigma defects (both positive and negative) (this is DM-19334).
      • Critically examine the results of that detection code. File blocking tickets on this one to investigate anything which looks suspicious (the first one of these is DM-19335).
      • Work through blocking tickets, until all the suspicions are explained.
      • Job done!

      Success criteria here are just to be able to identify visually-convincing defects in a notebook; worrying about appropriate formats to persist this information is out of scope for now.

        Attachments

        1. 2018Feb15-DM17490-bright.pdf
          208 kB
        2. bright_dist_darks.png
          bright_dist_darks.png
          16 kB
        3. bright_mask_darks.png
          bright_mask_darks.png
          28 kB
        4. defects_from_dark_auxTel_cut_edge.pdf
          1.24 MB
        5. defects_from_dark_auxtel_mar29.png
          defects_from_dark_auxtel_mar29.png
          116 kB
        6. defects_from_dark.pdf
          217 kB
        7. defects_from_flat_auxTel_cut_edge.pdf
          1.21 MB
        8. defects_from_flat_auxtel_mar29.png
          defects_from_flat_auxtel_mar29.png
          154 kB
        9. defects_from_flat.pdf
          291 kB
        10. defects_list_detector_18_from_dark.dat
          7 kB
        11. image-2019-05-07-15-47-01-714.png
          image-2019-05-07-15-47-01-714.png
          1.59 MB
        12. make_butler_repo.sh
          1 kB
        13. master_flat_dark_auxtel_29mar.png
          master_flat_dark_auxtel_29mar.png
          3.10 MB
        14. TS8_APR16_defects_from_dark.pdf
          226 kB
        15. TS8_APR16_defects_from_flat.pdf
          299 kB

          Issue Links

          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19334 Use afw detection code to identify n-sigma candidate defects in AuxTel and TS8 data

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19335 Understand the “wiggles” observed when histogramming flats & darks from TS8 and AuxTel

          • Done
          is parent task of

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. CAP-214 `Too many CR pixels (max 500000)` when running `constructDark.py` on auxTel dark

          • Undefined - No priority assigned (may not apply or be unknown)
          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-18621 `Too many CR pixels (max 500000)` when running `constructDark.py` on auxTel dark

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19336 Columnar defect identifcation

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19666 Produce task for identifying defects

          • Invalid
          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

            Activity

            Ascending order - Click to sort in descending order
            26 older comments
            Hide
            Permalink
            plazas Andrés Alejandro Plazas Malagón added a comment -

            Merlin Fisher-Levine Can this ticket be marked as done? 

            Show
            plazas Andrés Alejandro Plazas Malagón added a comment - Merlin Fisher-Levine Can this ticket be marked as done? 
            Hide
            Permalink
            mfisherlevine Merlin Fisher-Levine added a comment -

            Yes, I think that's fair. Following on from this, could you file a new ticket for finding the defects for the new sensor and persisting/adding them to obs_lsst so that we can use them, probably just replacing the old ones (though I guess some may insist on adding them rather than replacing them...)?

            Show
            mfisherlevine Merlin Fisher-Levine added a comment - Yes, I think that's fair. Following on from this, could you file a new ticket for finding the defects for the new sensor and persisting/adding them to obs_lsst so that we can use them, probably just replacing the old ones (though I guess some may insist on adding them rather than replacing them...)?
            Hide
            Permalink
            plazas Andrés Alejandro Plazas Malagón added a comment -

            Can existing ticket DM-18749 be used for that? 

            Show
            plazas Andrés Alejandro Plazas Malagón added a comment - Can existing ticket  DM-18749  be used for that? 
            Hide
            Permalink
            mfisherlevine Merlin Fisher-Levine added a comment -

            Sure, that seems OK, but there is quite a lot of chat on there already, so it might also be nice to start a fresh one, especially as the defects found in that ticket have already been added to obs_lsst (right?), meaning it would be legit to close that one, claim credit, and start a new ticket. Thoughts John Swinbank?

            Show
            mfisherlevine Merlin Fisher-Levine added a comment - Sure, that seems OK, but there is quite a lot of chat on there already, so it might also be nice to start a fresh one, especially as the defects found in that ticket have already been added to obs_lsst (right?), meaning it would be legit to close that one, claim credit, and start a new ticket. Thoughts John Swinbank ?
            Hide
            Permalink
            tjenness Tim Jenness added a comment -

            Defects are in obs_lsst_data

            Show
            tjenness Tim Jenness added a comment - Defects are in obs_lsst_data

              People

              Assignee:
              plazas Andrés Alejandro Plazas Malagón
              Reporter:
              swinbank John Swinbank
              Reviewers:
              Robert Lupton
              Watchers:
              Andrés Alejandro Plazas Malagón, Chris Walter, James Chiang, John Swinbank, Merlin Fisher-Levine, Robert Lupton, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.