Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-19334

Use afw detection code to identify n-sigma candidate defects in AuxTel and TS8 data

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Our first guess at an adequate algorithm to meet the goals of DM-17490 is simply to identify n-sigma outliers, both positive and negative, in AuxTel and TS8 data. Implement that.

        Attachments

          Issue Links

            Activity

            Hide
            plazas Andrés Alejandro Plazas Malagón added a comment -

            The code to do what is written in the description of the ticket—including modifications by Robert---can be found in: 

            /home/plazas/jhome/WORK/DM-17490/FindDefects_may7.ipynb

            It runs with w_2019_18 setup.  I attach a copy of the code as of today, for convenience. 

            FindDefects_may7.py

             

            Show
            plazas Andrés Alejandro Plazas Malagón added a comment - The code to do what is written in the description of the ticket—including modifications by Robert---can be found in:  /home/plazas/jhome/WORK/ DM-17490 /FindDefects_may7.ipynb It runs with w_2019_18 setup.  I attach a copy of the code as of today, for convenience.  FindDefects_may7.py  
            Hide
            swinbank John Swinbank added a comment - - edited

            (Changing my previous comment to say):

            Given that this is not the final outcome of DM-17490, I think it is ok for this not to exist in a git repository in the short term.

            Since paths are mutable, it's not safe to just refer to it by a filesystem location. However, attaching it to the ticket (as you have done) is fine for now.

            Please make sure a current version of the code is attached when you are ready to send this ticket for review.

            Show
            swinbank John Swinbank added a comment - - edited (Changing my previous comment to say): Given that this is not the final outcome of DM-17490 , I think it is ok for this not to exist in a git repository in the short term. Since paths are mutable, it's not safe to just refer to it by a filesystem location. However, attaching it to the ticket (as you have done) is fine for now. Please make sure a current version of the code is attached when you are ready to send this ticket for review.
            Hide
            plazas Andrés Alejandro Plazas Malagón added a comment - - edited

            Robert and I have written code that does what is written in the description of this ticket, i.e., identifies n-sigma outliers from master darks and master flats. This code has been used with AuxTel, TS8, and comCam data. The code is in the following file: FindDefects.py

            Documentation can be found in the doctrings inside the code, but the the function that does the main calculations is "find_hot_and_cold_pixels".  The code creates a directory ("output_directory") where ASCII files with the defects (as boxes) are printed. In addition, histograms and other diagnose plots are written to PDF files in that same directory. 

             

            Show
            plazas Andrés Alejandro Plazas Malagón added a comment - - edited Robert and I have written code that does what is written in the description of this ticket, i.e., identifies n-sigma outliers from master darks and master flats. This code has been used with AuxTel, TS8, and comCam data. The code is in the following file:  FindDefects.py Documentation can be found in the doctrings inside the code, but the the function that does the main calculations is "find_hot_and_cold_pixels".  The code creates a directory ("output_directory") where ASCII files with the defects (as boxes) are printed. In addition, histograms and other diagnose plots are written to PDF files in that same directory.   

              People

              Assignee:
              plazas Andrés Alejandro Plazas Malagón
              Reporter:
              swinbank John Swinbank
              Watchers:
              Andrés Alejandro Plazas Malagón, John Swinbank, Merlin Fisher-Levine
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.