Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-372

Add HiTS 2014, 2015 DECam data to /datasets

    Details

    • Type: RFC
    • Status: Implemented
    • Resolution: Done
    • Component/s: DM
    • Labels:
      None

      Description

      We are planning to use three fields from the High-cadence Transient Survey (HiTS; Forster, et al (2016), ApJ 832:155) for the alert production verification system (ap_verify). These three fields were imaged in both 2014 and 2015 with DECam and thus can be used for effectively testing the alert production pipelines. We have already packaged up these three fields (Blind15A_26, Blind15A_40, and Blind15A_42) from 2015 into the ap_verify_hits2015 repo.

      The plan is to also set up the three fields for both 2014 and 2015 in /datasets in the /datasets/decam/hits subdirectory, with separate additional subdirectories for each of the two years' exposures and then by each field. We will also include relevant master calibs and Gaia and PS1 reference catalogs in HTM format that overlap these three fields.

      We would also like to include pre-generated coadds to be used as templates for image subtraction. The current thought is to place these under PREPROCESSED/templates.

        Attachments

          Issue Links

            Activity

            Hide
            ctslater Colin Slater added a comment -

            Why does the calib repo live inside _internal/?

            Show
            ctslater Colin Slater added a comment - Why does the calib repo live inside _internal/ ?
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            Why does the calib repo live inside _internal/?

            RFC-308

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Why does the calib repo live inside _internal/? RFC-308
            Hide
            reiss David Reiss added a comment - - edited

            Last call for comments before I consider this RFC adopted. I have downloaded the HiTS 2014/2015 data. Below is the final implementation plan, derived from the comments above:

            1. Make sure to remove all calib {{wtmap}}s first.
            2. Place all raw HiTS data in /datasets/decam/_internal/raw/hits/ in separate subdirectories for each Blind* field.
            3. Place all MasterCals in /datasets/decam/_internal/preprocessed/masterCal/hits/.
            4. Ingest raw exposures into /datasets/decam/ via

            ingestImagesDecam.py /datasets/decam --filetype raw --mode=link /datasets/decam/_internal/raw/hits/Blind*/*fz
            

            5. Ingest MasterCals into /datasets/decam/_internal/calib/cpHits/ via

            ingestCalibs.py /datasets/decam --calib /datasets/decam/_internal/calib/cpHits --mode=link /datasets/decam/_internal/preprocessed/masterCal/hits/*fz --validity 999
            

            I will not copy over or ingest the InstCals.

            Show
            reiss David Reiss added a comment - - edited Last call for comments before I consider this RFC adopted. I have downloaded the HiTS 2014/2015 data. Below is the final implementation plan, derived from the comments above: 1. Make sure to remove all calib {{wtmap}}s first. 2. Place all raw HiTS data in /datasets/decam/_internal/raw/hits/ in separate subdirectories for each Blind* field. 3. Place all MasterCals in /datasets/decam/_internal/preprocessed/masterCal/hits/ . 4. Ingest raw exposures into /datasets/decam/ via ingestImagesDecam.py /datasets/decam --filetype raw --mode=link /datasets/decam/_internal/raw/hits/Blind*/*fz 5. Ingest MasterCals into /datasets/decam/_internal/calib/cpHits/ via ingestCalibs.py /datasets/decam --calib /datasets/decam/_internal/calib/cpHits --mode=link /datasets/decam/_internal/preprocessed/masterCal/hits/*fz --validity 999 I will not copy over or ingest the InstCals.
            Hide
            reiss David Reiss added a comment -

            Implementation ticket: DM-11371

            Show
            reiss David Reiss added a comment - Implementation ticket: DM-11371
            Hide
            reiss David Reiss added a comment - - edited

            Also adding defects:

            cd /datasets/decam/_internal/calib/cpHits
            ingestCalibs.py /datasets/decam/ --calib . --validity 0 --calibType defect --mode skip ../bpmDes/20*/*fits --noExit --ignore-ingested
            

            Show
            reiss David Reiss added a comment - - edited Also adding defects: cd /datasets/decam/_internal/calib/cpHits ingestCalibs.py /datasets/decam/ --calib . --validity 0 --calibType defect --mode skip ../bpmDes/20*/*fits --noExit --ignore-ingested

              People

              • Assignee:
                reiss David Reiss
                Reporter:
                reiss David Reiss
                Watchers:
                Colin Slater, David Reiss, Eric Bellm, Hsin-Fang Chiang, Krzysztof Findeisen, Paul Price
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:
                  Planned End:

                  Summary Panel