Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-5766

Implement spatial exposure selection task

    XMLWordPrintable

Details

    • Story
    • Status: Invalid
    • Resolution: Done
    • None
    • pipe_tasks
    • None
    • 6
    • DRP F16-4
    • Data Release Production

    Description

      Once DM-3472 lands, it will be possible to write an image selection task that uses the SQLite 3 database produced by IndexExposureTask (from daf_ingest) to search for exposures overlapping a region (in particular, the spatial extent of a coadd patch). The _rtree_search method in test_index_exposure.py (also from daf_ingest) has an example of how to perform spatial queries quickly.

      I was originally scheduled to do something in this space, but Paul mentioned that he had plans to refactor the image selection tasks already, and is much more familiar with the pipeline side of things than I am. Therefore, I'm handing off the implementation of the pipeline task mentioned in DM-3472 to him.

      Attachments

        Issue Links

          Activity

            price – I imagine that we'll want to tackle this in the May sprint. I've stubbed in a first guess at roughly how many story points might be involved, but please feel free to adjust that if you think it necessary.

            swinbank John Swinbank added a comment - price – I imagine that we'll want to tackle this in the May sprint. I've stubbed in a first guess at roughly how many story points might be involved, but please feel free to adjust that if you think it necessary.
            tjenness Tim Jenness added a comment - - edited

            Not entirely sure of the status of this ticket but I will note that daf_ingest is currently not part of lsst_apps or lsst_distrib.

            tjenness Tim Jenness added a comment - - edited Not entirely sure of the status of this ticket but I will note that daf_ingest is currently not part of lsst_apps or lsst_distrib .
            price Paul Price added a comment -

            Plan:

            • Add spatial database dataset (a sqlite database) in obs_base; will just access by filename.
            • Modify ProcessCcdTask to store results in the spatial database.
            • Modify SingleFrameDriverTask to store results in the spatial database.
            • Modify CoaddBaseTask.selectExposures and the SelectDataIdContainer to use the spatial database.
            • Modify CoaddDriverTask to use the spatial database.
            price Paul Price added a comment - Plan: Add spatial database dataset (a sqlite database) in obs_base; will just access by filename. Modify ProcessCcdTask to store results in the spatial database. Modify SingleFrameDriverTask to store results in the spatial database. Modify CoaddBaseTask.selectExposures and the SelectDataIdContainer to use the spatial database. Modify CoaddDriverTask to use the spatial database.

            Superseded by Gen3 butler. This image selection task will be converted as part of the supertask conversion epic: DM-14448

            yusra Yusra AlSayyad added a comment - Superseded by Gen3 butler. This image selection task will be converted as part of the supertask conversion epic:  DM-14448

            People

              price Paul Price
              smonkewitz Serge Monkewitz
              Hsin-Fang Chiang, John Parejko, John Swinbank, Paul Price, Serge Monkewitz, Tim Jenness, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.