Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9799

Learn to run meas_mosaic with HSC data

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      For the upcoming HSC reprocessing on lsstvc, learn the basics of the meas_mosaic package, what tasks are needed in HSC processing, how to run those tasks, and document the inputs and outputs of these tasks.

        Attachments

          Activity

          Ascending order - Click to sort in descending order
          Hide
          Permalink
          hchiang2 Hsin-Fang Chiang added a comment -

          The newest tagged stack compatible with meas_mosaic without version mismatch is w_2017_10. Stacks newer than that have pybind11 work merged; meas_mosaic is not wrapped by pybind11 but it will be retired soon.

          With w_2017_10 I was able to run MosaicTask (mosaic.py) on some HSC COSMOS data from DM-9053.

          inputs and outputs

          1. mosaic.py MosaicTask
            inputs: skymap, calexp, src, srcMatch, and refcat (astrometry_net_data)
            outputs: wcs, fcr
          2. calibrateExposure.py CalibrateExposureTask
            inputs: calexp, wcs, fcr
            outputs: calibrated_exp
          3. calibrateCatalog.py CalibrateCatalogTask
            inputs: calexp, wcs, fcr
            outputs: calibrated_src
          4. checkMosaic.py CheckMosaicTask
            inputs: calexp, wcs, fcr, src, icSrc, icMatch

          Likely only the MosaicTask is needed. For MosaicTask, each tract can be processed independently. It uses meas.base.forcedPhotCcd.PerTractCcdDataIdContainer and internally use multiprocessing with command line argument numCoresForReadSource.

          Show
          hchiang2 Hsin-Fang Chiang added a comment - The newest tagged stack compatible with meas_mosaic without version mismatch is w_2017_10 . Stacks newer than that have pybind11 work merged; meas_mosaic is not wrapped by pybind11 but it will be retired soon. With w_2017_10 I was able to run MosaicTask ( mosaic.py ) on some HSC COSMOS data from DM-9053 . inputs and outputs mosaic.py MosaicTask inputs: skymap, calexp, src, srcMatch, and refcat (astrometry_net_data) outputs: wcs, fcr calibrateExposure.py CalibrateExposureTask inputs: calexp, wcs, fcr outputs: calibrated_exp calibrateCatalog.py CalibrateCatalogTask inputs: calexp, wcs, fcr outputs: calibrated_src checkMosaic.py CheckMosaicTask inputs: calexp, wcs, fcr, src, icSrc, icMatch Likely only the MosaicTask is needed. For MosaicTask, each tract can be processed independently. It uses meas.base.forcedPhotCcd.PerTractCcdDataIdContainer and internally use multiprocessing with command line argument numCoresForReadSource .
          Hide
          Permalink
          hchiang2 Hsin-Fang Chiang added a comment -

          Note: meas_mosaic was then wrapped in DM-9887

          Show
          hchiang2 Hsin-Fang Chiang added a comment - Note: meas_mosaic was then wrapped in DM-9887

            People

            Assignee:
            hchiang2 Hsin-Fang Chiang
            Reporter:
            hchiang2 Hsin-Fang Chiang
            Watchers:
            Hsin-Fang Chiang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.