Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32895

Add matchObjectToTruth to obs_lsst's imsim DRP.yaml

    XMLWordPrintable

Details

    • 2
    • Data Release Production
    • No

    Description

      Following DM-32034, add the MatchTractCatalog task to DRP.yaml for LSSTCam/imsim, so it can be used to compute tract-level coadd metrics.

      I think it can go on step3 as it only relies on writeObjectTable. For DP0.2, it will need a backport and for someone to ingest the truth summary tables following PREOPS-584.

      Attachments

        Activity

          dtaranu Dan Taranu added a comment - - edited

          Passed Jenkins here.

          Also ran the following butler steps for /repo/dc2 on lsst-devl*:

          butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/test-med-1" "2.2i/truth_summary"
          butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/DP0.2" "2.2i/truth_summary"
          butler associate /repo/dc2 2.2i/truth_summary/ci_imsim -d truth_summary --collections 2.2i/truth_summary --where "skymap='DC2' and tract=3828"
          butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/ci_imsim" "2.2i/truth_summary/ci_imsim"
          

          Also ingested the truth_summary tables on the cloud for DP0.2 thanks to hchiang2 and will add the collections to the relevant default(s) tomorrow.

          dtaranu Dan Taranu added a comment - - edited Passed Jenkins here. Also ran the following butler steps for /repo/dc2 on lsst-devl* : butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/test-med-1" "2.2i/truth_summary" butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/DP0.2" "2.2i/truth_summary" butler associate /repo/dc2 2.2i/truth_summary/ci_imsim -d truth_summary --collections 2.2i/truth_summary --where "skymap='DC2' and tract=3828" butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/ci_imsim" "2.2i/truth_summary/ci_imsim" Also ingested the truth_summary tables on the cloud for DP0.2 thanks to hchiang2 and will add the collections to the relevant default(s) tomorrow.

          only comment is on obs_lsstĀ 

          yusra Yusra AlSayyad added a comment - only comment is on obs_lsstĀ 
          dtaranu Dan Taranu added a comment -

          Renamed as suggested and merged.

          dtaranu Dan Taranu added a comment - Renamed as suggested and merged.
          dtaranu Dan Taranu added a comment -

          Also ran the following on https://data-int.lsst.cloud:

          export BUTLER_DC2="s3://butler-us-central1-panda-dev/dc2/butler-external.yaml"
          butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults" "2.2i/truth_summary"
          butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/test-med-1" "2.2i/truth_summary"
          butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/DP0.2" "2.2i/truth_summary"
          butler associate $BUTLER_DC2 2.2i/truth_summary/ci_imsim -d truth_summary --collections 2.2i/truth_summary --where "skymap='DC2' and tract=3828"
          butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/ci_imsim" "2.2i/truth_summary/ci_imsim"
          

          dtaranu Dan Taranu added a comment - Also ran the following on https://data-int.lsst.cloud : export BUTLER_DC2="s3://butler-us-central1-panda-dev/dc2/butler-external.yaml" butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults" "2.2i/truth_summary" butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/test-med-1" "2.2i/truth_summary" butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/DP0.2" "2.2i/truth_summary" butler associate $BUTLER_DC2 2.2i/truth_summary/ci_imsim -d truth_summary --collections 2.2i/truth_summary --where "skymap='DC2' and tract=3828" butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/ci_imsim" "2.2i/truth_summary/ci_imsim"

          People

            dtaranu Dan Taranu
            dtaranu Dan Taranu
            Yusra AlSayyad
            Dan Taranu, Yusra AlSayyad
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Jenkins

                No builds found.