Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32895

Add matchObjectToTruth to obs_lsst's imsim DRP.yaml

    XMLWordPrintable

    Details

    • Story Points:
      2
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Following DM-32034, add the MatchTractCatalog task to DRP.yaml for LSSTCam/imsim, so it can be used to compute tract-level coadd metrics.

      I think it can go on step3 as it only relies on writeObjectTable. For DP0.2, it will need a backport and for someone to ingest the truth summary tables following PREOPS-584.

        Attachments

          Activity

          Hide
          dtaranu Dan Taranu added a comment - - edited

          Passed Jenkins here.

          Also ran the following butler steps for /repo/dc2 on lsst-devl*:

          butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/test-med-1" "2.2i/truth_summary"
          butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/DP0.2" "2.2i/truth_summary"
          butler associate /repo/dc2 2.2i/truth_summary/ci_imsim -d truth_summary --collections 2.2i/truth_summary --where "skymap='DC2' and tract=3828"
          butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/ci_imsim" "2.2i/truth_summary/ci_imsim"
          

          Also ingested the truth_summary tables on the cloud for DP0.2 thanks to Hsin-Fang Chiang and will add the collections to the relevant default(s) tomorrow.

          Show
          dtaranu Dan Taranu added a comment - - edited Passed Jenkins here. Also ran the following butler steps for /repo/dc2 on lsst-devl* : butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/test-med-1" "2.2i/truth_summary" butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/DP0.2" "2.2i/truth_summary" butler associate /repo/dc2 2.2i/truth_summary/ci_imsim -d truth_summary --collections 2.2i/truth_summary --where "skymap='DC2' and tract=3828" butler collection-chain /repo/dc2 --mode=extend "2.2i/defaults/ci_imsim" "2.2i/truth_summary/ci_imsim" Also ingested the truth_summary tables on the cloud for DP0.2 thanks to Hsin-Fang Chiang and will add the collections to the relevant default(s) tomorrow.
          Hide
          yusra Yusra AlSayyad added a comment -

          only comment is on obs_lsstĀ 

          Show
          yusra Yusra AlSayyad added a comment - only comment is on obs_lsstĀ 
          Hide
          dtaranu Dan Taranu added a comment -

          Renamed as suggested and merged.

          Show
          dtaranu Dan Taranu added a comment - Renamed as suggested and merged.
          Hide
          dtaranu Dan Taranu added a comment -

          Also ran the following on https://data-int.lsst.cloud:

          export BUTLER_DC2="s3://butler-us-central1-panda-dev/dc2/butler-external.yaml"
          butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults" "2.2i/truth_summary"
          butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/test-med-1" "2.2i/truth_summary"
          butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/DP0.2" "2.2i/truth_summary"
          butler associate $BUTLER_DC2 2.2i/truth_summary/ci_imsim -d truth_summary --collections 2.2i/truth_summary --where "skymap='DC2' and tract=3828"
          butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/ci_imsim" "2.2i/truth_summary/ci_imsim"
          

          Show
          dtaranu Dan Taranu added a comment - Also ran the following on https://data-int.lsst.cloud : export BUTLER_DC2="s3://butler-us-central1-panda-dev/dc2/butler-external.yaml" butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults" "2.2i/truth_summary" butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/test-med-1" "2.2i/truth_summary" butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/DP0.2" "2.2i/truth_summary" butler associate $BUTLER_DC2 2.2i/truth_summary/ci_imsim -d truth_summary --collections 2.2i/truth_summary --where "skymap='DC2' and tract=3828" butler collection-chain $BUTLER_DC2 --mode=extend "2.2i/defaults/ci_imsim" "2.2i/truth_summary/ci_imsim"

            People

            Assignee:
            dtaranu Dan Taranu
            Reporter:
            dtaranu Dan Taranu
            Reviewers:
            Yusra AlSayyad
            Watchers:
            Dan Taranu, Yusra AlSayyad
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.