Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-3372

Port, replace, or defer HSC-side provenance of EUPS products

    Details

    • Type: Story
    • Status: Done
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: daf_persistence, pipe_base
    • Labels:
      None
    • Templates:
    • Story Points:
      6
    • Sprint:
      DRP X16-1, DRP X16-2, DRP X16-3, DRP F16-1
    • Team:
      Data Release Production

      Description

      The HSC pipeline checks that setup EUPS products are identical between runs with the same output directory, in the same way configuration is checked in both the LSST and HSC pipelines.

      The implementation is a bit messy, and it's not strictly necessary, so it's not clear we should port this over as-is, or just wait for a better implementation to be provided by the Process Middleware team. We should at least RFC this question now.

        Issue Links

          Activity

          Hide
          ktl Kian-Tat Lim added a comment -

          daf_butlerUtils code looks good to me now (and still nicely compact).

          Show
          ktl Kian-Tat Lim added a comment - daf_butlerUtils code looks good to me now (and still nicely compact).
          Hide
          price Paul Price added a comment -

          Tim Jenness, I added some additional commits in the 'base' package with some tests. Would you please have a look? I left the fixup commits in so you can see what's changed, but will squash them away before merging.

          Show
          price Paul Price added a comment - Tim Jenness , I added some additional commits in the 'base' package with some tests. Would you please have a look? I left the fixup commits in so you can see what's changed, but will squash them away before merging.
          Hide
          tjenness Tim Jenness added a comment -

          Looks fine to me. Builds without problem. Thanks.

          Show
          tjenness Tim Jenness added a comment - Looks fine to me. Builds without problem. Thanks.
          Hide
          price Paul Price added a comment -

          Merged to master.

          Thanks, all!

          Show
          price Paul Price added a comment - Merged to master. Thanks, all!
          Show
          swinbank John Swinbank added a comment - Mentioned in release notes: https://confluence.lsstcorp.org/display/DM/Data+Release+Production+WIP+F16+Release+Notes

            People

            • Assignee:
              price Paul Price
              Reporter:
              jbosch Jim Bosch
              Reviewers:
              Tim Jenness
              Watchers:
              Jim Bosch, John Swinbank, Kian-Tat Lim, Paul Price, Russell Owen, Tim Jenness
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development

                  Agile