Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-7469

Other Composite Dataset work; Use cases, Requirements, and/or Implementation work TBD.

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: butler
    • Labels:
      None

      Attachments

        Activity

        Hide
        npease Nate Pease added a comment -

        this implements this basic use of composites so that a composite dataset can be defined in the policy (as consisting of composite or non-composite dataset component), and a basic test in obs_test that uses butler.get to get a composite dataset, and butler.put to put that dataset.

        The code here should be sufficient to serve as the foundation for most of the use examples & pseudocode at https://confluence.lsstcorp.org/display/DM/Use+Cases+for+Butler+Composite+Datasets
        but does not yet fully enable any of them.

        Show
        npease Nate Pease added a comment - this implements this basic use of composites so that a composite dataset can be defined in the policy (as consisting of composite or non-composite dataset component), and a basic test in obs_test that uses butler.get to get a composite dataset, and butler.put to put that dataset. The code here should be sufficient to serve as the foundation for most of the use examples & pseudocode at https://confluence.lsstcorp.org/display/DM/Use+Cases+for+Butler+Composite+Datasets but does not yet fully enable any of them.
        Hide
        ktl Kian-Tat Lim added a comment -

        Added some comments on the implementation; Jim Bosch should look at the test case.

        Show
        ktl Kian-Tat Lim added a comment - Added some comments on the implementation; Jim Bosch should look at the test case.
        Hide
        npease Nate Pease added a comment -

        I re-added Kian-Tat Lim as a reviewer, specifically for new changes in daf_persistence that I think are different enough from what was originally checked in that it's worth another look. Especially the new test folder at python/daf/persistence/test.

        Show
        npease Nate Pease added a comment - I re-added Kian-Tat Lim as a reviewer, specifically for new changes in daf_persistence that I think are different enough from what was originally checked in that it's worth another look. Especially the new test folder at python/daf/persistence/test.
        Hide
        jbosch Jim Bosch added a comment -

        Review (from me) complete. All comments are on the PRs.

        Show
        jbosch Jim Bosch added a comment - Review (from me) complete. All comments are on the PRs.
        Hide
        npease Nate Pease added a comment -

        Added Brian Van Klaveren as a reviewer to check the changes to LDM-463

        Show
        npease Nate Pease added a comment - Added Brian Van Klaveren as a reviewer to check the changes to LDM-463
        Hide
        npease Nate Pease added a comment -

        Moving this along. @ktl can look when he's back from vacation if he wants.

        Show
        npease Nate Pease added a comment - Moving this along. @ktl can look when he's back from vacation if he wants.

          People

          • Assignee:
            npease Nate Pease
            Reporter:
            npease Nate Pease
            Reviewers:
            Brian Van Klaveren, Kian-Tat Lim
            Watchers:
            Jim Bosch, Kian-Tat Lim, Nate Pease
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Summary Panel