Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11116

Define packaging layout

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None

      Description

      We envision the datasets for verify_ap to be eups packaged git LFS repos. The following structure is a first cut at what such a package may look like:

      ups/dataset_name.table (this should contain obs package needed to work with these data)
      data/[LFS data files]
      input_repo/_mapper (indicates the mapper to use with the data in this repository)
      

      This could potentially contain more information: e.g. templates for use with other datasets.

        Attachments

          Issue Links

            Activity

            Hide
            reiss David Reiss added a comment -
            Show
            reiss David Reiss added a comment - Likely to mimic https://github.com/lsst/validation_data_cfht
            Hide
            reiss David Reiss added a comment - - edited

            Created lsst/verify_ap_dataset_template repo.

            Show
            reiss David Reiss added a comment - - edited Created lsst/verify_ap_dataset_template repo.
            Hide
            reiss David Reiss added a comment -

            Added small data file in `raw` and verified that it uses git-lfs. This should be ready to go, but I'm willing to entertain adding more useful stuff.

            Show
            reiss David Reiss added a comment - Added small data file in `raw` and verified that it uses git-lfs. This should be ready to go, but I'm willing to entertain adding more useful stuff.
            Hide
            krughoff Simon Krughoff added a comment -

            Comments:

            • This repo should have been created in lsst-dm, not in lsst as a private repo. We don't want anything in the lsst organization that isn't sharable with the world. I actually think it should probably be moved to lsst-dm.
            • If you have data in raw you can get rid of the empty README.txt.
            • The file you put in raw says calexp, but I think it should be a raw data file. There are examples in: https://github.com/lsst/obs_test/tree/master/data/input/raw
            • It looks like the _mapper file should read lsst.obs.test.testMapper.TestMapper
            Show
            krughoff Simon Krughoff added a comment - Comments: This repo should have been created in lsst-dm, not in lsst as a private repo. We don't want anything in the lsst organization that isn't sharable with the world. I actually think it should probably be moved to lsst-dm. If you have data in raw you can get rid of the empty README.txt . The file you put in raw says calexp, but I think it should be a raw data file. There are examples in: https://github.com/lsst/obs_test/tree/master/data/input/raw It looks like the _mapper file should read lsst.obs.test.testMapper.TestMapper
            Hide
            reiss David Reiss added a comment - - edited

            OK, thanks for the review. Moved repo to lsst-dm/verify_ap_dataset_template, and addressed your other comments.

            Show
            reiss David Reiss added a comment - - edited OK, thanks for the review. Moved repo to lsst-dm/verify_ap_dataset_template, and addressed your other comments.
            Hide
            krughoff Simon Krughoff added a comment -

            Excellent! Ship it.

            Show
            krughoff Simon Krughoff added a comment - Excellent! Ship it.
            Hide
            reiss David Reiss added a comment -

            Thanks a lot! Merged.

            Show
            reiss David Reiss added a comment - Thanks a lot! Merged.

              People

              • Assignee:
                reiss David Reiss
                Reporter:
                krughoff Simon Krughoff
                Reviewers:
                Simon Krughoff
                Watchers:
                David Reiss, Simon Krughoff
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel