Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-2042

W16 Improve Data Provenance Design

    XMLWordPrintable

Details

    • Epic
    • Status: Done
    • Resolution: Done
    • None
    • Database
    • None
    • W16 Improve Data Provenance Design
    • 69
    • 02C.06.01.01
    • Data Access and Database
    • Winter 2016

    Description

      We have a detailed design of the Provenance, described at https://dev.lsstcorp.org/trac/wiki/db/Provenance. Work covered by this epic involves:
      1. Revisiting the design and tweaking it as necessary. In particular:

      • Describing in more details interactions with key data producers (DRP, AlertProd, Calibration, L3 data brought in by users).
      • Estimating the size of provenance data
      • Considering querying the provenance data

      2. Evaluating existing off-the-shelf provenance systems/tools.

      Deliverable: a document describing data provenance architecture / schema supported by a standalone proof-of-concept prototype.

      Attachments

        Issue Links

          Stories in Epic (Custom Issue Matrix)

          Activity

            jbecla Jacek Becla (Inactive) added a comment - The document describing provenance design is located at https://github.com/lsst-dm/provenance_proto/blob/master/Provenance.md . The schema can also be viewed at: https://lsst-web.ncsa.illinois.edu/schema/index.php?sVer=baseline

            People

              fritzm Fritz Mueller
              fritzm Fritz Mueller
              Jacek Becla (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.