Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9532

Create a metric definitions access API

    XMLWordPrintable

    Details

      Description

      DM-9542 completed initial work on transforming metrics to the new YAML schema design in https://sqr-017.lsst.io. Meanwhile, DM-9559 has introduced a SpecificationSet API design that parses a metrics package and provides a collection of Specifications as a mapping.

      This ticket is to update the MetricSet and Metric classes to match the SpecificationSet API design.

        Attachments

          Issue Links

          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-10089 Simplify validate_base Blob into a concrete collection type

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9542 Add initial jointcal metrics to validation_metrics

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9559 Create a specifications access API for validate_metrics specs

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9530 Create metric definitions package

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Parejkoj John Parejko created issue -
            Parejkoj John Parejko made changes -
            Field Original Value New Value
            Epic Link DM-8477 [ 28109 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-9530 [ DM-9530 ]
            jsick Jonathan Sick made changes -
            Labels SciencePipelines SciencePipelines validate_base validate_metrics
            jsick Jonathan Sick made changes -
            Description To go with the metric definitions repo in DM-9530, we need an access API. We sketched some plans for this out on the whiteboard today, and [~jsick] took some pictures of it. We'll add details below.

            Conveniently, having said API will make reorganizing the metric definitions organization easier, if we decide we need to reorganize it in the future.             		Create a Python API for loading *metric* definitions from {{validate_metrics}}, as implemented in DM-9530, into {{lsst.validate.base.Metric}} objects. This involves changing the {{Metric}} python class to conform to the update data model (see https://sqr-017.lsst.io and DM-9533
            ).

            This may involve creating a _new_ class, {{lsst.validate.base.MetricSet}}, which is a collection of Metrics.

            Loading _specifications_ into {{lsst.validate.base.Specification}} objects is deferred to a separate ticket.
            jsick Jonathan Sick made changes -
            Assignee Jonathan Sick [ jsick ]
            jsick Jonathan Sick made changes -
            Link This issue relates to DM-9559 [ DM-9559 ]
            jsick Jonathan Sick made changes -
            Description Create a Python API for loading *metric* definitions from {{validate_metrics}}, as implemented in DM-9530, into {{lsst.validate.base.Metric}} objects. This involves changing the {{Metric}} python class to conform to the update data model (see https://sqr-017.lsst.io and DM-9533
            ).

            This may involve creating a _new_ class, {{lsst.validate.base.MetricSet}}, which is a collection of Metrics.

            Loading _specifications_ into {{lsst.validate.base.Specification}} objects is deferred to a separate ticket.             		DM-9542 completed initial work on transforming metrics to the new YAML schema design in https://sqr-017.lsst.io. Meanwhile, DM-9559 has introduced a SpecificationSet API design that parses a metrics package and provides a collection of Specifications as a mapping.

            This ticket is to update the {{MetricSet}} and {{Metric}} classes to match the {{SpecificationSet}} API design.
            jsick Jonathan Sick made changes -
            Link This issue relates to DM-9542 [ DM-9542 ]
            jsick Jonathan Sick made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            jsick Jonathan Sick made changes -
            Story Points 1.4
            jsick Jonathan Sick made changes -
            Link This issue is blocked by DM-10089 [ DM-10089 ]
            jsick Jonathan Sick made changes -
            Story Points 1.4 1.8
            Labels SciencePipelines validate_base validate_metrics SciencePipelines verify verify_metrics
            jsick Jonathan Sick made changes -
            Reviewers Jonathan Sick [ jsick ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            jsick Jonathan Sick made changes -
            Resolution Done [ 10000 ]
            Status In Review [ 10004 ] Done [ 10002 ]

              People

              Assignee:
              jsick Jonathan Sick
              Reporter:
              Parejkoj John Parejko
              Reviewers:
              Jonathan Sick
              Watchers:
              Angelo Fausti, Frossie Economou, John Parejko, Jonathan Sick, Michael Wood-Vasey, Simon Krughoff, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.