Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-8471

AP Source Association in F18

    XMLWordPrintable

    Details

    • Epic Name:
      f18-ap-association
    • Story Points:
      50
    • WBS:
      02C.03.02
    • Team:
      Alert Production
    • Cycle:
      Fall 2018

      Description

      Improve the prototype source association pipeline. This will include:

      • Integration with the l1dbproto provided by the DAX team, iterating with them on design and requirements, to result in a documented interface to which both teams can work;
      • Generate simple time series statistics, to be agreed agreed with Eric Bellm, during source association (per LDM-151 v4.1 §6.21; see also DM-14437);
      • Think hard about the edge cases in AP source association, and come up with potential solutions for implementation in the next cycle (per LDM-151 v4.1 §6.23.4).

        Attachments

          Issue Links

            Activity

            Hide
            krughoff Simon Krughoff added a comment - - edited

            This should include Chris Morrison [X] working with Eric Bellm to define the set of functionality needed. We also need to define metrics that can be used to test association as well as the dataset(s) to feed the metrics.

            This may require implementing DM-8837.

            Other open questions:
            What about matching to SSObject?
            How do we assign a confidence to the association?
            Can DIAObjects contain more than one DIASource from a given epoch?
            Can DIASources belong to multiple DIAObjects?

            Show
            krughoff Simon Krughoff added a comment - - edited This should include Chris Morrison [X] working with Eric Bellm to define the set of functionality needed. We also need to define metrics that can be used to test association as well as the dataset(s) to feed the metrics. This may require implementing DM-8837 . Other open questions: What about matching to SSObject? How do we assign a confidence to the association? Can DIAObjects contain more than one DIASource from a given epoch? Can DIASources belong to multiple DIAObjects?
            Hide
            swinbank John Swinbank added a comment - - edited

            Note to self: this epic was originally scheduled for the S17 cycle. However, it was deprioritised due to the emphasis on the AP end-to-end system, for which a "minimal" association system is being developed in DM-10768. That means we're punting it to the future. That means we'll show a variance on it, but it is nicely explicable.

            Show
            swinbank John Swinbank added a comment - - edited Note to self: this epic was originally scheduled for the S17 cycle. However, it was deprioritised due to the emphasis on the AP end-to-end system, for which a "minimal" association system is being developed in DM-10768 . That means we're punting it to the future. That means we'll show a variance on it, but it is nicely explicable.
            Hide
            swinbank John Swinbank added a comment -

            Closing out this epic and the end of F18. Changing priorities and requirements have caused this work to focus on integration of the PPDB with the AP system; time series statistics and “probablistic” source association will be addressed in DM-16720 during S19.

            Show
            swinbank John Swinbank added a comment - Closing out this epic and the end of F18. Changing priorities and requirements have caused this work to focus on integration of the PPDB with the AP system; time series statistics and “probablistic” source association will be addressed in DM-16720 during S19.

              People

              Assignee:
              cmorrison Chris Morrison [X] (Inactive)
              Reporter:
              krughoff Simon Krughoff
              Watchers:
              John Swinbank, Simon Krughoff
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.