Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15224

Investigate low association rate in HiTS2015 CI dataset

    Details

    • Story Points:
      4
    • Sprint:
      AP F18-3, AP F18-4, AP F18-5
    • Team:
      Alert Production

      Description

      While testing ap_verify_ci_hits2015, a set of six overlapping exposures across three epochs, for DM-15142, I got the following source matching statistics:

      • 1600 DiaObjects with 1 DiaSource
      • 82 DiaObjects with 2 DiaSources
      • 0 DiaObjects with 3 DiaSources

      The issue appears whether I run ap_pipe all at once or in order of increasing visit ID, so it does not appear to be a concurrency bug in the database. On the other hand, the dataset footprint is known to include "messy" chips, so it's possible that many of the DiaSources are transient artifacts rather than real sources.

      Pair-investigate the properties of the images and DiaObjects to figure out what is happening.

        Attachments

          Issue Links

            Activity

            krzys Krzysztof Findeisen created issue -
            krzys Krzysztof Findeisen made changes -
            Field Original Value New Value
            Epic Link DM-14447 [ 80385 ]
            krzys Krzysztof Findeisen made changes -
            Risk Score 0
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-15142 [ DM-15142 ]
            swinbank John Swinbank made changes -
            Sprint AP F18-3 [ 748 ] AP F18-3, AP F18-4 [ 748, 749 ]
            krzys Krzysztof Findeisen made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            swinbank John Swinbank made changes -
            Sprint AP F18-3, AP F18-4 [ 748, 749 ] AP F18-3, AP F18-4, AP F18-5 [ 748, 749, 750 ]
            mrawls Meredith Rawls made changes -
            Attachment dm15224-sources.png [ 34342 ]
            mrawls Meredith Rawls made changes -
            Reviewers Ian Sullivan [ sullivan ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            sullivan Ian Sullivan made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            mrawls Meredith Rawls made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]

              People

              • Assignee:
                mrawls Meredith Rawls
                Reporter:
                krzys Krzysztof Findeisen
                Reviewers:
                Ian Sullivan
                Watchers:
                Ian Sullivan, Krzysztof Findeisen, Meredith Rawls
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel