Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10003

AP Science Lead -- Update Nightly Flow diagram

    Details

      Description

      There are several things that came up in talking through the current dataflow diagram in the draft branch of LDM-151, several updates were identified. I'm assigning this to Eric Bellm, but I'm happy to have him hand it off to me or someone else.

      • Alert Generation box needs template as input
      • Between Alert Generation and Alert Distribution, the box says DIAObject, but that's not strictly true since now postage stamps exist with each DIASource
      • Alert distribution is shown as a tan box which implies that it is a pipeline, but in reality is that it is a completely separate system. In fact, I image the system as function by having Alert Generation post the "alerts" directly to that system.

        Attachments

          Activity

          krughoff Simon Krughoff created issue -
          krughoff Simon Krughoff made changes -
          Field Original Value New Value
          Epic Link DM-9621 [ 30659 ]
          swinbank John Swinbank made changes -
          Team Alert Production [ 10300 ]
          ebellm Eric Bellm made changes -
          Assignee Eric Bellm [ ebellm ]
          ebellm Eric Bellm made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          Hide
          ebellm Eric Bellm added a comment -

          Simon Krughoff: Can you take a look at https://confluence.lsstcorp.org/display/~ajc/LDM-151+Overview and see if the changes are responsive to your concerns? I'll cut it up and put it github after you take a look.

          I didn't change the Alert Distribution box--I wasn't sure of a non-pipeline representation that made more sense. Suggestions welcome.

          Show
          ebellm Eric Bellm added a comment - Simon Krughoff : Can you take a look at https://confluence.lsstcorp.org/display/~ajc/LDM-151+Overview and see if the changes are responsive to your concerns? I'll cut it up and put it github after you take a look. I didn't change the Alert Distribution box--I wasn't sure of a non-pipeline representation that made more sense. Suggestions welcome.
          Hide
          krughoff Simon Krughoff added a comment -

          The line from the Template to the alert generation crosses a lot of lines, I wonder if it would be clearer to just duplicate the template box to the left of the alert generation box. We duplicate data products in other places for clarity already.

          In order to be consistent with Andy's original diagram, should we us a rhombus for the postage stamps since they are nominally images?

          For alert distribution, maybe put a box around the whole thing to the right and label it alert distribution and somehow show the DIASources and postage stamps going into that?

          Show
          krughoff Simon Krughoff added a comment - The line from the Template to the alert generation crosses a lot of lines, I wonder if it would be clearer to just duplicate the template box to the left of the alert generation box. We duplicate data products in other places for clarity already. In order to be consistent with Andy's original diagram, should we us a rhombus for the postage stamps since they are nominally images? For alert distribution, maybe put a box around the whole thing to the right and label it alert distribution and somehow show the DIASources and postage stamps going into that?
          ebellm Eric Bellm made changes -
          Labels LDM-151
          ebellm Eric Bellm made changes -
          Labels LDM-151 LDM-151 SciencePipelines
          Hide
          ebellm Eric Bellm added a comment -

          Check revised versions of Figures 3-6.

          Show
          ebellm Eric Bellm added a comment - Check revised versions of Figures 3-6.
          ebellm Eric Bellm made changes -
          Reviewers Simon Krughoff [ krughoff ]
          Status In Progress [ 3 ] In Review [ 10004 ]
          Hide
          krughoff Simon Krughoff added a comment -

          Perfect. Looks great.

          Show
          krughoff Simon Krughoff added a comment - Perfect. Looks great.
          krughoff Simon Krughoff made changes -
          Status In Review [ 10004 ] Reviewed [ 10101 ]
          ebellm Eric Bellm made changes -
          Resolution Done [ 10000 ]
          Status Reviewed [ 10101 ] Done [ 10002 ]

            People

            • Assignee:
              ebellm Eric Bellm
              Reporter:
              krughoff Simon Krughoff
              Reviewers:
              Simon Krughoff
              Watchers:
              Andrew Connolly, Eric Bellm, Maria Patterson [X] (Inactive), Simon Krughoff
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel