Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32419

RC2 reprocessing with w_2021_42+ (gen2)

    XMLWordPrintable

    Details

    • Story Points:
      4
    • Epic Link:
    • Sprint:
      DRP S21b, DRP S22A, DRP S22B
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Process the RC2 dataset with the w_2021_42+ the ticket branches from DM-30284 stack using gen2 middleware.This will largely follow the procedure followed in DM-31815, but we are setting up all branches currently in progress on DM-30284 as these are now known gen2/gen3 parity breaking issue for the coaddition stages (so this may take a few iterations as bugs there get worked out).

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-32766 RC2 reprocessing with w_2021_46+ (gen2)

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-31815 RC2 reprocessing with w_2021_38 (gen2)

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-32071 DC2 Reprocessing with w_2021_40+ (gen2)

          • Done
          mentioned in

          Page Loading...

            Activity

            Ascending order - Click to sort in descending order
            No builds found.
            lauren Lauren MacArthur created issue -
            lauren Lauren MacArthur made changes -
            Field Original Value New Value
            Link This issue relates to DM-31815 [ DM-31815 ]
            lauren Lauren MacArthur made changes -
            Link This issue relates to DM-32071 [ DM-32071 ]
            lauren Lauren MacArthur made changes -
            Remote Link This issue links to "Page (Confluence)" [ 31349 ]
            lauren Lauren MacArthur made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            Hide
            Permalink
            lauren Lauren MacArthur added a comment - - edited

            Run is complete. Saw the same set of errors and warnings as reported in DM-31477 & DM-31815 (no new ones noticed).

            Logs can be found at (or linked here):

            /datasets/hsc/repo/rerun/RC/w_2021_42/DM-32419/logs

            FGCM plots and logs are linked here

            pipe_analysis plots: gen2, gen3 + gen2 vs gen3.

            matchedVisitMetrics output linked here

            Metrics were successfully dispatched, ingested to SQuaSH, and now appear on the DRP metrics monthly Gen 2 (HSC RC2) dashboard in chronograph.

            Show
            lauren Lauren MacArthur added a comment - - edited Run is complete. Saw the same set of errors and warnings as reported in DM-31477 & DM-31815 (no new ones noticed). Logs can be found at (or linked here ): / datasets / hsc / repo / rerun / RC / w_2021_42 / DM - 32419 / logs FGCM plots and logs are linked here pipe_analysis plots: gen2 , gen3 + gen2 vs gen3 . matchedVisitMetrics output linked here Metrics were successfully dispatched, ingested to SQuaSH, and now appear on the DRP metrics monthly Gen 2 (HSC RC2) dashboard in chronograph .
            Hide
            Permalink
            lauren Lauren MacArthur added a comment -

            Please have a look to make sure all is in place when you get a chance

            Show
            lauren Lauren MacArthur added a comment - Please have a look to make sure all is in place when you get a chance
            lauren Lauren MacArthur made changes -
            Reviewers Yusra AlSayyad [ yusra ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            lauren Lauren MacArthur made changes -
            Description Process a single tract of the DC2 dataset with the w_2021_42+ the ticket branches from DM-30284 stack using gen2 middleware.This will largely follow the procedure followed in DM-31815, but we are setting up all branches currently in progress on DM-30284 as these are now known gen2/gen3 parity breaking issue for the coaddition stages (so this may take a few iterations as bugs there get worked out). Process the RC2 dataset with the w_2021_42+ the ticket branches from DM-30284 stack using gen2 middleware.This will largely follow the procedure followed in DM-31815, but we are setting up all branches currently in progress on DM-30284 as these are now known gen2/gen3 parity breaking issue for the coaddition stages (so this may take a few iterations as bugs there get worked out).
            lauren Lauren MacArthur made changes -
            Story Points 4
            lauren Lauren MacArthur made changes -
            Link This issue relates to DM-32766 [ DM-32766 ]
            yusra Yusra AlSayyad made changes -
            Sprint DRP S21b [ 1094 ] DRP S21b, DRP S22A [ 1094, 1137 ]
            yusra Yusra AlSayyad made changes -
            Sprint DRP S21b, DRP S22A [ 1094, 1137 ] DRP S21b, DRP S22A, DRP S22B [ 1094, 1137, 1138 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-30547 [ 511213 ]
            yusra Yusra AlSayyad made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            yusra Yusra AlSayyad made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]

              People

              Assignee:
              lauren Lauren MacArthur
              Reporter:
              lauren Lauren MacArthur
              Reviewers:
              Yusra AlSayyad
              Watchers:
              Lauren MacArthur, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.