Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4632

Create IDL pipeline workflow for DRP processing - makeCoaddTempExp

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Middleware
    • Labels:
      None

      Description

      For the verification datasets work we need the ability to run a dataset all the way through DRP processing that takes advantage of many cores (orchestration), keeps track of successful and failed dataIDs, creates individual log files, and creates helpful QA plots/metrics/webpages. Nidever will use his PHOTRED IDL workflow and rewrite it for the stack. processCcdDecam is working. The next step is makeCoaddTempExp.

        Attachments

          Issue Links

            Activity

            Hide
            nidever David Nidever [X] (Inactive) added a comment -

            Work on the makeCoaddTempExp portion of the IDL workflow has started.

            Show
            nidever David Nidever [X] (Inactive) added a comment - Work on the makeCoaddTempExp portion of the IDL workflow has started.
            Hide
            nidever David Nidever [X] (Inactive) added a comment -

            The makeCoaddTempExp portion of the IDL workflow needs to know which patches a visit overlaps so that it can run makeCoaddTempExp with the smallest unit of data. reportPatches.py performs this task but is currently broken.

            Show
            nidever David Nidever [X] (Inactive) added a comment - The makeCoaddTempExp portion of the IDL workflow needs to know which patches a visit overlaps so that it can run makeCoaddTempExp with the smallest unit of data. reportPatches.py performs this task but is currently broken.
            Hide
            frossie Frossie Economou added a comment -

            Assignee has left project and this work is no longer in this WBS.

            Show
            frossie Frossie Economou added a comment - Assignee has left project and this work is no longer in this WBS.

              People

              Assignee:
              nidever David Nidever [X] (Inactive)
              Reporter:
              nidever David Nidever [X] (Inactive)
              Watchers:
              David Nidever [X] (Inactive), Frossie Economou
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: