Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-33854

Need periodic log messages for forcedPhotCoadd during aperture corrections

    XMLWordPrintable

    Details

    • Story Points:
      3
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      The PanDA batch system needs tasks to write periodic log messages at least every 2 hours, to ensure that the task is still running and not in some stuck state.  forcedPhotCoadd already does write VERBOSE log messages every 10 minutes, but stops doing this once it starts applying aperture corrections.  Because the aperture corrections can take several hours, the lack of log messages can lead to PanDA killing the job, requiring additional re-attempts that may eventually fail again for the same reason.

      So additional periodic logging, at VERBOSE level, are needed during aperture correction and any subsequent steps.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-33858 Profile and optimize ApplyApCorrTask and CoaddBoundedField

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-31528 Add more log messages to the measure task

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-33820 Emit periodic log messages during Faro data loading

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-33919 Add heartbeat logging support to utils

          • Done

            Activity

            Ascending order - Click to sort in descending order
            hlin Huan Lin created issue -
            tjenness Tim Jenness made changes -
            Field Original Value New Value
            Link This issue relates to DM-33820 [ DM-33820 ]
            tjenness Tim Jenness made changes -
            Component/s pipe_tasks [ 10726 ]
            Component/s Science Pipelines [ 10706 ]
            tjenness Tim Jenness made changes -
            Component/s meas_base [ 10750 ]
            Component/s pipe_tasks [ 10726 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-31528 [ DM-31528 ]
            ctslater Colin Slater made changes -
            Link This issue relates to DM-33858 [ DM-33858 ]
            yusra Yusra AlSayyad made changes -
            Labels SciencePipelines SciencePipelines backport-v23
            kannawad Arun Kannawadi made changes -
            Assignee Arun Kannawadi [ kannawad ]
            kannawad Arun Kannawadi made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            kannawad Arun Kannawadi made changes -
            Reviewers Tim Jenness [ tjenness ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            tjenness Tim Jenness made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            kannawad Arun Kannawadi made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            tjenness Tim Jenness made changes -
            Labels SciencePipelines backport-v23 SciencePipelines backport-approved backport-v23
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-33919 [ DM-33919 ]
            kannawad Arun Kannawadi made changes -
            Labels SciencePipelines backport-approved backport-v23 SciencePipelines backport-approved backport-done backport-v23
            yusra Yusra AlSayyad made changes -
            Epic Link PREOPS-1161 [ 1475339 ]
            Story Points 3
            Team Data Release Production [ 10301 ]

              People

              Assignee:
              kannawad Arun Kannawadi
              Reporter:
              hlin Huan Lin
              Reviewers:
              Tim Jenness
              Watchers:
              Arun Kannawadi, Colin Slater, Huan Lin, Shuwei Ye, Tim Jenness, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.