Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-33854

Need periodic log messages for forcedPhotCoadd during aperture corrections

    XMLWordPrintable

    Details

    • Story Points:
      3
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      The PanDA batch system needs tasks to write periodic log messages at least every 2 hours, to ensure that the task is still running and not in some stuck state.  forcedPhotCoadd already does write VERBOSE log messages every 10 minutes, but stops doing this once it starts applying aperture corrections.  Because the aperture corrections can take several hours, the lack of log messages can lead to PanDA killing the job, requiring additional re-attempts that may eventually fail again for the same reason.

      So additional periodic logging, at VERBOSE level, are needed during aperture correction and any subsequent steps.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-33858 Profile and optimize ApplyApCorrTask and CoaddBoundedField

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-31528 Add more log messages to the measure task

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-33820 Emit periodic log messages during Faro data loading

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-33919 Add heartbeat logging support to utils

          • Done

            Activity

              People

              Assignee:
              kannawad Arun Kannawadi
              Reporter:
              hlin Huan Lin
              Reviewers:
              Tim Jenness
              Watchers:
              Arun Kannawadi, Colin Slater, Huan Lin, Shuwei Ye, Tim Jenness, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.