Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16693

Long Decam DCR run failures with invalid values

    XMLWordPrintable

    Details

      Description

      When Meredith Rawls ran DcrAssembleCoaddTask it failed on patches with large regions of no data. The Task should test whether subregions contain data at an earlier stage, and skip them or fail earlier. See the log below for an example:

      ==> slurm/job146732-24.out <==
          res = func(self, *args, **keyArgs)
        File "/project/mrawls/pipe_tasks/python/lsst/pipe/tasks/dcrAssembleCoadd.py", line 233, in runDataRef
          results = AssembleCoaddTask.runDataRef(self, dataRef, selectDataList=selectDataList)
        File "/software/lsstsw/stack_20181012/stack/miniconda3-4.5.4-fcd27eb/Linux64/pipe_base/16.0-16-ge6a35c8+5/python/lsst/pipe/base/timer.py", line 149, in wrapper
          res = func(self, *args, **keyArgs)
        File "/project/mrawls/pipe_tasks/python/lsst/pipe/tasks/assembleCoadd.py", line 361, in runDataRef
          inputData.weightList, supplementaryData=supplementaryData)
        File "/project/mrawls/pipe_tasks/python/lsst/pipe/tasks/dcrAssembleCoadd.py", line 404, in run
          convergenceCheck = (convergenceList[-1] - convergenceMetric)/convergenceMetric
      ZeroDivisionError: float division by zero
      

        Attachments

          Activity

          Hide
          sullivan Ian Sullivan added a comment -

          Please review this by re-running the failed Decam patches.

          Show
          sullivan Ian Sullivan added a comment - Please review this by re-running the failed Decam patches.
          Hide
          mrawls Meredith Rawls added a comment -

          This resolved the problem (when I used the DM-16632 branch, which includes this fix). Thanks!

          Show
          mrawls Meredith Rawls added a comment - This resolved the problem (when I used the DM-16632 branch, which includes this fix). Thanks!

            People

            Assignee:
            sullivan Ian Sullivan
            Reporter:
            sullivan Ian Sullivan
            Reviewers:
            Meredith Rawls
            Watchers:
            Ian Sullivan, John Swinbank, Meredith Rawls
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.