Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21455

Sanitize inputs for DCR multiband measurement

    Details

    • Templates:
    • Story Points:
      2
    • Sprint:
      AP F19-4 (2H September)
    • Team:
      Alert Production

      Description

      The DCR multiband coadd source detection and measurement tasks (DM-14553) appear to be broken when running on lsst-dev. detectCoaddSources.py runs fine for a normal deepCoadd but fails with the following error message when run on a dcrCoadd. The problem appears to be the warning: root WARN: Unexpected ID subfilter; guessing type is "str"

      CameraMapper INFO: Loading exposure registry from /project/mrawls/hits2014/ingested/registry.sqlite3
      CameraMapper INFO: Loading calib registry from /project/mrawls/hits2014/ingested/calib2/calibRegistry.sqlite3
      CameraMapper INFO: Loading calib registry from /project/mrawls/hits2014/ingested/calib2/calibRegistry.sqlite3
      root WARN: Unexpected ID subfilter; guessing type is "str"
      root WARN: Unexpected ID numSubfilters; guessing type is "str"
      root INFO: Running: /project/sullivan/code/pipe_tasks/bin/detectCoaddSources.py /project/sullivan/hits2014/dcrcoadds_processed --output /project/sullivan/hits2014/dcrcoadds_processed --id filter=g subfilter=0^1^2 numSubfilte
      rs=3 tract=0 patch=17,11^17,12^17,13^17,14 --config coaddName=dcr --clobber-config --clobber-versions
      WARNING: You are using OpenBLAS with multiple threads (24), but have not
      specified the number of threads using one of the OpenBLAS environment variables:
      OPENBLAS_NUM_THREADS, GOTO_NUM_THREADS, OMP_NUM_THREADS.
      This may indicate that you are unintentionally using multiple threads, which may
      cause problems. WE HAVE THEREFORE DISABLED OpenBLAS THREADING. If you know
      what you are doing and want threads enabled implicitly, set the environment
      variable LSST_ALLOW_IMPLICIT_THREADS.
      detectCoaddSources FATAL: Failed on dataId=DataId(initialdata={'filter': 'g', 'subfilter': '0', 'numSubfilters': '3', 'tract': 0, 'patch': '17,11'}, tag=set()): RuntimeError: Failed to format 'dcrCoadd/%(filter)s%(subfilter)
      dof%(numSubfilters)d/%(tract)d/%(patch)s.fits' with data DataId(initialdata={'filter': 'g', 'subfilter': '0', 'numSubfilters': '3', 'tract': 0, 'patch': '17,11'}, tag=set()): %d format: a number is required, not str
      Traceback (most recent call last):
        File "/software/lsstsw/stack_20190330/stack/miniconda3-4.5.12-1172c30/Linux64/obs_base/18.1.0-18-gb5d19ff+1/python/lsst/obs/base/cameraMapper.py", line 922, in _mapActualToPath
          return template % transformedId
      TypeError: %d format: a number is required, not str
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sullivan Ian Sullivan
                Reporter:
                sullivan Ian Sullivan
                Watchers:
                Ian Sullivan
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel