Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-19797

Error from loadReferenceObjects with a Gen3 HSC-RC2 repo

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Templates:
    • Story Points:
      1
    • Team:
      Data Release Production

      Description

      With stack w_2019_19 and a ci_hsc repo, I can run the "processCcd" of one CCD:

      pipetask -d "visit=903334 and detector=22" -j 1 -b /project/hchiang2/bps_ci_hsc/w_2019_19/ci_hsc/DATA/butler.yaml -p lsst.ip.isr -p lsst.pipe.tasks  -i raw,calib,ref/ps1_pv3_3pi_20170110  -o out run -t isrTask.IsrTask:isr -C isr:$OBS_SUBARU_DIR/config/hsc/isr.py -t characterizeImage.CharacterizeImageTask:cit -C cit:$OBS_SUBARU_DIR/config/charImage.py -C cit:$OBS_SUBARU_DIR/config/hsc/charImage.py -t calibrate.CalibrateTask:ct -C ct:$OBS_SUBARU_DIR/config/calibrate.py -C ct:$OBS_SUBARU_DIR/config/hsc/calibrate.py
      

      This finishes without problems.

      Using DM-19638 we now can build a Gen3 HSC-RC2 repo. I got a repo with sqlite registry, and did the equivalent for another CCD:

      pipetask -d "visit=1228 and detector=40" -j 1 -b /project/hchiang2/gen3repos/w_2019_19/lite/repo/butler.yaml -p lsst.ip.isr -p lsst.pipe.tasks  -i raw/hsc,calibs/hsc/default,refcats/ps1_pv3  -o out run -t isrTask.IsrTask:isr -C isr:$OBS_SUBARU_DIR/config/hsc/isr.py -t characterizeImage.CharacterizeImageTask:cit -C cit:$OBS_SUBARU_DIR/config/charImage.py -C cit:$OBS_SUBARU_DIR/config/hsc/charImage.py -t calibrate.CalibrateTask:ct -C ct:$OBS_SUBARU_DIR/config/calibrate.py -C ct:$OBS_SUBARU_DIR/config/hsc/calibrate.py
      

      After the log messages

      calibrate INFO: Loaded 1474 reference objects
      calibrate WARN: Catalog pm_ra field is not an Angle; not applying proper motion
      

      it failed with

        File "/software/lsstsw/stack_20190330/stack/miniconda3-4.5.12-1172c30/Linux64/meas_astrom/17.0.1-8-g7a3d54a+18/python/lsst/meas/astrom/astrometry.py", line 152, in run
          res = self.solve(exposure=exposure, sourceCat=sourceCat)
        File "/software/lsstsw/stack_20190330/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_base/17.0.1-2-g3e5d191+31/python/lsst/pipe/base/timer.py", line 150, in wrapper
          res = func(self, *args, **keyArgs)
        File "/software/lsstsw/stack_20190330/stack/miniconda3-4.5.12-1172c30/Linux64/meas_astrom/17.0.1-8-g7a3d54a+18/python/lsst/meas/astrom/astrometry.py", line 196, in solve
          epoch=expMd.epoch,
        File "/software/lsstsw/stack_20190330/stack/miniconda3-4.5.12-1172c30/Linux64/meas_algorithms/17.0.1-13-g1d86082b+1/python/lsst/meas/algorithms/loadReferenceObjects.py", line 324, in loadPixelBox
          return self.loadRegion(outerSkyRegion, filtFunc=_filterFunction, epoch=epoch, filterName=filterName)
        File "/software/lsstsw/stack_20190330/stack/miniconda3-4.5.12-1172c30/Linux64/meas_algorithms/17.0.1-13-g1d86082b+1/python/lsst/meas/algorithms/loadReferenceObjects.py", line 415, in loadRegion
          if not hasNanojanskyFluxUnits(refCat.schema) or not getFormatVersionFromRefCat(refCat) >= 1:
      TypeError: '>=' not supported between instances of 'NoneType' and 'int'
      

      Don't think this has to block the merging of DM-19638 tomorrow, hence a separate ticket.

        Attachments

          Container Issues

            Issue Links

              Activity

                People

                • Assignee:
                  jbosch Jim Bosch
                  Reporter:
                  hchiang2 Hsin-Fang Chiang
                  Reviewers:
                  Nate Lust
                  Watchers:
                  Hsin-Fang Chiang, Jim Bosch, Nate Lust
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  3 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Summary Panel