Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-7538

CModel is producing SingularTransformException

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: meas_modelfit
    • Labels:
      None
    • Templates:
    • Story Points:
      1
    • Epic Link:
    • Sprint:
      DRP F16-4
    • Team:
      Data Release Production

      Description

      This is running on private data because I haven't yet found a public example that produces the problem. The particular data set may be specialised, but we shouldn't be so chatty in any case.

      pprice@tiger-sumire:/scratch/gpfs/pprice $ processCcd.py DATA --rerun cmodel --id visit=42742 ccd=49 --clobber-config
      /home/pprice/.local/lib/python2.7/site-packages/matplotlib/font_manager.py:273: UserWarning: Matplotlib is building the font cache using fc-list. This may take a moment.
        warnings.warn('Matplotlib is building the font cache using fc-list. This may take a moment.')
      : Loading config overrride file '/tigress/HSC/LSST/stack/Linux64/obs_subaru/12.0-16-gbc41bb6+2/config/processCcd.py'
      : Loading config overrride file '/tigress/HSC/LSST/stack/Linux64/obs_subaru/12.0-16-gbc41bb6+2/config/hsc/processCcd.py'
      : input=/scratch/gpfs/pprice/DATA
      : calib=None
      : output=/scratch/gpfs/pprice/DATA/rerun/cmodel
      CameraMapper: Loading registry registry from /scratch/gpfs/pprice/DATA/rerun/cmodel/_parent/registry.sqlite3
      CameraMapper: Loading calibRegistry registry from /scratch/gpfs/pprice/DATA/CALIB/calibRegistry.sqlite3
      processCcd: Processing {'taiObs': '2015-10-15', 'pointing': 1383, 'visit': 42742, 'dateObs': '2015-10-15', 'filter': 'HSC-I', 'field': 'U105A_CEN', 'ccd': 49, 'expTime': 250.0}
      processCcd.isr: Performing ISR on sensor {'taiObs': '2015-10-15', 'pointing': 1383, 'visit': 42742, 'dateObs': '2015-10-15', 'filter': 'HSC-I', 'field': 'U105A_CEN', 'ccd': 49, 'expTime': 250.0}
      processCcd.isr.crosstalk: Applying crosstalk correction
      processCcd.isr: Applying brighter fatter correction
      processCcd.isr: Finished brighter fatter in 6 iterations
      processCcd.isr: Set 0 BAD pixels to 3199.49
      processCcd.isr: Flattened sky level: 3200.822754 +/- 38.878743
      processCcd.isr: Measuring sky levels in 8x16 grids: 3196.589865
      processCcd.isr: Sky flatness in 8x16 grids - pp: 0.151048 rms: 0.022820
      processCcd.isr: Setting rough magnitude zero point: 34.594850
      processCcd.charImage: Processing {'taiObs': '2015-10-15', 'pointing': 1383, 'visit': 42742, 'dateObs': '2015-10-15', 'filter': 'HSC-I', 'field': 'U105A_CEN', 'ccd': 49, 'expTime': 250.0}
      processCcd.charImage.repair: Identified 831 cosmic rays.
      processCcd.charImage.detection: Detected 664 positive sources to 50 sigma.
      processCcd.charImage.detection: Resubtracting the background after object detection
      processCcd.charImage.measurement: Measuring 664 sources (664 parents, 0 children) 
      processCcd.charImage.measurePsf: Measuring PSF
      processCcd.charImage.measurePsf: PSF star selector found 303 candidates
      processCcd.charImage.measurePsf: Reserved 75 candidates from the fitting
      processCcd.charImage.measurePsf: PSF determination using 205/303 stars.
      processCcd.charImage: iter 1; PSF sigma=1.26, dimensions=(41, 41); median background=3196.07
      processCcd.charImage.repair: Identified 799 cosmic rays.
      processCcd.charImage.detection: Detected 743 positive sources to 50 sigma.
      processCcd.charImage.detection: Resubtracting the background after object detection
      processCcd.charImage.measurement: Measuring 743 sources (743 parents, 0 children) 
      processCcd.charImage.measurement WARNING: Error in modelfit_CModel.measure on record 36715308886523905: 
        File "src/geom/LinearTransform.cc", line 66, in const lsst::afw::geom::LinearTransform lsst::afw::geom::LinearTransform::invert() const
          Could not compute LinearTransform inverse {0}
      lsst::afw::geom::SingularTransformException: 'Could not compute LinearTransform inverse'
       
      processCcd.charImage.measurement WARNING: Error in modelfit_CModel.measure on record 36715308886523906: 
        File "src/geom/LinearTransform.cc", line 66, in const lsst::afw::geom::LinearTransform lsst::afw::geom::LinearTransform::invert() const
          Could not compute LinearTransform inverse {0}
      lsst::afw::geom::SingularTransformException: 'Could not compute LinearTransform inverse'
       
      [many, many more follow...]
      processCcd.charImage.measureApCorr: Measuring aperture corrections for 7 flux fields
      /tigress/HSC/LSST/stack/Linux64/meas_algorithms/12.0-24-g3f92e4c+6/python/lsst/meas/algorithms/measureApCorr.py:226: RuntimeWarning: invalid value encountered in greater
        fluxes > 0.0,
      processCcd.charImage.measureApCorr: Aperture correction for modelfit_CModel_exp: RMS 0.073826 from 253
      processCcd.charImage.measureApCorr: Aperture correction for base_PsfFlux: RMS 0.074407 from 255
      processCcd.charImage.measureApCorr: Aperture correction for modelfit_CModel: RMS 0.073742 from 253
      processCcd.charImage.measureApCorr: Aperture correction for modelfit_CModel_initial: RMS 0.072894 from 254
      processCcd.charImage.measureApCorr: Aperture correction for ext_photometryKron_KronFlux: RMS 0.062862 from 255
      processCcd.charImage.measureApCorr: Aperture correction for base_GaussianFlux: RMS 0.086553 from 255
      processCcd.charImage.measureApCorr: Aperture correction for modelfit_CModel_dev: RMS 0.073533 from 253
      processCcd.charImage.applyApCorr: Applying aperture corrections to 7 flux fields
      processCcd.charImage.applyApCorr: Use naive flux sigma computation
      processCcd.calibrate: Processing {'taiObs': '2015-10-15', 'pointing': 1383, 'visit': 42742, 'dateObs': '2015-10-15', 'filter': 'HSC-I', 'field': 'U105A_CEN', 'ccd': 49, 'expTime': 250.0}
      processCcd.calibrate.detection: Detected 4386 positive sources to 5 sigma.
      processCcd.calibrate.detection: Resubtracting the background after object detection
      processCcd.calibrate.deblend: Deblending 4386 sources
      processCcd.calibrate.deblend: Deblended: of 4386 sources, 1006 were deblended, creating 3754 children, total 8140 sources
      processCcd.calibrate.measurement: Measuring 8140 sources (4386 parents, 3754 children) 
      processCcd.calibrate.applyApCorr: Applying aperture corrections to 2 flux fields
      processCcd.calibrate.applyApCorr: Use naive flux sigma computation
      [...]
      

        Attachments

          Activity

            People

            • Assignee:
              price Paul Price
              Reporter:
              price Paul Price
              Reviewers:
              Jim Bosch
              Watchers:
              Jim Bosch, Paul Price
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel