Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11776

"RuntimeWarning: invalid value encountered in greater/less" in processing HSC data

    XMLWordPrintable

    Details

      Description

      When running singleFrameDriver or processCcd with HSC RC data, it's frequent to see warnings like these:

      /software/lsstsw/stack/Linux64/meas_algorithms/13.0-18-gc4ad422+4/python/lsst/meas/algorithms/objectSizeStarSelector.py:400: RuntimeWarning: invalid value encountered in less
        bad = numpy.logical_or(bad, width < self.config.widthMin)
      /software/lsstsw/stack/Linux64/meas_algorithms/13.0-18-gc4ad422+4/python/lsst/meas/algorithms/objectSizeStarSelector.py:401: RuntimeWarning: invalid value encountered in greater
        bad = numpy.logical_or(bad, width > self.config.widthMax)
      /software/lsstsw/stack/Linux64/meas_algorithms/13.0-18-gc4ad422+4/python/lsst/meas/algorithms/matcherSourceSelector.py:126: RuntimeWarning: invalid value encountered in greater
        return sourceCat.get(self.fluxKey)/sourceCat.get(self.fluxSigmaKey) > self.config.minSnr
      

      Jim Bosch thinks they are likely from comparisons with NaNs for flagged sources. It'd be good to make them go away.

      An example data id to reproduce is to run:
      processCcd.py /datasets/hsc/repo/ --rerun private/username/abcd --id visit=28398 ccd=29
      Its output is attached in example.log

        Attachments

          Issue Links

            Activity

            hchiang2 Hsin-Fang Chiang created issue -
            hchiang2 Hsin-Fang Chiang made changes -
            Field Original Value New Value
            Summary "RuntimeWarning: invalid value encountered in greater/less" in processCcd-ing HSC data "RuntimeWarning: invalid value encountered in greater/less" in processing HSC data
            tjenness Tim Jenness made changes -
            Watchers Hsin-Fang Chiang, Jim Bosch [ Hsin-Fang Chiang, Jim Bosch ] Hsin-Fang Chiang, Jim Bosch, Scott Daniel [ Hsin-Fang Chiang, Jim Bosch, Scott Daniel ]
            tjenness Tim Jenness made changes -
            Labels SciencePipelines
            tjenness Tim Jenness made changes -
            Component/s meas_algorithms [ 10732 ]
            Component/s Science Pipelines [ 10706 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-12259 [ DM-12259 ]
            tjenness Tim Jenness made changes -
            Link This issue is duplicated by DM-5087 [ DM-5087 ]
            tjenness Tim Jenness made changes -
            Component/s ip_diffim [ 10743 ]
            Component/s meas_deblender [ 10741 ]
            Component/s meas_extensions_psfex [ 10734 ]
            Component/s pipe_tasks [ 10726 ]
            price Paul Price made changes -
            Reviewers Hsin-Fang Chiang [ hchiang2 ]
            Status To Do [ 10001 ] In Review [ 10004 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            price Paul Price made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Link This issue relates to DM-13541 [ DM-13541 ]
            tjenness Tim Jenness made changes -
            Assignee Paul Price [ price ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-13889 [ DM-13889 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-13889 [ DM-13889 ]
            swinbank John Swinbank made changes -
            Link This issue is duplicated by DM-6594 [ DM-6594 ]

              People

              Assignee:
              price Paul Price
              Reporter:
              hchiang2 Hsin-Fang Chiang
              Reviewers:
              Hsin-Fang Chiang
              Watchers:
              Hsin-Fang Chiang, Jim Bosch, John Parejko, Paul Price, Scott Daniel, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: