Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-24328

colorAnalysis RuntimeError: No good data points to plot for sample labelled: all

    XMLWordPrintable

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: pipe_analysis
    • Labels:
      None
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Using the shared stack
      setup lsst_distrib -t w_2020_13
      setup lsst_sims -k -t sims_w_2020_13
      and the current master of pipe_analysis (6e7595b) and qa_explorer (4a24f54)

      This fails

      colorAnalysis.py /datasets/hsc/repo/ --calib /datasets/hsc/calib/20200115/ --rerun DM-23243/MULTIBAND/DEEP:private/whatever --config doWriteParquetTables=True --id tract=9812 filter=HSC-G^HSC-I2^HSC-I^HSC-R2^HSC-R^HSC-Y^HSC-Z^NB0387^NB0816^NB0921
      

      Traceback:

      Traceback (most recent call last):
        File "/software/lsstsw/stack_20200220/stack/miniconda3-4.7.12-984c9f7/Linux64/pipe_base/19.0.0-15-g557baf8+1/python/lsst/pipe/base/cmdLineTask.py", line 388, in __call__
          result = self.runTask(task, dataRef, kwargs)
        File "/software/lsstsw/stack_20200220/stack/miniconda3-4.7.12-984c9f7/Linux64/pipe_base/19.0.0-15-g557baf8+1/python/lsst/pipe/base/cmdLineTask.py", line 447, in runTask
          return task.runDataRef(dataRef, **kwargs)
        File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/colorAnalysis.py", line 429, in runDataRef
          patchList=patchList, hscRun=repoInfo.hscRun, geLabel=geLabel)
        File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/colorAnalysis.py", line 730, in plotGalacticExtinction
          labeller=AllLabeller(), qMin=qMin, qMax=qMax, magThreshold=99.0,
        File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/analysis.py", line 229, in __init__
          format(labeller.plot[0]))
      RuntimeError: No good data points to plot for sample labelled: all
      

        Attachments

          Activity

          Hide
          hchiang2 Hsin-Fang Chiang added a comment -

          Before the failure, there is this line in the log:

          colorAnalysis INFO: shortName = galacticExtinction_HSC-I2
          

          And earlier in the log, there is this warning:

          colorAnalysis WARN: Do not have A_X/E(B-V) for filter HSC-I2.  No Galactic Extinction correction applied for that filter.  Flag will be set
          

          If I don't include HSC-I2 in the input filter ID list, then the job could continue.

          Similarly for HSC-R2.

          That probably explains the failure, but still it would be nice for this to fail more gracefully.

          Show
          hchiang2 Hsin-Fang Chiang added a comment - Before the failure, there is this line in the log: colorAnalysis INFO: shortName = galacticExtinction_HSC-I2 And earlier in the log, there is this warning: colorAnalysis WARN: Do not have A_X/E(B-V) for filter HSC-I2. No Galactic Extinction correction applied for that filter. Flag will be set If I don't include HSC-I2 in the input filter ID list, then the job could continue. Similarly for HSC-R2. That probably explains the failure, but still it would be nice for this to fail more gracefully.
          Hide
          lauren Lauren MacArthur added a comment -

          Agreed!  Those filters weren’t even on my radar when the code was written, so are not accommodated...this should be fixed in addition to adding a more graceful fail mode for unrecognized filters.  Thanks � 

          Show
          lauren Lauren MacArthur added a comment - Agreed!  Those filters weren’t even on my radar when the code was written, so are not accommodated...this should be fixed in addition to adding a more graceful fail mode for unrecognized filters.  Thanks � 

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            hchiang2 Hsin-Fang Chiang
            Watchers:
            Hsin-Fang Chiang, Lauren MacArthur, Yusra AlSayyad
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:

                Jenkins

                No builds found.