[DM-36251] Cleanup pipelines.lsst.io pipe_tasks warnings due to pipe_tasks - Jira

XML

Word

Printable

Details

Type: Story
Status: To Do
Resolution: Unresolved
Fix Version/s: None
Component/s: pipe_tasks
Labels:

Urgent?:
No

Description

Although I got pipelines.lsst.io to build with ~~DM-35939~~, it still produces a lot of warnings during the build. Cleaning up those warnings can be a slow process, as numpydoc isn't always specific about where the problem occurred. I'm not sure how much of this cleanup can really be done with just a `package-docs build`, instead of `stack-docs build`, given the former produces warnings about missing links because it can't know about things in other packages, but it might help because that runs much faster than a full `stack-docs build`.

I don't know if we have ways to make those warning messages more informative; tagging Jonathan Sick and Tim Jenness for suggestions.

I'd suggest waiting on DM-36249, as that will pull a lot of text out of docstrings and into Task Topic docs, and we'll probably cut down on the number of warnings produced as part of that.

Attachments

Issue Links

is blocked by

DM-36249 Move task docs out of class docstrings

To Do

is triggered by

DM-35939 Convert pipe_tasks to numpydoc and task topics

Done

Activity

Hide

Permalink

Tim Jenness added a comment - 15/Sep/22 11:44 PM

These are the new warnings:

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

---------- in

Return a dict of empty catalogs for each catalog dataset produced by this task.

... in the docstring of getSchemaCatalogs in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/mergeDetections.py.

  warn(msg)

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

---------- in

Return a dict of empty catalogs for each catalog dataset produced by this task.

... in the docstring of getSchemaCatalogs in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/mergeDetections.py.

  warn(msg)

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

------ in

Do postprocessing calculations

... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py.

  warn(msg)

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

------ in

Do postprocessing calculations

... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py.

  warn(msg)

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

------ in

Do postprocessing calculations

... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py.

  warn(msg)

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

------ in

Do postprocessing calculations

... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py.

  warn(msg)

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

------ in

Do postprocessing calculations

... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py.

  warn(msg)

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

------ in

Do postprocessing calculations

... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py.

  warn(msg)

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

------ in

Do postprocessing calculations

... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py.

  warn(msg)

/Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length...

Returns

------ in

Do postprocessing calculations

... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py.

  warn(msg)

reading sources... [100%] py-api/lsst.pipe.tasks.warpAndPsfMatch.WarpAndPsfMatchTask                                                                                                                               WARNING: :1: (WARNING/2) Inline interpreted text or phrase reference start-string without end-string.

WARNING: :3: (ERROR/3) Unexpected indentation.

WARNING: :4: (WARNING/2) Block quote ends without a blank line; unexpected unindent.

WARNING: :6: (WARNING/2) Definition list ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/assembleCoadd.py:docstring of lsst.pipe.tasks.assembleCoadd.CompareWarpAssembleCoaddTask:50: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/assembleCoadd.py:docstring of lsst.pipe.tasks.assembleCoadd.CompareWarpAssembleCoaddTask:51: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/characterizeImage.py:docstring of lsst.pipe.tasks.characterizeImage.CharacterizeImageTask.run:6: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/characterizeImage.py:docstring of lsst.pipe.tasks.characterizeImage.CharacterizeImageTask.run:7: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/colorterms.py:docstring of lsst.pipe.tasks.colorterms.ColortermDict:11: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/colorterms.py:docstring of lsst.pipe.tasks.colorterms.ColortermDict:14: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/colorterms.py:docstring of lsst.pipe.tasks.colorterms.ColortermLibrary.getColorterm:4: WARNING: Inline emphasis start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/cosmicRayPostDiff.py:docstring of lsst.pipe.tasks.cosmicRayPostDiff.CosmicRayPostDiffTask:4: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/cosmicRayPostDiff.py:docstring of lsst.pipe.tasks.cosmicRayPostDiff.CosmicRayPostDiffTask:6: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/extended_psf.py:docstring of lsst.pipe.tasks.extended_psf.MeasureExtendedPsfTask.select_detector_refs:10: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/extended_psf.py:docstring of lsst.pipe.tasks.extended_psf.StackBrightStarsTask.run:11: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/fit_multiband.py:docstring of lsst.pipe.tasks.fit_multiband.MultibandFitSubTask.run:31: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/fit_multiband.py:docstring of lsst.pipe.tasks.fit_multiband.MultibandFitSubTask.run:34: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/functors.py:docstring of lsst.pipe.tasks.functors.CompositeFunctor.__call__:11: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/functors.py:docstring of lsst.pipe.tasks.functors.MagErr:8: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/functors.py:docstring of lsst.pipe.tasks.functors.MagErr:9: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/imageDifference.py:docstring of lsst.pipe.tasks.imageDifference.ImageDifferenceTask:9: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/imageDifference.py:docstring of lsst.pipe.tasks.imageDifference.ImageDifferenceTask:10: WARNING: Inline strong start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/doc/py-api/lsst.pipe.tasks.insertFakes.InsertFakesConfig.rst:57:<autosummary>:1: WARNING: Inline literal start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:8: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:47: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:49: WARNING: Definition list ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:50: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:53: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:55: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:57: WARNING: Definition list ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:63: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:68: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/matchBackgrounds.py:docstring of lsst.pipe.tasks.matchBackgrounds.MatchBackgroundsTask.run:37: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/matchBackgrounds.py:docstring of lsst.pipe.tasks.matchBackgrounds.MatchBackgroundsTask.run:39: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/matchBackgrounds.py:docstring of lsst.pipe.tasks.matchBackgrounds.MatchBackgroundsTask.run:45: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/matchBackgrounds.py:docstring of lsst.pipe.tasks.matchBackgrounds.MatchBackgroundsTask.run:47: WARNING: Bullet list ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/doc/py-api/lsst.pipe.tasks.matchFakes.MatchFakesConfig.rst:59:<autosummary>:1: WARNING: Inline literal start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/doc/py-api/lsst.pipe.tasks.matchFakes.MatchVariableFakesConfig.rst:59:<autosummary>:1: WARNING: Inline literal start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/doc/py-api/lsst.pipe.tasks.mergeDetections.MergeDetectionsConfig.rst:24:<autosummary>:1: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/multiBand.py:docstring of lsst.pipe.tasks.multiBand.DetectCoaddSourcesTask:11: ERROR: Unknown target name: "sourcedetectiontask".

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable:28: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable:30: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable:39: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable:40: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable.toDataFrame:8: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable.toDataFrame:10: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable.toDataFrame:16: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable.toDataFrame:17: WARNING: Block quote ends without a blank line; unexpected unindent.

docstring of lsst.pipe.tasks.photoCal.PhotoCalConfig.applyColorTerms:4: ERROR: Unexpected indentation.

docstring of lsst.pipe.tasks.photoCal.PhotoCalConfig.applyColorTerms:5: WARNING: Block quote ends without a blank line; unexpected unindent.

docstring of lsst.pipe.tasks.photoCal.PhotoCalConfig.applyColorTerms:7: WARNING: Definition list ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.PostprocessAnalysis:7: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.PostprocessAnalysis:8: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:19: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:20: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:25: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:27: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:31: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:33: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:37: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:38: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:69: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.WriteRecalibratedSourceTableTask.addCalibColumns:4: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/processBrightStars.py:docstring of lsst.pipe.tasks.processBrightStars.ProcessBrightStarsTask.applySkyCorr:17: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/processBrightStars.py:docstring of lsst.pipe.tasks.processBrightStars.ProcessBrightStarsTask.run:22: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/processBrightStars.py:docstring of lsst.pipe.tasks.processBrightStars.ProcessBrightStarsTask.warpStamps:11: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/propagateSourceFlags.py:docstring of lsst.pipe.tasks.propagateSourceFlags.PropagateSourceFlagsTask.run:22: WARNING: Block quote ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/propagateVisitFlags.py:docstring of lsst.pipe.tasks.propagateVisitFlags.PropagateVisitFlagsTask:22: ERROR: Error in "rubric" directive:

no content permitted.

.. rubric:: Notes

    We want to be able to set a flag for sources on the coadds using flags

    that were determined from the individual visits.  A common example is sources

    that were used for PSF determination, since we do not do any PSF determination

    on the coadd but use the individual visits.  This requires matching the coadd

    source catalog to each of the catalogs from the inputs (see

    PropagateVisitFlagsConfig.matchRadius), and thresholding on the number of

    times a source is flagged on the input catalog.

    An important consideration in this is that the flagging of sources in the

    individual visits can be somewhat stochastic, e.g., the same stars may not

    always be used for PSF determination because the field of view moves slightly

    between visits, or the seeing changed.  We there threshold on the relative

    occurrence of the flag in the visits (see PropagateVisitFlagsConfig.flags).

    Flagging a source that is always flagged in inputs corresponds to a threshold

    of 1, while flagging a source that is flagged in any of the input corresponds

    to a threshold of 0.  But neither of these extrema are really useful in

    practise.

    Setting the threshold too high means that sources that are not consistently

    flagged (e.g., due to chip gaps) will not have the flag propagated.  Setting

    that threshold too low means that random sources which are falsely flagged in

    the inputs will start to dominate.  If in doubt, we suggest making this

    threshold relatively low, but not zero (e.g., 0.1 to 0.2 or so).  The more

    confidence in the quality of the flagging, the lower the threshold can be.

    The relative occurrence accounts for the edge of the field-of-view of the

    camera, but does not include chip gaps, bad or saturated pixels, etc.

    Initialization

    Beyond the usual Task initialization, PropagateVisitFlagsTask also requires

    a schema for the catalog that is being constructed.

    The 'run' method (described below) is the entry-point for operations.  The

    'getCcdInputs' staticmethod is provided as a convenience for retrieving the

    'ccdInputs' (CCD inputs table) from an Exposure.

    .. code-block :: none

        # Requires:

        # * butler: data butler, for retrieving the CCD catalogs

        # * coaddCatalog: catalog of source measurements on the coadd (lsst.afw.table.SourceCatalog)

        # * coaddExposure: coadd (lsst.afw.image.Exposure)

        from lsst.pipe.tasks.propagateVisitFlags import PropagateVisitFlagsTask, PropagateVisitFlagsConfig

        config = PropagateVisitFlagsConfig()

        config.flags["calib_psf_used"] = 0.3 # Relative threshold for this flag

        config.matchRadius = 0.5 # Matching radius in arcsec

        task = PropagateVisitFlagsTask(coaddCatalog.schema, config=config)

        ccdInputs = task.getCcdInputs(coaddExposure)

        task.run(butler, coaddCatalog, ccdInputs, coaddExposure.getWcs())

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/quickFrameMeasurement.py:docstring of lsst.pipe.tasks.quickFrameMeasurement.QuickFrameMeasurementTask.run:32: WARNING: Definition list ends without a blank line; unexpected unindent.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/read_curated_calibs.py:docstring of lsst.pipe.tasks.read_curated_calibs.read_all:28: ERROR: Error in "rubric" directive:

no content permitted.

.. rubric:: Notes

    Each leaf object in the constructed dictionary has metadata associated with it.

    The detector ID may be retrieved from the DETECTOR entry of that metadata.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/scaleZeroPoint.py:docstring of lsst.pipe.tasks.scaleZeroPoint.ScaleZeroPointTask.scaleFromFluxMag0:21: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/scaleZeroPoint.py:docstring of lsst.pipe.tasks.scaleZeroPoint.ScaleZeroPointTask.scaleFromPhotoCalib:16: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/selectImages.py:docstring of lsst.pipe.tasks.selectImages.BaseSelectImagesTask.run:21: ERROR: Unexpected indentation.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.addNewDiaObject:21: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.addNewDiaObject:29: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.addNewDiaObject:29: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.addNewDiaObject:46: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.findMatches:18: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.findMatches:22: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.updateCatalogs:25: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.updateCatalogs:29: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.updateCatalogs:29: WARNING: Inline interpreted text or phrase reference start-string without end-string.

/Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.updateCatalogs:46: WARNING: Inline interpreted text or phrase reference start-string without end-string.

looking for now-outdated files... none found

Show

Tim Jenness added a comment - 15/Sep/22 11:44 PM These are the new warnings: /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ---------- in Return a dict of empty catalogs for each catalog dataset produced by this task. ... in the docstring of getSchemaCatalogs in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/mergeDetections.py. warn(msg) /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ---------- in Return a dict of empty catalogs for each catalog dataset produced by this task. ... in the docstring of getSchemaCatalogs in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/mergeDetections.py. warn(msg) /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ------ in Do postprocessing calculations ... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py. warn(msg) /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ------ in Do postprocessing calculations ... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py. warn(msg) /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ------ in Do postprocessing calculations ... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py. warn(msg) /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ------ in Do postprocessing calculations ... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py. warn(msg) /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ------ in Do postprocessing calculations ... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py. warn(msg) /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ------ in Do postprocessing calculations ... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py. warn(msg) /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ------ in Do postprocessing calculations ... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py. warn(msg) /Users/timj/work/lsstsw/miniconda/envs/lsst-scipipe-4.0.0/lib/python3.10/site-packages/numpydoc/docscrape.py:440: UserWarning: potentially wrong underline length... Returns ------ in Do postprocessing calculations ... in the docstring of run in /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py. warn(msg) reading sources... [100%] py-api/lsst.pipe.tasks.warpAndPsfMatch.WarpAndPsfMatchTask WARNING: :1: (WARNING/2) Inline interpreted text or phrase reference start-string without end-string. WARNING: :3: (ERROR/3) Unexpected indentation. WARNING: :4: (WARNING/2) Block quote ends without a blank line; unexpected unindent. WARNING: :6: (WARNING/2) Definition list ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/assembleCoadd.py:docstring of lsst.pipe.tasks.assembleCoadd.CompareWarpAssembleCoaddTask:50: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/assembleCoadd.py:docstring of lsst.pipe.tasks.assembleCoadd.CompareWarpAssembleCoaddTask:51: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/characterizeImage.py:docstring of lsst.pipe.tasks.characterizeImage.CharacterizeImageTask.run:6: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/characterizeImage.py:docstring of lsst.pipe.tasks.characterizeImage.CharacterizeImageTask.run:7: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/colorterms.py:docstring of lsst.pipe.tasks.colorterms.ColortermDict:11: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/colorterms.py:docstring of lsst.pipe.tasks.colorterms.ColortermDict:14: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/colorterms.py:docstring of lsst.pipe.tasks.colorterms.ColortermLibrary.getColorterm:4: WARNING: Inline emphasis start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/cosmicRayPostDiff.py:docstring of lsst.pipe.tasks.cosmicRayPostDiff.CosmicRayPostDiffTask:4: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/cosmicRayPostDiff.py:docstring of lsst.pipe.tasks.cosmicRayPostDiff.CosmicRayPostDiffTask:6: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/extended_psf.py:docstring of lsst.pipe.tasks.extended_psf.MeasureExtendedPsfTask.select_detector_refs:10: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/extended_psf.py:docstring of lsst.pipe.tasks.extended_psf.StackBrightStarsTask.run:11: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/fit_multiband.py:docstring of lsst.pipe.tasks.fit_multiband.MultibandFitSubTask.run:31: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/fit_multiband.py:docstring of lsst.pipe.tasks.fit_multiband.MultibandFitSubTask.run:34: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/functors.py:docstring of lsst.pipe.tasks.functors.CompositeFunctor.__call__:11: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/functors.py:docstring of lsst.pipe.tasks.functors.MagErr:8: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/functors.py:docstring of lsst.pipe.tasks.functors.MagErr:9: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/imageDifference.py:docstring of lsst.pipe.tasks.imageDifference.ImageDifferenceTask:9: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/imageDifference.py:docstring of lsst.pipe.tasks.imageDifference.ImageDifferenceTask:10: WARNING: Inline strong start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/doc/py-api/lsst.pipe.tasks.insertFakes.InsertFakesConfig.rst:57:<autosummary>:1: WARNING: Inline literal start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:8: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:47: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:49: WARNING: Definition list ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:50: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:53: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:55: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:57: WARNING: Definition list ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:63: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/makeWarp.py:docstring of lsst.pipe.tasks.makeWarp.MakeWarpTask:68: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/matchBackgrounds.py:docstring of lsst.pipe.tasks.matchBackgrounds.MatchBackgroundsTask.run:37: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/matchBackgrounds.py:docstring of lsst.pipe.tasks.matchBackgrounds.MatchBackgroundsTask.run:39: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/matchBackgrounds.py:docstring of lsst.pipe.tasks.matchBackgrounds.MatchBackgroundsTask.run:45: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/matchBackgrounds.py:docstring of lsst.pipe.tasks.matchBackgrounds.MatchBackgroundsTask.run:47: WARNING: Bullet list ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/doc/py-api/lsst.pipe.tasks.matchFakes.MatchFakesConfig.rst:59:<autosummary>:1: WARNING: Inline literal start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/doc/py-api/lsst.pipe.tasks.matchFakes.MatchVariableFakesConfig.rst:59:<autosummary>:1: WARNING: Inline literal start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/doc/py-api/lsst.pipe.tasks.mergeDetections.MergeDetectionsConfig.rst:24:<autosummary>:1: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/multiBand.py:docstring of lsst.pipe.tasks.multiBand.DetectCoaddSourcesTask:11: ERROR: Unknown target name: "sourcedetectiontask". /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable:28: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable:30: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable:39: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable:40: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable.toDataFrame:8: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable.toDataFrame:10: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable.toDataFrame:16: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/parquetTable.py:docstring of lsst.pipe.tasks.parquetTable.MultilevelParquetTable.toDataFrame:17: WARNING: Block quote ends without a blank line; unexpected unindent. docstring of lsst.pipe.tasks.photoCal.PhotoCalConfig.applyColorTerms:4: ERROR: Unexpected indentation. docstring of lsst.pipe.tasks.photoCal.PhotoCalConfig.applyColorTerms:5: WARNING: Block quote ends without a blank line; unexpected unindent. docstring of lsst.pipe.tasks.photoCal.PhotoCalConfig.applyColorTerms:7: WARNING: Definition list ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.PostprocessAnalysis:7: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.PostprocessAnalysis:8: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:19: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:20: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:25: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:27: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:31: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:33: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:37: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:38: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.TransformCatalogBaseTask:69: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/postprocess.py:docstring of lsst.pipe.tasks.postprocess.WriteRecalibratedSourceTableTask.addCalibColumns:4: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/processBrightStars.py:docstring of lsst.pipe.tasks.processBrightStars.ProcessBrightStarsTask.applySkyCorr:17: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/processBrightStars.py:docstring of lsst.pipe.tasks.processBrightStars.ProcessBrightStarsTask.run:22: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/processBrightStars.py:docstring of lsst.pipe.tasks.processBrightStars.ProcessBrightStarsTask.warpStamps:11: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/propagateSourceFlags.py:docstring of lsst.pipe.tasks.propagateSourceFlags.PropagateSourceFlagsTask.run:22: WARNING: Block quote ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/propagateVisitFlags.py:docstring of lsst.pipe.tasks.propagateVisitFlags.PropagateVisitFlagsTask:22: ERROR: Error in "rubric" directive: no content permitted. .. rubric:: Notes We want to be able to set a flag for sources on the coadds using flags that were determined from the individual visits. A common example is sources that were used for PSF determination, since we do not do any PSF determination on the coadd but use the individual visits. This requires matching the coadd source catalog to each of the catalogs from the inputs (see PropagateVisitFlagsConfig.matchRadius), and thresholding on the number of times a source is flagged on the input catalog. An important consideration in this is that the flagging of sources in the individual visits can be somewhat stochastic, e.g., the same stars may not always be used for PSF determination because the field of view moves slightly between visits, or the seeing changed. We there threshold on the relative occurrence of the flag in the visits (see PropagateVisitFlagsConfig.flags). Flagging a source that is always flagged in inputs corresponds to a threshold of 1, while flagging a source that is flagged in any of the input corresponds to a threshold of 0. But neither of these extrema are really useful in practise. Setting the threshold too high means that sources that are not consistently flagged (e.g., due to chip gaps) will not have the flag propagated. Setting that threshold too low means that random sources which are falsely flagged in the inputs will start to dominate. If in doubt, we suggest making this threshold relatively low, but not zero (e.g., 0.1 to 0.2 or so). The more confidence in the quality of the flagging, the lower the threshold can be. The relative occurrence accounts for the edge of the field-of-view of the camera, but does not include chip gaps, bad or saturated pixels, etc. Initialization Beyond the usual Task initialization, PropagateVisitFlagsTask also requires a schema for the catalog that is being constructed. The 'run' method (described below) is the entry-point for operations. The 'getCcdInputs' staticmethod is provided as a convenience for retrieving the 'ccdInputs' (CCD inputs table) from an Exposure. .. code-block :: none # Requires: # * butler: data butler, for retrieving the CCD catalogs # * coaddCatalog: catalog of source measurements on the coadd (lsst.afw.table.SourceCatalog) # * coaddExposure: coadd (lsst.afw.image.Exposure) from lsst.pipe.tasks.propagateVisitFlags import PropagateVisitFlagsTask, PropagateVisitFlagsConfig config = PropagateVisitFlagsConfig() config.flags["calib_psf_used"] = 0.3 # Relative threshold for this flag config.matchRadius = 0.5 # Matching radius in arcsec task = PropagateVisitFlagsTask(coaddCatalog.schema, config=config) ccdInputs = task.getCcdInputs(coaddExposure) task.run(butler, coaddCatalog, ccdInputs, coaddExposure.getWcs()) /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/quickFrameMeasurement.py:docstring of lsst.pipe.tasks.quickFrameMeasurement.QuickFrameMeasurementTask.run:32: WARNING: Definition list ends without a blank line; unexpected unindent. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/read_curated_calibs.py:docstring of lsst.pipe.tasks.read_curated_calibs.read_all:28: ERROR: Error in "rubric" directive: no content permitted. .. rubric:: Notes Each leaf object in the constructed dictionary has metadata associated with it. The detector ID may be retrieved from the DETECTOR entry of that metadata. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/scaleZeroPoint.py:docstring of lsst.pipe.tasks.scaleZeroPoint.ScaleZeroPointTask.scaleFromFluxMag0:21: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/scaleZeroPoint.py:docstring of lsst.pipe.tasks.scaleZeroPoint.ScaleZeroPointTask.scaleFromPhotoCalib:16: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/selectImages.py:docstring of lsst.pipe.tasks.selectImages.BaseSelectImagesTask.run:21: ERROR: Unexpected indentation. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.addNewDiaObject:21: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.addNewDiaObject:29: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.addNewDiaObject:29: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.addNewDiaObject:46: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.findMatches:18: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.findMatches:22: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.updateCatalogs:25: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.updateCatalogs:29: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.updateCatalogs:29: WARNING: Inline interpreted text or phrase reference start-string without end-string. /Users/timj/work/lsstsw/build/pipe_tasks/python/lsst/pipe/tasks/simpleAssociation.py:docstring of lsst.pipe.tasks.simpleAssociation.SimpleAssociationTask.updateCatalogs:46: WARNING: Inline interpreted text or phrase reference start-string without end-string. looking for now-outdated files... none found

People

Assignee:: Unassigned

Reporter:: John Parejko

Watchers:: Ian Sullivan, John Parejko, Jonathan Sick, Tim Jenness, Yusra AlSayyad

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 15/Sep/22 10:58 PM

Updated:: 28/Oct/22 5:49 PM

Jenkins

No builds found.

Data Management