Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-17062

Apply jointcal/meas_mosaic in Gen3 MakeWarpTask

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      2
    • Epic Link:
    • Sprint:
      DRP F19-5, DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June)
    • Team:
      Data Release Production

      Description

      ci_hsc doesn't contain enough data to make running meas_mosaic/jointcal helpful. DM-17028 implements MakeWarpTask, but lacks the ability to apply meas_mosaic/jointcal outputs. 

      (This was split into a separate ticket because it is a lower priority than getting a full DRP on ci_hsc working)

        Attachments

          Issue Links

            Activity

            Hide
            price Paul Price added a comment -

            Similar changes are required to the ForcedPhotCcdTask in meas_base.

            Gen3 doesn't work for this: I got the following error when adding a tract dimension for jointcal inputs.

            Failed to build graph: envelope(): incompatible function arguments. The following argument types are supported:
                1. (self: lsst.sphgeom.pixelization.Pixelization, region: lsst.sphgeom.region.Region, maxRanges: int=0) -> lsst::sphgeom::RangeSet
            Invoked with: HtmPixelization(7), NotImplemented
            Traceback (most recent call last):
              File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/ctrl_mpexec/19.0.0-7-g52b04eb+9/bin/pipetask", line 26, in <module>
                sys.exit(CmdLineFwk().parseAndRun())
              File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/ctrl_mpexec/19.0.0-7-g52b04eb+9/python/lsst/ctrl/mpexec/cmdLineFwk.py", line 156, in parseAndRun
                qgraph = self.makeGraph(pipeline, args)
              File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/ctrl_mpexec/19.0.0-7-g52b04eb+9/python/lsst/ctrl/mpexec/cmdLineFwk.py", line 340, in makeGraph
                qgraph = graphBuilder.makeGraph(pipeline, inputCollections, outputCollection, args.data_query)
              File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/pipe_base/19.0.0-6-gb6b8b0a+9/python/lsst/pipe/base/graphBuilder.py", line 778, in makeGraph
                skipExisting=self.skipExisting)
              File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/pipe_base/19.0.0-6-gb6b8b0a+9/python/lsst/pipe/base/graphBuilder.py", line 668, in fillQuanta
                expand=True,
              File "/home/pprice/LSST/daf_butler/python/lsst/daf/butler/registry/_registry.py", line 1301, in queryDatasets
                query = builder.finish()
              File "/home/pprice/LSST/daf_butler/python/lsst/daf/butler/registry/queries/_builder.py", line 403, in finish
                parameters = self._addWhereClause()
              File "/home/pprice/LSST/daf_butler/python/lsst/daf/butler/registry/queries/_builder.py", line 334, in _addWhereClause
                for begin, end in dimension.pixelization.envelope(self.summary.dataId.region):
            TypeError: envelope(): incompatible function arguments. The following argument types are supported:
                1. (self: lsst.sphgeom.pixelization.Pixelization, region: lsst.sphgeom.region.Region, maxRanges: int=0) -> lsst::sphgeom::RangeSet
            Invoked with: HtmPixelization(7), NotImplemented
            

            Show
            price Paul Price added a comment - Similar changes are required to the ForcedPhotCcdTask in meas_base. Gen3 doesn't work for this: I got the following error when adding a tract dimension for jointcal inputs. Failed to build graph: envelope(): incompatible function arguments. The following argument types are supported: 1. (self: lsst.sphgeom.pixelization.Pixelization, region: lsst.sphgeom.region.Region, maxRanges: int=0) -> lsst::sphgeom::RangeSet Invoked with: HtmPixelization(7), NotImplemented Traceback (most recent call last): File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/ctrl_mpexec/19.0.0-7-g52b04eb+9/bin/pipetask", line 26, in <module> sys.exit(CmdLineFwk().parseAndRun()) File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/ctrl_mpexec/19.0.0-7-g52b04eb+9/python/lsst/ctrl/mpexec/cmdLineFwk.py", line 156, in parseAndRun qgraph = self.makeGraph(pipeline, args) File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/ctrl_mpexec/19.0.0-7-g52b04eb+9/python/lsst/ctrl/mpexec/cmdLineFwk.py", line 340, in makeGraph qgraph = graphBuilder.makeGraph(pipeline, inputCollections, outputCollection, args.data_query) File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/pipe_base/19.0.0-6-gb6b8b0a+9/python/lsst/pipe/base/graphBuilder.py", line 778, in makeGraph skipExisting=self.skipExisting) File "/projects/HSC/LSST/stack_tiger2-sumire.princeton.edu_20191212/stack/miniconda3-4.7.10-4d7b902/Linux64/pipe_base/19.0.0-6-gb6b8b0a+9/python/lsst/pipe/base/graphBuilder.py", line 668, in fillQuanta expand=True, File "/home/pprice/LSST/daf_butler/python/lsst/daf/butler/registry/_registry.py", line 1301, in queryDatasets query = builder.finish() File "/home/pprice/LSST/daf_butler/python/lsst/daf/butler/registry/queries/_builder.py", line 403, in finish parameters = self._addWhereClause() File "/home/pprice/LSST/daf_butler/python/lsst/daf/butler/registry/queries/_builder.py", line 334, in _addWhereClause for begin, end in dimension.pixelization.envelope(self.summary.dataId.region): TypeError: envelope(): incompatible function arguments. The following argument types are supported: 1. (self: lsst.sphgeom.pixelization.Pixelization, region: lsst.sphgeom.region.Region, maxRanges: int=0) -> lsst::sphgeom::RangeSet Invoked with: HtmPixelization(7), NotImplemented

              People

              • Assignee:
                yusra Yusra AlSayyad
                Reporter:
                yusra Yusra AlSayyad
                Watchers:
                Paul Price, Yusra AlSayyad
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Summary Panel