Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13893

Run pipe_analysis scripts with the RC2 data of w_2018_12

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Run

      1. visitAnalysis
      2. coaddAnalysis
      3. colorAnalysis
      4. compareVisitAnalysis
      5. compareCoaddAnalysis

      with the w_2018_12 RC2 outputs from DM-13795

        Attachments

          Issue Links

            Activity

            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            visitAnalysis and compareVisitAnalysis are finished using the current master of pipe_analysis (commit 79af2c7 with w_2018_12).

            The coadd level code failed due to the DM-11162 changes:

            Traceback (most recent call last):
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/pipe_base/14.0-6-ge2c9487+60/python/lsst/pipe/base/cmdLineTask.py", line 408, in __call__
                result = task.run(dataRef, **kwargs)
              File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/colorAnalysis.py", line 231, in run
                hscRun=repoInfo.hscRun)
              File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/colorAnalysis.py", line 386, in plotStarColors
                tractInfo=tractInfo, patchList=patchList, hscRun=hscRun)
              File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/analysis.py", line 752, in plotAll
                highlightList=highlightList, filterStr=dataId['filter'])
              File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/analysis.py", line 214, in plotAgainstMagAndHist
                plotTractOutline(axTopRight, tractInfo, patchList)
              File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/plotUtils.py", line 207, in plotTractOutline
                tractRa, tractDec = bboxToRaDec(tractInfo.getBBox(), tractInfo.getWcs())
              File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/plotUtils.py", line 342, in bboxToRaDec
                coord = wcs.pixelToSky(p).toIcrs()
            AttributeError: 'lsst.afw.geom.spherePoint.spherePoint.SpherePoint' object has no attribute 'toIcrs'
            

            Show
            hchiang2 Hsin-Fang Chiang added a comment - visitAnalysis and compareVisitAnalysis are finished using the current master of pipe_analysis (commit 79af2c7 with w_2018_12 ). The coadd level code failed due to the DM-11162 changes: Traceback (most recent call last): File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/pipe_base/14.0-6-ge2c9487+60/python/lsst/pipe/base/cmdLineTask.py" , line 408 , in __call__ result = task.run(dataRef, **kwargs) File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/colorAnalysis.py" , line 231 , in run hscRun=repoInfo.hscRun) File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/colorAnalysis.py" , line 386 , in plotStarColors tractInfo=tractInfo, patchList=patchList, hscRun=hscRun) File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/analysis.py" , line 752 , in plotAll highlightList=highlightList, filterStr=dataId[ 'filter' ]) File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/analysis.py" , line 214 , in plotAgainstMagAndHist plotTractOutline(axTopRight, tractInfo, patchList) File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/plotUtils.py" , line 207 , in plotTractOutline tractRa, tractDec = bboxToRaDec(tractInfo.getBBox(), tractInfo.getWcs()) File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/plotUtils.py" , line 342 , in bboxToRaDec coord = wcs.pixelToSky(p).toIcrs() AttributeError: 'lsst.afw.geom.spherePoint.spherePoint.SpherePoint' object has no attribute 'toIcrs'
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            Running pipe_analysis with the tickets/DM-11162 branch b12d596 gave the following error:

            Traceback (most recent call last):
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/pipe_base/14.0-6-ge2c9487+60/python/lsst/pipe/base/cmdLineTask.py", line 408, in __call__
                result = task.run(dataRef, **kwargs)
              File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/colorAnalysis.py", line 207, in run
                coaddDataset="Coadd_forced_src")
              File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/utils.py", line 999, in getRepoInfo
                hscRun = checkHscStack(metadata)
              File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/utils.py", line 931, in checkHscStack
                return metadata.get(name) if metadata.exists(name) else None
              File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/afw/14.0-60-ga423a1d65/python/lsst/afw/table/base/baseContinued.py", line 337, in __getattr__
                return getattr(self.columns, name)
            AttributeError: 'lsst.afw.table.source.source.SourceColumnView' object has no attribute 'exists'
            

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Running pipe_analysis with the tickets/ DM-11162 branch b12d596 gave the following error: Traceback (most recent call last): File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/pipe_base/14.0-6-ge2c9487+60/python/lsst/pipe/base/cmdLineTask.py" , line 408 , in __call__ result = task.run(dataRef, **kwargs) File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/colorAnalysis.py" , line 207 , in run coaddDataset= "Coadd_forced_src" ) File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/utils.py" , line 999 , in getRepoInfo hscRun = checkHscStack(metadata) File "/home/hchiang2/stack/pipe_analysis/python/lsst/pipe/analysis/utils.py" , line 931 , in checkHscStack return metadata.get(name) if metadata.exists(name) else None File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/afw/14.0-60-ga423a1d65/python/lsst/afw/table/base/baseContinued.py" , line 337 , in __getattr__ return getattr(self.columns, name) AttributeError: 'lsst.afw.table.source.source.SourceColumnView' object has no attribute 'exists'
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            The above errors were reported to Slack and were then fixed in the branch.

            coaddAnalysis, colorAnalysis, and compareCoaddAnalysis are run using the u/price/20180326 branch commit 71a27ab. Essentially it's the same as the newer tickets/DM-11162 branch.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - The above errors were reported to Slack and were then fixed in the branch. coaddAnalysis, colorAnalysis, and compareCoaddAnalysis are run using the u/price/20180326 branch commit 71a27ab. Essentially it's the same as the newer tickets/ DM-11162 branch.
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            compareVisitAnalysis and compareCoaddAnalysis were done between the RC/w_2018_10/DM-13647 repo and the RC/w_2018_12/DM-13795 repo.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - compareVisitAnalysis and compareCoaddAnalysis were done between the RC/w_2018_10/ DM-13647 repo and the RC/w_2018_12/ DM-13795 repo.
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            Runs finished successfully using the versions as described in the previous comments. Logs are at /project/hsc_rc/w_2018_12/DM-13795/qaLogs

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Runs finished successfully using the versions as described in the previous comments. Logs are at /project/hsc_rc/w_2018_12/ DM-13795 /qaLogs

              People

              Assignee:
              hchiang2 Hsin-Fang Chiang
              Reporter:
              hchiang2 Hsin-Fang Chiang
              Watchers:
              Hsin-Fang Chiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.