Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-31665

DC2 Reprocessing with w_2021_36 (gen2)

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Story Points:
      5
    • Epic Link:
    • Sprint:
      DRP S21b
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Process a single tract of the DC2 dataset with the w_2021_36 stack using gen2 middleware. Will follow same procedure as in DM-31351 where we started processing just a single tract, 3829. This run is required due to the gen2/gen3 SFM parity breaking issue that affected the w_2021_32 run and was resolved in DM-31412.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-32071 DC2 Reprocessing with w_2021_40+ (gen2)

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-22954 Define DC2.2i tracts to be included in the validation dataset

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-31351 DC2 Reprocessing with w_2021_32 (gen2)

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            lauren Lauren MacArthur added a comment -

            I still see the following (noted in DM-31067 and already ticketed: DM-31713):

            Traceback (most recent call last):
            		 
              File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/meas_extensions_scarlet/22.0.1-3-g31051c9+a0d9a39064/python/lsst/mea\
            		 
            s/extensions/scarlet/scarletDeblendTask.py", line 761, in deblend
            		 
                blend, skipped, spectrumInit = deblend(mExposure, foot, self.config)
            		 
              File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/meas_extensions_scarlet/22.0.1-3-g31051c9+a0d9a39064/python/lsst/mea\
            		 
            s/extensions/scarlet/scarletDeblendTask.py", line 300, in deblend
            		 
                blend = Blend(sources, observation)
            		 
              File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/blend.py"\
            		 
            , line 79, in __init__
            		 
                super().__init__(self.sources)
            		 
              File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/component\
            		 
            .py", line 237, in __init__
            		 
                super().__init__(frame, children=components, bbox=box)
            		 
              File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/component\
            		 
            .py", line 38, in __init__
            		 
                super().__init__(*parameters, children=children)
            		 
              File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/model.py"\
            		 
            , line 47, in __init__
            		 
                self.check_parameters()
            		 
              File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/model.py"\
            		 
            , line 122, in check_parameters
            		 
                raise ArithmeticError(msg)
            		 
            ArithmeticError: Model Blend, Parameter 'spectrum' is not finite:
            		 
            [3.2872605e-01 9.9999997e-21           nan 3.3848934e+04 9.9999997e-21
            		 
             9.9999997e-21]

            But otherwise all looks good. In particular, SFM parity has been reestablished, so gen2/gen3 parity testing for vanilla coaddition/multiband can resume on DM-30284.

            The pipe_analysis gen2 & gen2 vs. gen3 plots are linked here and the gen3-only plots are here.

            The verifyDrp plots are linked here.

            Run logs are in /datasets/DC2/repoRun2.2i/rerun/w_2021_36/DM-31665/logs and linked here.

            QA logs are in /datasets/DC2/repoRun2.2i/rerun/w_2021_36/DM-31665/qaLogs and linked here.

            Metrics were dispatched and ingested. They can be seen on the dashboard titled "DRP metrics monthly for DC2 (Gen2)" at https://chronograf-demo.lsst.codes/sources/2/dashboards.

            Show
            lauren Lauren MacArthur added a comment - I still see the following (noted in DM-31067  and already ticketed: DM-31713 ): Traceback (most recent call last): File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/meas_extensions_scarlet/22.0.1-3-g31051c9+a0d9a39064/python/lsst/mea\ s/extensions/scarlet/scarletDeblendTask.py", line 761, in deblend blend, skipped, spectrumInit = deblend(mExposure, foot, self.config) File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/meas_extensions_scarlet/22.0.1-3-g31051c9+a0d9a39064/python/lsst/mea\ s/extensions/scarlet/scarletDeblendTask.py", line 300, in deblend blend = Blend(sources, observation) File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/blend.py"\ , line 79, in __init__ super().__init__(self.sources) File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/component\ .py", line 237, in __init__ super().__init__(frame, children=components, bbox=box) File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/component\ .py", line 38, in __init__ super().__init__(*parameters, children=children) File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/model.py"\ , line 47, in __init__ self.check_parameters() File "/software/lsstsw/stack_20210813/stack/miniconda3-py38_4.9.2-0.7.0/Linux64/scarlet/lsst-dev-g965bb5fbbf+f31336177f/lib/python/scarlet/model.py"\ , line 122, in check_parameters raise ArithmeticError(msg) ArithmeticError: Model Blend, Parameter 'spectrum' is not finite: [3.2872605e-01 9.9999997e-21 nan 3.3848934e+04 9.9999997e-21 9.9999997e-21] But otherwise all looks good. In particular, SFM parity has been reestablished, so gen2/gen3 parity testing for vanilla coaddition/multiband can resume on DM-30284 . The pipe_analysis gen2 & gen2 vs. gen3 plots are linked here and the gen3-only plots are here . The verifyDrp plots are linked here . Run logs are in /datasets/DC2/repoRun2.2i/rerun/w_2021_36/ DM-31665 /logs and linked here . QA logs are in /datasets/DC2/repoRun2.2i/rerun/w_2021_36/ DM-31665 /qaLogs and linked here . Metrics were dispatched and ingested. They can be seen on the dashboard titled "DRP metrics monthly for DC2 (Gen2)" at https://chronograf-demo.lsst.codes/sources/2/dashboards .
            Hide
            Permalink
            lauren Lauren MacArthur added a comment -

            Another one to check off the books (when you get a chance to confirm all is in order to your satisfaction!)

            Show
            lauren Lauren MacArthur added a comment - Another one to check off the books (when you get a chance to confirm all is in order to your satisfaction!)

              People

              Assignee:
              lauren Lauren MacArthur
              Reporter:
              lauren Lauren MacArthur
              Reviewers:
              Yusra AlSayyad
              Watchers:
              Lauren MacArthur, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.