Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-6815

Update LSST full-stack processing configuration to match best practice from HSC

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      10
    • Epic Link:
    • Sprint:
      DRP F16-2, DRP F16-3, DRP F16-4
    • Team:
      Data Release Production

      Description

      In preparation for running an end-to-end comparison of large scale processing with the HSC and LSST stacks, we need to update the configuration to reflect currently understood best practice.

      In general, we expect the default HSC configuration to be better understood and "battle-tested" given that it has been used for science-grade data releases.

      Audit the default configuration of the full LSST stack (from ProcessCcdTask through multiband coadd processing). Where LSST defaults differ from HSC, update the LSST configuration to match the HSC equivalent unless there's a clear reason why LSST's default should be different. When it's not appropriate to update the LSST configuration, add an override to obs_subaru.

      In some cases, the LSST and HSC stacks have diverged so that a direct transfer of configuration options isn't possible. Where an equivalent can be found, take advantage of it. Otherwise, stick with existing LSST defaults.

        Attachments

        1. demoJunkSuppression.png
          demoJunkSuppression.png
          30 kB
        2. demoPsfFlux.png
          demoPsfFlux.png
          15 kB
        3. demoSpatialStructure.png
          demoSpatialStructure.png
          212 kB
        4. demoSpatialStructure2.png
          demoSpatialStructure2.png
          75 kB
        5. demoSpatialStructureUseApprox.png
          demoSpatialStructureUseApprox.png
          79 kB

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-6816 Process HSC "RC" dataset through the LSST stack

          • Done
          is blocked by

          RFC - An issue whose primary purpose is to advertise an intent and allow stakeholders to comment. RFC-220 Adopt best practice configuration defaults from HSC

          • Implemented
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9411 Investigate effects of bounding box setting for adaptive moments

          • Done

          RFC - An issue whose primary purpose is to advertise an intent and allow stakeholders to comment. RFC-212 Activate junk suppression by default

          • Implemented

            Activity

            Ascending order - Click to sort in descending order
            swinbank John Swinbank created issue -
            swinbank John Swinbank made changes -
            Field Original Value New Value
            Epic Link DM-5399 [ 23206 ]
            swinbank John Swinbank made changes -
            Rank Ranked higher
            swinbank John Swinbank made changes -
            Link This issue blocks DM-6816 [ DM-6816 ]
            swinbank John Swinbank made changes -
            Assignee Lauren MacArthur [ lauren ] Bob Armstrong [ rearmstr ]
            rearmstr Bob Armstrong made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            swinbank John Swinbank made changes -
            Sprint DRP F16-2 [ 231 ] TCAMS 2016_03, DRP F16-2 [ 209, 231 ]
            swinbank John Swinbank made changes -
            Rank Ranked higher
            swinbank John Swinbank made changes -
            Sprint TCAMS 2016_03, DRP F16-2 [ 209, 231 ] DRP F16-2 [ 231 ]
            swinbank John Swinbank made changes -
            Sprint DRP F16-2 [ 231 ] DRP F16-2, DRP F16-3 [ 231, 237 ]
            swinbank John Swinbank made changes -
            Rank Ranked lower
            swinbank John Swinbank made changes -
            Assignee Bob Armstrong [ rearmstr ] Lauren MacArthur [ lauren ]
            swinbank John Swinbank made changes -
            Sprint DRP F16-2, DRP F16-3 [ 231, 237 ] DRP F16-2, DRP F16-3, DRP F16-4 [ 231, 237, 246 ]
            swinbank John Swinbank made changes -
            Rank Ranked higher
            price Paul Price made changes -
            Link This issue relates to RFC-212 [ RFC-212 ]
            lauren Lauren MacArthur made changes -
            Attachment demoPsfFlux.png [ 28521 ]
            Attachment demoJunkSuppression.png [ 28522 ]
            lauren Lauren MacArthur made changes -
            Attachment demoSpatialStructure.png [ 28523 ]
            lauren Lauren MacArthur made changes -
            Attachment demoSpatialStructure2.png [ 28524 ]
            lauren Lauren MacArthur made changes -
            Reviewers Paul Price [ price ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            lauren Lauren MacArthur made changes -
            Attachment demoSpatialStructureUseApprox.png [ 28527 ]
            lauren Lauren MacArthur made changes -
            Link This issue is blocked by RFC-220 [ RFC-220 ]
            price Paul Price made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            lauren Lauren MacArthur made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            lauren Lauren MacArthur made changes -
            Link This issue relates to DM-9411 [ DM-9411 ]

              People

              Assignee:
              lauren Lauren MacArthur
              Reporter:
              swinbank John Swinbank
              Reviewers:
              Paul Price
              Watchers:
              Bob Armstrong, Jim Bosch, John Swinbank, Lauren MacArthur, Paul Price, Robert Lupton
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.