Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-29776

Attempt complete two-QG HSC RC2 run on w16 on one tract

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: obs_subaru
    • Labels:
    • Story Points:
      8
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      We think w16 includes all changes needed to make the Gen3 HSC RC2 w14 run succeed, as well as a single-shot FCGM configuration that should require less handholding and better pipeline subset definitions (DM-29737, DM-29615, DM-29750, DM-29348). Test this by trying to run tract=9813. Also use this to measure actual peak memory usage and update our BPS configs as well.

        Attachments

        1. step1.yaml
          2 kB
        2. step2.yaml
          2 kB
        3. step3.yaml
          2 kB

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29884 Fix exception in Gen3+applyColorTerms logic branch of jointcal

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29885 Disable jointcal photometry in HSC via config

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29916 Single-shot, multi-cycle FGCM is memory-inefficient

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-30046 Investigate memory usage of ForcedPhotCcd

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29670 Parallel/alternate Gen3 RC2 w_2021_14 processing for jointcal+

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29918 Investigate bad cgroup/HTCondor memory analysis in BPS vs. fgcmcal

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29944 Add some narrow-band filters to skymap's tract+patch+band data ID packers

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29714 Write simple tooling to check QuantumGraph expects vs. actual outputs

          • Won't Fix

            Activity

            Ascending order - Click to sort in descending order
            jbosch Jim Bosch created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Link This issue relates to DM-29670 [ DM-29670 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-29714 [ DM-29714 ]
            jbosch Jim Bosch made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-29884 [ DM-29884 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-29885 [ DM-29885 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-29918 [ DM-29918 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-29916 [ DM-29916 ]
            jbosch Jim Bosch made changes -
            Reviewers Yusra AlSayyad [ yusra ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            yusra Yusra AlSayyad made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-29944 [ DM-29944 ]
            jbosch Jim Bosch made changes -
            Attachment step1.yaml [ 49340 ]
            Attachment step2.yaml [ 49341 ]
            Attachment step3.yaml [ 49342 ]
            jbosch Jim Bosch made changes -
            Labels drp-parity
            jbosch Jim Bosch made changes -
            Component/s obs_subaru [ 10747 ]
            jbosch Jim Bosch made changes -
            Epic Link DM-29149 [ 458506 ]
            Story Points 4 8
            jbosch Jim Bosch made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-30046 [ DM-30046 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-29149 [ 458506 ] DM-29153 [ 458510 ]

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Reviewers:
              Yusra AlSayyad
              Watchers:
              Jim Bosch, John Parejko, Lee Kelvin, Monika Adamow, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.