Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-29776

Attempt complete two-QG HSC RC2 run on w16 on one tract

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: obs_subaru
    • Labels:
    • Story Points:
      8
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      We think w16 includes all changes needed to make the Gen3 HSC RC2 w14 run succeed, as well as a single-shot FCGM configuration that should require less handholding and better pipeline subset definitions (DM-29737, DM-29615, DM-29750, DM-29348). Test this by trying to run tract=9813. Also use this to measure actual peak memory usage and update our BPS configs as well.

        Attachments

        1. step1.yaml
          2 kB
        2. step2.yaml
          2 kB
        3. step3.yaml
          2 kB

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29884 Fix exception in Gen3+applyColorTerms logic branch of jointcal

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29885 Disable jointcal photometry in HSC via config

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29916 Single-shot, multi-cycle FGCM is memory-inefficient

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-30046 Investigate memory usage of ForcedPhotCcd

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29670 Parallel/alternate Gen3 RC2 w_2021_14 processing for jointcal+

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29918 Investigate bad cgroup/HTCondor memory analysis in BPS vs. fgcmcal

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29944 Add some narrow-band filters to skymap's tract+patch+band data ID packers

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29714 Write simple tooling to check QuantumGraph expects vs. actual outputs

          • Won't Fix

            Activity

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Reviewers:
              Yusra AlSayyad
              Watchers:
              Jim Bosch, John Parejko, Lee Kelvin, Monika Adamow, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.