Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-8333

Run selected existing science codes with initial Batch Production Service facade

    XMLWordPrintable

    Details

    • Epic Name:
      Run science codes with initial service facade interface
    • Story Points:
      100
    • WBS:
      02C.07.01
    • Team:
      Data Facility
    • Cycle:
      Spring 2017

      Description

      Run HSC as-is code with initial service facade interface to PU. Provide QA visibility to prototype science operations role.

      • Ensure Slurm workload manager is available on the verification cluster (Greg)
      • Provide raw database access on lsst-db (???)
      • Ensure availability of HPC cluster (verification cluster), database servers, and Openstack for use by this activity (ICI)

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
         
        		DM-10129

        Process HSC RC dataset using Stack version chosen for the full S17B reprocessing

        		 6 Hsin-Fang Chiang Done
         
        		DM-10128

        Obtain missing public HSC RC data and add them to /datasets/hsc

        		 1 Hsin-Fang Chiang Done
         
        		DM-10084

        Process HSC RC dataset using Stack w_2017_w14

        		 10 Hsin-Fang Chiang Done
         
        		DM-10053

        /datasets/decam/calib/cp201302/ became obsolete during w_2017_11 and w_2017_13

        		 1 Hsin-Fang Chiang Done
         
        		DM-10404

        S17B  full HSC reprocessing with the SSP PDR1 data

        		 25 Hsin-Fang Chiang Done
         
        		DM-10436

        Add HSC Bright Object Masks (version "Arcturus") to /datasets/hsc

        		 1 Hsin-Fang Chiang Done
         
        		DM-8534

        Provide policy in appropriate location

        		 1 Hsin-Fang Chiang Done
         
        		DM-9061

        Copy PS1 catalog to /datasets

        		 0.25 Hsin-Fang Chiang Done
         
        		DM-9053

        Run singleFrameDriver with the HSC COSMOS dataset on Verification Cluster

        		 3 Hsin-Fang Chiang Done
         
        		DM-9800

        Define the steps and configs for reprocessing the HSC PDR1 data on lsstvc

        		 2 Hsin-Fang Chiang Done
         
        		DM-9799

        Learn to run meas_mosaic with HSC data

        		3 Hsin-Fang Chiang Done
         
        		DM-9978

        Copy the HSC calibs 20170105 to /datasets/hsc/calib

        		 0.5 Hsin-Fang Chiang Done
         
        		DM-9931

        Add dependency of "refcat" on "preSfm" in ci_hsc

        		 1 Hsin-Fang Chiang Done
         
        		DM-8701

        Copy and ingest HSC Cosmos data

        		 1 Hsin-Fang Chiang Done
         
        		DM-8681

        Implement RFC-263: Add DECam COSMOS data to /datasets/decam/

        		 3 Hsin-Fang Chiang Done
         
        		DM-8393

        Attend the middleware sync up meeting for the upcoming HSC data processing

        		 10 Hsin-Fang Chiang Won't Fix

          Activity

          Ascending order - Click to sort in descending order
          plutchak Joel Plutchak (Inactive) created issue -
          plutchak Joel Plutchak (Inactive) made changes -
          Field Original Value New Value
          Description Run HSC as-is code with initial service facade interface to PU. Provide QA visibility to prototype science operations roles.
          		Run HSC as-is code with initial service facade interface to PU. Provide QA visibility to prototype science operations role

          * Ensure Slurm workload manager is available on the verification cluster (Greg)
          * Provide raw database access on lsst-db (???)
          * Ensure availability of HPC cluster (verification cluster), database servers, and Openstack for use by this activity (ICI)
          plutchak Joel Plutchak (Inactive) made changes -
          WBS 02C.07.01
          plutchak Joel Plutchak (Inactive) made changes -
          WBS 02C.07.01 02C.07.02
          plutchak Joel Plutchak (Inactive) made changes -
          WBS 02C.07.02 02C.07.01
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-8393 [ 28004 ]
          plutchak Joel Plutchak (Inactive) made changes -
          Story Points 110
          plutchak Joel Plutchak (Inactive) made changes -
          Story Points 110 100
          mgelman2 Margaret Gelman made changes -
          Description Run HSC as-is code with initial service facade interface to PU. Provide QA visibility to prototype science operations role

          * Ensure Slurm workload manager is available on the verification cluster (Greg)
          * Provide raw database access on lsst-db (???)
          * Ensure availability of HPC cluster (verification cluster), database servers, and Openstack for use by this activity (ICI)           		Run HSC as-is code with initial service facade interface to PU. Provide QA visibility to prototype science operations role.

          * Ensure Slurm workload manager is available on the verification cluster (Greg)
          * Provide raw database access on lsst-db (???)
          * Ensure availability of HPC cluster (verification cluster), database servers, and Openstack for use by this activity (ICI)
          Summary Run selected existing science codes with initial service facade interface Run selected existing science codes with initial Batch Production Service facade
          plutchak Joel Plutchak (Inactive) made changes -
          Cycle Spring 2017 [ 10804 ]
          plutchak Joel Plutchak (Inactive) made changes -
          Labels Batch_Production_Services
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-8681 [ 28447 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-8534 [ 28175 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-8701 [ 28491 ]
          plutchak Joel Plutchak (Inactive) made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-9053 [ 29409 ]
          plutchak Joel Plutchak (Inactive) made changes -
          End date 28/Feb/17 28/Apr/17
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-9061 [ 29500 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-9799 [ 31153 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-9800 [ 31154 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-9931 [ 31358 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-10084 [ 31649 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-9978 [ 31416 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-10128 [ 31729 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-10129 [ 31730 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-10053 [ 31612 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-10404 [ 32141 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Epic Child DM-10436 [ 32189 ]
          plutchak Joel Plutchak (Inactive) made changes -
          End date 28/Apr/17 31/Aug/17
          Start date 01/Dec/16 01/Jun/17
          plutchak Joel Plutchak (Inactive) made changes -
          End date 31/Aug/17 01/Dec/16
          Start date 01/Jun/17 28/Feb/17
          plutchak Joel Plutchak (Inactive) made changes -
          Resolution Done [ 10000 ]
          Status In Progress [ 3 ] Done [ 10002 ]
          lauren Lauren MacArthur made changes -
          Link This issue relates to DM-11345 [ DM-11345 ]
          hchiang2 Hsin-Fang Chiang made changes -
          Link This issue relates to DM-11345 [ DM-11345 ]
          frossie Frossie Economou made changes -
          Team Process Middleware [ 10206 ] Data Facility [ 12219 ]

            People

            Assignee:
            hchiang2 Hsin-Fang Chiang
            Reporter:
            plutchak Joel Plutchak (Inactive)
            Watchers:
            Joel Plutchak (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:
              Start date:
              End date:

                Jenkins

                No builds found.