Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-3864

Integration Dataset for metrics and regression tests - Part I

    XMLWordPrintable

    Details

    • Epic Name:
      sqre-integration-dataset
    • Story Points:
      50
    • WBS:
      02C.01.02
    • Team:
      SQuaRE
    • Cycle:
      Winter 2016

      Description

      This epic covers the defintion of a compact but rich dataset to
      support regression testing and surrogate metric development for
      regular automatic integration tests. It also involes a definition of
      interim/surrogate metrics where they can aid testing and development
      and/or where KMPs cannot be calculated.

      [DN 75% MWV 25%]

        Attachments

          Issue Links

          blocks

          Milestone - An overall project milestone DLP-351 Intermediate Performance Metrics routinelly calculated and published

          • Major - Major loss of function.
          • Closed
          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-4706 Rerun and create a repository for CFHT astrometry test.

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-4708 Integrate astrometry test into SDSS demo lsst_dm_stack_demo

          • Done

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
           
          		DM-4307

          Please add HSC tests to CI

          		0.5 Michael Wood-Vasey Done
           
          		DM-4709

          Prototype a validation module of the stack using CFHT data.

          		1 Michael Wood-Vasey Done
           
          		DM-4708

          Integrate astrometry test into SDSS demo lsst_dm_stack_demo

          		0.5 Michael Wood-Vasey Done
           
          		DM-4706

          Rerun and create a repository for CFHT astrometry test.

          		1 Michael Wood-Vasey Done
           
          		DM-5393

          Add `pipe_tasks` as optional dependency to `validate_drp`

          		0.1 Michael Wood-Vasey Done
           
          		DM-5372

          Fix obs_* packages and ci tests broken by DM-4683

          		1 Michael Wood-Vasey Done
           
          		DM-5370

          Create lsst_ci package as a continuous integration build target

          		1 Michael Wood-Vasey Done
           
          		DM-5135

          Make ci_hsc buildable by Jenkins

          		2 Michael Wood-Vasey Done
           
          		DM-5121

          Add multiple-filter capabilities to `validate_drp`

          		1 Michael Wood-Vasey Done
           
          		DM-4901

          Use yaml configuration files to store camera-specific data ID and ref image information for validation testing.

          		1 Michael Wood-Vasey Done
           
          		DM-4848

          Measure photometric repeatability and correctness of reported errors

          		5 Michael Wood-Vasey Done
           
          		DM-4827

          Adapt `validate_drp` to standard python and bin subdir sturcture

          		0.5 Michael Wood-Vasey Done
           
          		DM-4817

          Read and understand `ci_hsc` and plan relationship with `validate_drp`

          		2 Michael Wood-Vasey Done
           
          		DM-4814

          Create validation_data set for DECam validation test

          		2 Michael Wood-Vasey Done
           
          		DM-5017

          Make validate_drp examples/runDecamTest.sh take

          		0.1 Michael Wood-Vasey Done
           
          		DM-4956

          Adapt SRD-based measurements of astrometric performance for validate_drp

          		4 Michael Wood-Vasey Done
           
          		DM-2917

          obs_cfht unit tests are broken

          		1 Michael Wood-Vasey Done

            Activity

            Hide
            Permalink
            frossie Frossie Economou added a comment -

            This epic was aggressively extended in scope to include implementation as well as investigation, and also to include HSC as it became clear that HSC is now the #1 precursor target for QA.

            Some of the work is described in DM technical note #8:

            http://dmtn-008.lsst.io/en/latest/

            Relevant repositories for this epic are:

            https://github.com/lsst/validate_drp
            and
            https://github.com/lsst/validation_data_hsc
            https://github.com/lsst/validation_data_cfht
            https://github.com/lsst/validation_data_decam

            Show
            frossie Frossie Economou added a comment - This epic was aggressively extended in scope to include implementation as well as investigation, and also to include HSC as it became clear that HSC is now the #1 precursor target for QA. Some of the work is described in DM technical note #8: http://dmtn-008.lsst.io/en/latest/ Relevant repositories for this epic are: https://github.com/lsst/validate_drp and https://github.com/lsst/validation_data_hsc https://github.com/lsst/validation_data_cfht https://github.com/lsst/validation_data_decam

              People

              Assignee:
              wmwood-vasey Michael Wood-Vasey
              Reporter:
              frossie Frossie Economou
              Watchers:
              Frossie Economou
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.