Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-3864

Integration Dataset for metrics and regression tests - Part I

    XMLWordPrintable

Details

    • sqre-integration-dataset
    • 50
    • 02C.01.02
    • SQuaRE
    • Winter 2016

    Description

      This epic covers the defintion of a compact but rich dataset to
      support regression testing and surrogate metric development for
      regular automatic integration tests. It also involes a definition of
      interim/surrogate metrics where they can aid testing and development
      and/or where KMPs cannot be calculated.

      [DN 75% MWV 25%]

      Attachments

        Issue Links

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
           
          DM-4848

          Measure photometric repeatability and correctness of reported errors

          5 Michael Wood-Vasey Done
           
          DM-4827

          Adapt `validate_drp` to standard python and bin subdir sturcture

          0.5 Michael Wood-Vasey Done
           
          DM-4817

          Read and understand `ci_hsc` and plan relationship with `validate_drp`

          2 Michael Wood-Vasey Done
           
          DM-4814

          Create validation_data set for DECam validation test

          2 Michael Wood-Vasey Done
           
          DM-5017

          Make validate_drp examples/runDecamTest.sh take

          0.1 Michael Wood-Vasey Done
           
          DM-4307

          Please add HSC tests to CI

          0.5 Michael Wood-Vasey Done
           
          DM-4956

          Adapt SRD-based measurements of astrometric performance for validate_drp

          4 Michael Wood-Vasey Done
           
          DM-4901

          Use yaml configuration files to store camera-specific data ID and ref image information for validation testing.

          1 Michael Wood-Vasey Done
           
          DM-4709

          Prototype a validation module of the stack using CFHT data.

          1 Michael Wood-Vasey Done
           
          DM-4708

          Integrate astrometry test into SDSS demo lsst_dm_stack_demo

          0.5 Michael Wood-Vasey Done
           
          DM-4706

          Rerun and create a repository for CFHT astrometry test.

          1 Michael Wood-Vasey Done
           
          DM-5393

          Add `pipe_tasks` as optional dependency to `validate_drp`

          0.1 Michael Wood-Vasey Done
           
          DM-5372

          Fix obs_* packages and ci tests broken by DM-4683

          1 Michael Wood-Vasey Done
           
          DM-5370

          Create lsst_ci package as a continuous integration build target

          1 Michael Wood-Vasey Done
           
          DM-5135

          Make ci_hsc buildable by Jenkins

          2 Michael Wood-Vasey Done
           
          DM-5121

          Add multiple-filter capabilities to `validate_drp`

          1 Michael Wood-Vasey Done
           
          DM-2917

          obs_cfht unit tests are broken

          1 Michael Wood-Vasey Done

          Activity

            This epic was aggressively extended in scope to include implementation as well as investigation, and also to include HSC as it became clear that HSC is now the #1 precursor target for QA.

            Some of the work is described in DM technical note #8:

            http://dmtn-008.lsst.io/en/latest/

            Relevant repositories for this epic are:

            https://github.com/lsst/validate_drp
            and
            https://github.com/lsst/validation_data_hsc
            https://github.com/lsst/validation_data_cfht
            https://github.com/lsst/validation_data_decam

            frossie Frossie Economou added a comment - This epic was aggressively extended in scope to include implementation as well as investigation, and also to include HSC as it became clear that HSC is now the #1 precursor target for QA. Some of the work is described in DM technical note #8: http://dmtn-008.lsst.io/en/latest/ Relevant repositories for this epic are: https://github.com/lsst/validate_drp and https://github.com/lsst/validation_data_hsc https://github.com/lsst/validation_data_cfht https://github.com/lsst/validation_data_decam

            People

              wmwood-vasey Michael Wood-Vasey
              frossie Frossie Economou
              Frossie Economou
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.