Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-3864

Integration Dataset for metrics and regression tests - Part I

    XMLWordPrintable

    Details

    • Epic Name:
      sqre-integration-dataset
    • Story Points:
      50
    • WBS:
      02C.01.02
    • Team:
      SQuaRE
    • Cycle:
      Winter 2016

      Description

      This epic covers the defintion of a compact but rich dataset to
      support regression testing and surrogate metric development for
      regular automatic integration tests. It also involes a definition of
      interim/surrogate metrics where they can aid testing and development
      and/or where KMPs cannot be calculated.

      [DN 75% MWV 25%]

        Attachments

          Issue Links

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
           
          DM-5393

          Add `pipe_tasks` as optional dependency to `validate_drp`

          0.1 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-5372

          Fix obs_* packages and ci tests broken by DM-4683

          1 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-5370

          Create lsst_ci package as a continuous integration build target

          1 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4848

          Measure photometric repeatability and correctness of reported errors

          5 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4827

          Adapt `validate_drp` to standard python and bin subdir sturcture

          0.5 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4817

          Read and understand `ci_hsc` and plan relationship with `validate_drp`

          2 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4814

          Create validation_data set for DECam validation test

          2 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4709

          Prototype a validation module of the stack using CFHT data.

          1 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4708

          Integrate astrometry test into SDSS demo lsst_dm_stack_demo

          0.5 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4706

          Rerun and create a repository for CFHT astrometry test.

          1 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-5135

          Make ci_hsc buildable by Jenkins

          2 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-5121

          Add multiple-filter capabilities to `validate_drp`

          1 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-5017

          Make validate_drp examples/runDecamTest.sh take

          0.1 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4956

          Adapt SRD-based measurements of astrometric performance for validate_drp

          4 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4901

          Use yaml configuration files to store camera-specific data ID and ref image information for validation testing.

          1 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-4307

          Please add HSC tests to CI

          0.5 Michael Wood-Vasey [X] (Inactive) Done
           
          DM-2917

          obs_cfht unit tests are broken

          1 Michael Wood-Vasey [X] (Inactive) Done

            Activity

            Hide
            frossie Frossie Economou added a comment -

            This epic was aggressively extended in scope to include implementation as well as investigation, and also to include HSC as it became clear that HSC is now the #1 precursor target for QA.

            Some of the work is described in DM technical note #8:

            http://dmtn-008.lsst.io/en/latest/

            Relevant repositories for this epic are:

            https://github.com/lsst/validate_drp
            and
            https://github.com/lsst/validation_data_hsc
            https://github.com/lsst/validation_data_cfht
            https://github.com/lsst/validation_data_decam

            Show
            frossie Frossie Economou added a comment - This epic was aggressively extended in scope to include implementation as well as investigation, and also to include HSC as it became clear that HSC is now the #1 precursor target for QA. Some of the work is described in DM technical note #8: http://dmtn-008.lsst.io/en/latest/ Relevant repositories for this epic are: https://github.com/lsst/validate_drp and https://github.com/lsst/validation_data_hsc https://github.com/lsst/validation_data_cfht https://github.com/lsst/validation_data_decam

              People

              Assignee:
              wmwood-vasey Michael Wood-Vasey [X] (Inactive)
              Reporter:
              frossie Frossie Economou
              Watchers:
              Frossie Economou
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins Builds

                  No builds found.