Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12711

AP Pipeline Development in S18

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Templates:
    • Epic Name:
      s18-ap-pipe
    • Story Points:
      218
    • WBS:
      02C.03.08
    • Team:
      Alert Production
    • Cycle:
      Spring 2018

      Description

      Development of the end-to-end AP pipeline system. To include extending it to measure more metrics, to cover other instrumentation, and to provide drill-down capabilities for investigating failures

        Attachments

          Container Issues

            Issue Links

            Stories in Epic (Custom Issue Matrix)

            Key Summary Story Points Assignee Status
             
            DM-13970

            Investigate options for integrating AP with CI

            4 Krzysztof Findeisen Done
             
            DM-13849

            Convert all ap_verify test data to obs_test

            4 Krzysztof Findeisen Done
             
            DM-13835

            Cannot ingest empty data

            2 Krzysztof Findeisen Done
             
            DM-13687

            Make exploratory plots from HiTS processing

            6 Meredith Rawls Done
             
            DM-13685

            Add storage of calibrated fluxes and computation of flux means to ap_assocation

            10 Chris Morrison Done
             
            DM-13573

            Create command-line ingestion script in ap_verify

            4 Krzysztof Findeisen Done
             
            DM-12853

            Review design questions in ap_verify

            4 Krzysztof Findeisen Done
             
            DM-12848

            ap_verify unit tests fail on lsst-dev

            2 Krzysztof Findeisen Done
             
            DM-13530

            Generalize ingestion to non-HiTS data

            6 Krzysztof Findeisen Done
             
            DM-13052

            AssociationTask does not call update on associated DIAObjects

            2 Chris Morrison Done
             
            DM-11745

            Investigate wrapping external function calls in ap_verify

            2 Krzysztof Findeisen Done
             
            DM-12306

            Make datasets optional for ap_verify

            2 Krzysztof Findeisen Done
             
            DM-11953

            Improve MaxPsfWcsSelectImagesTask

            4 Eric Bellm Done
             
            DM-13042

            allow ap_verify to run under SLURM

            4 Krzysztof Findeisen Done
             
            DM-13536

            Use repositories more idiomatically

            3 Krzysztof Findeisen Done
             
            DM-13535

            Accept idiomatic input repositories

            1 Krzysztof Findeisen Done
             
            DM-12867

            Study implications of Task/Butler redesign on ap_verify

            6 Krzysztof Findeisen Done
             
            DM-13478

            Refactor AssociationDBSqlite to return and store afw tables containing DIAObjects instead of the current DIAObjectCollection. Remove DIAObjectCollection from the repository.

            10 Chris Morrison Done
             
            DM-13477

            Move association math from DIAObjectCollection into AssociationTask

            5 Chris Morrison Done
             
            DM-12865

            Missing dependencies for ap_association

            1 Chris Morrison Done
             
            DM-13451

            Make ap_verify responsible for ingestion

            8 Krzysztof Findeisen Done
             
            DM-13163

            Refactor ap_pipe to use CmdLineTask primitives

            10 Krzysztof Findeisen Done
             
            DM-13164

            Update documentation for ap_pipe

            6 Meredith Rawls Done
             
            DM-10299

            Apply crosstalk correction in decam

            12 Meredith Rawls Done
             
            DM-12851

            Determine whether dataset framework can be made generic

            6 Krzysztof Findeisen Done
             
            DM-11372

            Create CommandLineTask utility in `ap_pipe`

            6 Meredith Rawls Won't Fix
             
            DM-13500

            Ingest ap_verify data into single repository

            2 Krzysztof Findeisen Won't Fix
             
            DM-12662

            ap_pipe should consistently use new-style repos

            2 Krzysztof Findeisen Invalid
             
            DM-12314

            Generalize ap_pipe to multiple visits

            4 Unassigned Invalid

              Activity

                People

                • Assignee:
                  swinbank John Swinbank
                  Reporter:
                  swinbank John Swinbank
                  Watchers:
                  John Swinbank, Krzysztof Findeisen
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  2 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Summary Panel