Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12711

AP Pipeline Development in S18

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      s18-ap-pipe
    • Story Points:
      218
    • WBS:
      02C.03.08
    • Team:
      Alert Production
    • Cycle:
      Spring 2018

      Description

      Development of the end-to-end AP pipeline system. To include extending it to measure more metrics, to cover other instrumentation, and to provide drill-down capabilities for investigating failures

        Attachments

          Issue Links

          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. DM-10296 Address unresolved issues found in building the AP prototype pipeline

          • Done

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
           
          		DM-11745

          Investigate wrapping external function calls in ap_verify

          		 2 Krzysztof Findeisen Done
           
          		DM-11953

          Improve MaxPsfWcsSelectImagesTask

          		 4 Eric Bellm Done
           
          		DM-13530

          Generalize ingestion to non-HiTS data

          		 6 Krzysztof Findeisen Done
           
          		DM-13451

          Make ap_verify responsible for ingestion

          		 8 Krzysztof Findeisen Done
           
          		DM-13478

          Refactor AssociationDBSqlite to return and store afw tables containing DIAObjects instead of the current DIAObjectCollection. Remove DIAObjectCollection from the repository.

          		 10 Chris Morrison [X] (Inactive) Done
           
          		DM-13477

          Move association math from DIAObjectCollection into AssociationTask

          		 5 Chris Morrison [X] (Inactive) Done
           
          		DM-12867

          Study implications of Task/Butler redesign on ap_verify

          		 6 Krzysztof Findeisen Done
           
          		DM-12865

          Missing dependencies for ap_association

          		 1 Chris Morrison [X] (Inactive) Done
           
          		DM-12853

          Review design questions in ap_verify

          		 4 Krzysztof Findeisen Done
           
          		DM-12851

          Determine whether dataset framework can be made generic

          		 6 Krzysztof Findeisen Done
           
          		DM-12848

          ap_verify unit tests fail on lsst-dev

          		 2 Krzysztof Findeisen Done
           
          		DM-12306

          Make datasets optional for ap_verify

          		 2 Krzysztof Findeisen Done
           
          		DM-13687

          Make exploratory plots from HiTS processing

          		 6 Meredith Rawls Done
           
          		DM-13685

          Add storage of calibrated fluxes and computation of flux means to ap_assocation

          		 10 Chris Morrison [X] (Inactive) Done
           
          		DM-13573

          Create command-line ingestion script in ap_verify

          		 4 Krzysztof Findeisen Done
           
          		DM-13849

          Convert all ap_verify test data to obs_test

          		 4 Krzysztof Findeisen Done
           
          		DM-13835

          Cannot ingest empty data

          		 2 Krzysztof Findeisen Done
           
          		DM-13536

          Use repositories more idiomatically

          		 3 Krzysztof Findeisen Done
           
          		DM-13535

          Accept idiomatic input repositories

          		 1 Krzysztof Findeisen Done
           
          		DM-13970

          Investigate options for integrating AP with CI

          		 4 Krzysztof Findeisen Done
           
          		DM-13052

          AssociationTask does not call update on associated DIAObjects

          		 2 Chris Morrison [X] (Inactive) Done
           
          		DM-13042

          allow ap_verify to run under SLURM

          		 4 Krzysztof Findeisen Done
           
          		DM-13164

          Update documentation for ap_pipe

          		 6 Meredith Rawls Done
           
          		DM-13163

          Refactor ap_pipe to use CmdLineTask primitives

          		 10 Krzysztof Findeisen Done
           
          		DM-10299

          Apply crosstalk correction in decam

          		 12 Meredith Rawls Done
           
          		DM-11372

          Create CommandLineTask utility in `ap_pipe`

          		 6 Meredith Rawls Won't Fix
           
          		DM-13500

          Ingest ap_verify data into single repository

          		 2 Krzysztof Findeisen Won't Fix
           
          		DM-12662

          ap_pipe should consistently use new-style repos

          		 2 Krzysztof Findeisen Invalid
           
          		DM-12314

          Generalize ap_pipe to multiple visits

          		 4 Unassigned Invalid

            Activity

            There are no comments yet on this issue.

              People

              Assignee:
              swinbank John Swinbank
              Reporter:
              swinbank John Swinbank
              Watchers:
              John Swinbank, Krzysztof Findeisen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.