Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-30516

AP pipeline infrastructure and Gen 3 updates in S22b

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: In Progress
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      s22b-ap-infrastructure
    • Story Points:
      27
    • WBS:
      02C.03.05
    • Team:
      Alert Production
    • Cycle:
      Spring 2022

      Description

      Infrastructure work to support Alert Production. This includes middleware, verification and testing frameworks, as well as performance tuning.

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
        DM-33256

        Remove Gen 2 support from verify

        4 Unassigned To Do
        DM-33254

        Remove Gen 2 support from ap_pipe

        4 Unassigned To Do
        DM-33095

        Streamline updating of ap_verify CI datasets

        4 Krzysztof Findeisen To Do
        DM-33039

        Re-examine how to handle dataset management scripts

        Krzysztof Findeisen To Do
        DM-34445

        Update ap_verify tutorial

        1 Unassigned To Do
        DM-34769

        Remove characterizeImage refObjLoader hooks

        1 John Parejko To Do
        DM-34758

        DiaCalculation plugins report fatal errors

        2 Unassigned To Do
        DM-34906

        Systematic error in ephemerides in ap_verify datasets

        6 Unassigned To Do
        DM-32138

        Remove VisitInfo.exposureId

        6 Unassigned To Do
        DM-31866

        Clean up requests usage in EphemerisQueryTask

        6 Krzysztof Findeisen To Do
        DM-31836

        Write gen3 formatter for Zooniverse data

        6 John Parejko To Do
        DM-21382

        Separate GenericMap's visitor API from its implementation

        6 Krzysztof Findeisen To Do
        DM-21268

        GenericMap can't distinguish int/float sizes in Python

        6 Krzysztof Findeisen To Do
        DM-26028

        Generalize ap_verify to use other executors

        Krzysztof Findeisen To Do
        DM-25160

        Record use of CCDData alert stamps in DPDD and DMTN-093

        4 Eric Bellm To Do
        DM-24326

        Add a PSF object to the Astropy CCData representation

        8 Unassigned To Do
        DM-28524

        Add versioning to Persistable

        8 Unassigned To Do
        DM-32771

        Persist analysis_ap plots with the butler

        4 Meredith Rawls To Do
        DM-21216

        GenericMap converts C-strings to bool

        2 Krzysztof Findeisen To Do
        DM-16773

        ap_verify_hits2015 hard to manage with lsstsw

        Unassigned To Do
        DM-16078

        convert coadd_utils to numpydoc

        John Swinbank To Do
        DM-16205

        Document ap_pipe using new Task doc framework

        4 Unassigned To Do
        DM-17458

        Complete docstrings in ip_diffim

        2 Unassigned To Do
        DM-17070

        Clean up lsst.afw.multiband

        2 Unassigned To Do
        DM-16861

        Convert afw.image to numpydoc

        6 Unassigned To Do
        DM-14136

        convert ip_isr documentation to numpydoc

        6 Unassigned To Do
        DM-34925

        Investigate memory use spike at end of DcrAssembleCoaddTask

        2 Ian Sullivan To Do
        DM-30869

        Modernize MetricTask for better Gen 3 workflow

        8 Krzysztof Findeisen To Do
        DM-13711

        Add type of observation information to visitInfo

        2 John Parejko To Do
        DM-25161

        Develop proposal for PSF representation in astropy CCDData

        12 John Parejko To Do
        DM-34586

        Use --fail-fast in ap_verify to halt execution on first error

        1 John Parejko In Progress
        DM-16824

        Convert meas_algorithms to numpydoc format

        John Parejko In Progress
        DM-34787

        Run ci_cosmos and ci_hits with the new image differencing

        2 John Parejko In Progress
        DM-34531

        Cleanup piff PSF determiner model size config options

        2 Arun Kannawadi In Review
         
        DM-33734

        Investigate non-processing AP pipeline overhead

        4 Krzysztof Findeisen Done
         
        DM-33639

        Fix refcat ingest docs and convert message to ingest into a RUN collection

        1 John Parejko Done
         
        DM-33058

        Deprecate validation_data_hsc and validation_data_decam

        2 John Parejko Done
         
        DM-32975

        Investigate omitting curated calibs from ap_verify dataset

        2 Krzysztof Findeisen Done
         
        DM-33416

        Write up a sketch of how to use pytest coverage to assist in gen2 removal

        2 John Parejko Done
         
        DM-33150

        Remove Gen 2 support from ap_verify

        7 Krzysztof Findeisen Done
         
        DM-34254

        ap_verify metrics report 0 completeness after switch to Piff

        6 John Parejko Done
         
        DM-33821

        Develop Chronograph metrics for known SSO attribution

        1 Krzysztof Findeisen Done
         
        DM-34768

        Deprecate characterizeImage refcat hooks

        1 John Parejko Done
         
        DM-33541

        Add unit tests for the ImageCutoutBackend class

        5 John Parejko Done
         
        DM-34626

        Discuss ExposureInfo with the Pipelines Scientist

        1 Krzysztof Findeisen Done
         
        DM-32838

        AP pipeline performance characterization

        6 John Parejko Done
         
        DM-32694

        Split AP pipeline into ApPipeWithFakes

        8 Krzysztof Findeisen Done
         
        DM-31063

        Copy configs from obs_* packages to ap_pipe

        3 Krzysztof Findeisen Done
         
        DM-34693

        Investigate lack of solar system matches in ap_verify runs

        6 Krzysztof Findeisen Done
         
        DM-12659

        Clean up Doxygen tagfile imports

        3 Krzysztof Findeisen Done
        DM-34786

        Run ci_hits with the new image differencing

        2 John Parejko Reviewed
         
        DM-32726

        Inconsistent overriding in ap_verify

        1 Krzysztof Findeisen Invalid

          Activity

          There are no comments yet on this issue.

            People

            Assignee:
            sullivan Ian Sullivan
            Reporter:
            sullivan Ian Sullivan
            Watchers:
            Ian Sullivan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:

                CI Builds

                No builds found.