Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-25143

Alert serialization & distribution in F20A

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      f20a-ap-alert
    • Story Points:
      39.375
    • WBS:
      02C.03.03
    • Team:
      Alert Production
    • Cycle:
      Fall 2020

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
       
      DM-25199

      Distribute lsst.alert.packet on PyPI

      2 Spencer Nelson Done
       
      DM-25164

      Add diaForceSources to diaPipe loader and to alert packets

      6 Chris Morrison Done
       
      DM-25163

      Understand astropy.CCDData

      4 Chris Morrison Done
       
      DM-25208

      Fix broken test in lsst/alert_packet master

      2 Spencer Nelson Done
       
      DM-24696

      Flatten Ap alert schemas

      4 Eric Bellm Done
       
      DM-24327

      Include coadd cutouts in alert packets

      4 Chris Morrison Done
       
      DM-24325

      Include CCDData cutouts in alert packets

      6 Chris Morrison Done
       
      DM-25826

      lsst.alert.packet reader should iterate over alerts

      4 Spencer Nelson Done
       
      DM-25737

      Investigate reasons for large cutouts in alert packets

      6 Chris Morrison Done
       
      DM-25753

      Prepare and present a discussion on alternative alert distribution schemes to the DM-SST

      6 Spencer Nelson Done
       
      DM-25229

      Create final sample alerts for distribution to community brokers

      2 Chris Morrison Done
       
      DM-25228

      Create README for sample alert packets

      2 Eric Bellm Done
       
      DM-25226

      Provide alert stream simulator for distribution to potential community broker authors

      1 Spencer Nelson Done
       
      DM-24926

      Attempt to get footprints from afw diaSourceCatalog and automatically set the alert cutout size.

      4 Chris Morrison Done
       
      DM-24646

      Document alert stream simulator usage and setup

      2 Spencer Nelson Done
       
      DM-24645

      Provide a sample consumer application for the alert stream simulator

      1 Spencer Nelson Done
       
      DM-24643

      Implement infinite-mode data pacer for alert stream simulator

      5 Spencer Nelson Done
       
      DM-25390

      Add Kafka serialization wrapper code to lsst.alert.stream

      1 Spencer Nelson Done
       
      DM-24967

      Fix flake8 errors in alert-stream-simulator

      0.1 Spencer Nelson Done
       
      DM-24966

      Raise Kafka errors as exceptions, not errors

      0.25 Spencer Nelson Done
       
      DM-25102

      Distribute lsst/alert_stream on PyPI

      2 Spencer Nelson Done
       
      DM-26064

      Change alert-stream-simulator tests to use latest alert packet version

      1 Spencer Nelson Done
       
      DM-26061

      Fix missing seek_to_beginning method in alert-stream-simulator

      1 Spencer Nelson Done
       
      DM-25930

      Limit alert cutout size to twice the detection footprint size.

      4 Chris Morrison Done
       
      DM-25681

      Alert cutouts should use the as-subtracted warps

      8 Chris Morrison Invalid

        Activity

        Hide
        swinbank John Swinbank added a comment -

        This work was completed in F20A.

        • The Alert Stream Simulator was delivered to the scientific community.
        • The Alert Production Pipeline is now capable of packaging alerts as Avro packets, using Astropy CCDData cutouts, but without PSF information.

        Further enhancements to the Alert Stream Simulator are planned on DM-26824, but those are not scheduled for the next development demicycle.

        Effort to enhance Astropy CCDData with PSF information will be undertaken on DM-26803.

        Show
        swinbank John Swinbank added a comment - This work was completed in F20A. The Alert Stream Simulator was delivered to the scientific community. The Alert Production Pipeline is now capable of packaging alerts as Avro packets, using Astropy CCDData cutouts, but without PSF information. Further enhancements to the Alert Stream Simulator are planned on DM-26824 , but those are not scheduled for the next development demicycle. Effort to enhance Astropy CCDData with PSF information will be undertaken on DM-26803 .

          People

          • Assignee:
            swinbank John Swinbank
            Reporter:
            swinbank John Swinbank
            Watchers:
            John Swinbank
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Summary Panel