Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15198

Clarify situation surrounding regeneration of PVIs to users on demand

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: Data Access
    • Labels:

      Description

      Action item from the 2018-05-22/24 DMLT F2F

      John Swinbank: Ensure pipelines code for regenerating images on demand is included in LDM-151, that an equivalent service is included in the appropriate DAX design documentation, and that both of them are included in the DM construction plan. 19 Jun 2018

      (It's not clear from the above, but this is explicitly referring to the generation of PVIs)

        Attachments

          Issue Links

            Activity

            Hide
            tjenness Tim Jenness added a comment -

            ...but still has to be solved and documented, and presumably is very closely related to PVI regeneration.

            Show
            tjenness Tim Jenness added a comment - ...but still has to be solved and documented, and presumably is very closely related to PVI regeneration.
            Hide
            swinbank John Swinbank added a comment -

            Tim, can we not continue this conversation on this ticket please? It's clearly out of scope. Please feel free to file another ticket, or raise it at the next DMLT meeting, as you think appropriate.

            Show
            swinbank John Swinbank added a comment - Tim, can we not continue this conversation on this ticket please? It's clearly out of scope. Please feel free to file another ticket, or raise it at the next DMLT meeting, as you think appropriate.
            Hide
            swinbank John Swinbank added a comment -

            Next: what is a PVI? Per DMS-REQ-0069...

            OOB, Tim Jenness points out that DMS-REQ-0069 “contains” some other requirements which specify that PVIs should contain a background model, a photometric zeropoint, a spatially-varying PSF, a WCS, the image data, a mask plane and a variance plane.

            Show
            swinbank John Swinbank added a comment - Next: what is a PVI? Per DMS-REQ-0069... OOB, Tim Jenness points out that DMS-REQ-0069 “contains” some other requirements which specify that PVIs should contain a background model, a photometric zeropoint, a spatially-varying PSF, a WCS, the image data, a mask plane and a variance plane.
            Hide
            swinbank John Swinbank added a comment -

            We discussed this at the DMLT call of 2019-12-02.

            Main outcome of that is that Frossie Economou and Gregory Dubois-Felsmann are putting together a DMTN which will propose an architecture for generation of data products (not just PVIs) on demand. That will form the basis for further discussion at the DMLT, and subsequently for requesting inputs from T/CAMs.

            In parallel, the new sizing model (DMTN-135) will have to make some assumptions about what is being stored and what is being computed. That will be clearly documented in the technote, and should ideally be parameterized so that it's easy to update the sizing model in response to architectural decisions.

            Show
            swinbank John Swinbank added a comment - We discussed this at the DMLT call of 2019-12-02. Main outcome of that is that Frossie Economou and Gregory Dubois-Felsmann are putting together a DMTN which will propose an architecture for generation of data products (not just PVIs) on demand. That will form the basis for further discussion at the DMLT, and subsequently for requesting inputs from T/CAMs. In parallel, the new sizing model (DMTN-135) will have to make some assumptions about what is being stored and what is being computed. That will be clearly documented in the technote, and should ideally be parameterized so that it's easy to update the sizing model in response to architectural decisions.
            Hide
            gpdf Gregory Dubois-Felsmann added a comment -

            This architectural question will be addressed in DMTN-139, an image service architecture note, being developed by me and Frossie under DM-22746.

            Show
            gpdf Gregory Dubois-Felsmann added a comment - This architectural question will be addressed in DMTN-139, an image service architecture note, being developed by me and Frossie under DM-22746 .

              People

              • Assignee:
                swinbank John Swinbank
                Reporter:
                swinbank John Swinbank
                Watchers:
                Gregory Dubois-Felsmann, John Swinbank, Kian-Tat Lim, Tim Jenness
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated:
                  End date:

                  Summary Panel