Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11880

Investigate and report on the impact to the DM design to keep raw images on disk

    Details

    • Type: Story
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Design Documents
    • Labels:
      None
    • Team:
      Data Facility

      Description

      Following analysis of RFC-325, a change to the DM level design is proposed for keeping raw images on disk at both the US and Chilean Data Centers, either without compression or with lossless compression.
      This ticket covers analyzing the technical and cost impact of this design change, including preparing an Observatory-level change request.

        Attachments

          Issue Links

            Activity

            Hide
            tjenness Tim Jenness added a comment -

            Reassigning to Michelle Butler from Don. It's really important for PVI generation and generation of other virtual data products, (and also efficiency for DRP) if we have raw data on disk and do not have to go to tape every time something needs to be done using data older than a month.

            Show
            tjenness Tim Jenness added a comment - Reassigning to Michelle Butler from Don. It's really important for PVI generation and generation of other virtual data products, (and also efficiency for DRP) if we have raw data on disk and do not have to go to tape every time something needs to be done using data older than a month.
            Hide
            tjenness Tim Jenness added a comment -

            Wil O'Mullane indicates to me that this may have been done in that the budget has been adjusted to account for raw data on disk (when we removed the tape system from Chile). We might not have updated the relevant LDMs though.

            Show
            tjenness Tim Jenness added a comment - Wil O'Mullane indicates to me that this may have been done in that the budget has been adjusted to account for raw data on disk (when we removed the tape system from Chile). We might not have updated the relevant LDMs though.
            Hide
            mbutler Michelle Butler added a comment - - edited

            Margaret Gelman is not sure if we adjusted the disk budget to hold more data.   Need to check that out.  (This is for Chile.  Tape is still in the design for LDF) 

            – Michelle 

             

             

            Show
            mbutler Michelle Butler added a comment - - edited Margaret Gelman is not sure if we adjusted the disk budget to hold more data.   Need to check that out.  (This is for Chile.  Tape is still in the design for LDF)  – Michelle     
            Hide
            mbutler Michelle Butler added a comment -

            very old issue from 2017.   new pricing model from KTL includes what is needed on disk.  

            Show
            mbutler Michelle Butler added a comment - very old issue from 2017.   new pricing model from KTL includes what is needed on disk.  

              People

              • Assignee:
                mbutler Michelle Butler
                Reporter:
                tjenness Tim Jenness
                Watchers:
                Gregory Dubois-Felsmann, Kian-Tat Lim, Michelle Butler, Tim Jenness, Wil O'Mullane
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel