Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4924

Please provide transparent access to compressed files

    Details

    • Type: Improvement
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: butler
    • Labels:
      None
    • Templates:
    • Team:
      Data Access and Database

      Description

      I just noticed that if we compress files on disk (using gzip in this case) that the butler can't read them, although cfitsio can. That is,
      calexp = butler.get("calexp", dataId)
      fails but
      calexp = afwImage.ExposureF(butler.get("calexp_filename", dataId))
      works.

      SDSS's butler-equivalent checked for a variety of suffixes. for example
      ["", ".gz", ".fz"]
      and handled this transparently, searching for files with one of these suffixes appended until a match was found.

      Please provide this, or equivalent, functionality.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                rhl Robert Lupton
                Watchers:
                Nate Pease, Robert Lupton
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel