Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-6911

Ingesting tile compressed FITS files

    Details

      Description

      When I try to read in FITS tile compressed calexps (created with either cfitsio's fpack or astropy.io.fits), the files appear to be read correctly, but something from the headers appears to be mangled. I have not tracked down the problem in detail, but running jointcal on a butler repo containing the tile compressed calexps results in bad fits, while running it on the uncompressed files works fine.

      The problem likely lies in how we are extracting header information that may be modified as part of the tile compression process (compressed HDUs are actually binary tables, not images).

      This ticket came out of a discussion on community.

        Attachments

          Issue Links

            Activity

            Hide
            Parejkoj John Parejko added a comment -

            Ping of Paul Price, as this may be an earlier iteration of DM-11332. If you can close this simultaneously, I can switch my jointcal catalogs to using tile compression instead of bulk gzipping.

            Show
            Parejkoj John Parejko added a comment - Ping of Paul Price , as this may be an earlier iteration of DM-11332 . If you can close this simultaneously, I can switch my jointcal catalogs to using tile compression instead of bulk gzipping.
            Hide
            Parejkoj John Parejko added a comment -

            This works as of DM-11332; jointcal now works fine on fpacked images.

            Show
            Parejkoj John Parejko added a comment - This works as of DM-11332 ; jointcal now works fine on fpacked images.

              People

              • Assignee:
                Unassigned
                Reporter:
                Parejkoj John Parejko
                Watchers:
                Dominique Boutigny, Jim Bosch, John Parejko, Kian-Tat Lim, Paul Price, Robert Lupton
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel