Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11138

Convert meas_mosaic wcs output to a format directly readable by the butler

    Details

    • Story Points:
      2
    • Sprint:
      DRP S18-3
    • Team:
      Data Release Production

      Description

      meas_mosaic writes its WCS as FITS header with no attached image, which requires loading code to use the following pattern:

      md = butler.get("wcs_md", ...)
      wcs = lsst.afw.image.makeWcs(md)
      

      instead of simply

      wcs = butler.get("wcs", ...)
      

      Using a header-only format also limits us to FITS-standard WCS mappings.

      Because Wcs inherits from afw::table::io::Persistable it already has writeFits and readFits methods that utilize our FITS binary table format, which will be able to save more complex WCS solutions. It's also compatible (or will be soon, on DM-10728) with the "FitsCatalogStorage" butler storage type, so we should be able to fix this by:

      • Redefining "wcs" to be a "FitsCatalogStorage" dataset, instead of a "FitsStorage" exposure in all mappers;
      • modifying meas_mosaic (and possibly jointcal, if needed) to use butler.put directly.
      • modifying any code that consumes the wcs dataset to use butler.get directly.

      In addition, this issue should include creating a simple command-line script that can be used to convert a data repository from the old format to the new one.

        Attachments

          Issue Links

            Activity

            jbosch Jim Bosch created issue -
            Parejkoj John Parejko made changes -
            Field Original Value New Value
            Watchers Jim Bosch, John Parejko, Paul Price [ Jim Bosch, John Parejko, Paul Price ] Jim Bosch, John Parejko, Paul Price, Russell Owen [ Jim Bosch, John Parejko, Paul Price, Russell Owen ]
            jbosch Jim Bosch made changes -
            Link This issue is triggered by RFC-450 [ RFC-450 ]
            jbosch Jim Bosch made changes -
            Epic Link DM-12729 [ 36328 ]
            jbosch Jim Bosch made changes -
            Component/s obs_base [ 10719 ]
            Component/s obs_subaru [ 10747 ]
            Sprint DRP S18-3 [ 687 ]
            Team Data Release Production [ 10301 ]
            Assignee Jim Bosch [ jbosch ]
            jbosch Jim Bosch made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            jbosch Jim Bosch made changes -
            Component/s validate_drp [ 14011 ]
            jbosch Jim Bosch made changes -
            Component/s obs_cfht [ 10762 ]
            Component/s obs_decam [ 12851 ]
            Component/s validate_drp [ 14011 ]
            jbosch Jim Bosch made changes -
            Component/s pipe_tasks [ 10726 ]
            jbosch Jim Bosch made changes -
            Link This issue blocks DM-13579 [ DM-13579 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-12796 [ DM-12796 ]
            jbosch Jim Bosch made changes -
            Reviewers Lauren MacArthur [ lauren ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            lauren Lauren MacArthur made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            jbosch Jim Bosch made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Link This issue is triggering DM-13760 [ DM-13760 ]
            yusra Yusra AlSayyad made changes -
            Story Points 2
            yusra Yusra AlSayyad made changes -
            Risk Score 0

              People

              • Assignee:
                jbosch Jim Bosch
                Reporter:
                jbosch Jim Bosch
                Reviewers:
                Lauren MacArthur
                Watchers:
                Hsin-Fang Chiang, Jim Bosch, John Parejko, Lauren MacArthur, Paul Price, Russell Owen
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel