Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16068

Some flux fields are not getting their units set

    Details

    • Templates:
    • Story Points:
      1
    • Sprint:
      DRP F18-5
    • Team:
      Data Release Production

      Description

      Since the flux -> instFlux name change of DM-10302, some backwards compatibility issues with older catalogs were revealed and thought to be fixed on DM-15857. The idea was to set aliases for all flux fields, identifying them by their units: any field with unit "count", "dn", or "adu" gets an alias set. This relies on the proper units having been set for all flux fields in the catalog. I have just found several cases (two very important ones!) where units are not being set:

      (Field['D'](name="modelfit_CModel_flux", doc="flux from the final cmodel fit"), Key<D>(offset=984, nElements=1))
      (Field['D'](name="modelfit_CModel_fluxErr", doc="flux uncertainty from the final cmodel fit"), Key<D>(offset=992, nElements=1))
      (Field['D'](name="modelfit_CModel_initial_flux_inner", doc="flux within the fit region, with no extrapolation"), Key<D>(offset=928, nElements=1))
      (Field['D'](name="modelfit_CModel_dev_flux_inner", doc="flux within the fit region, with no extrapolation"), Key<D>(offset=976, nElements=1))
      (Field['D'](name="modelfit_CModel_exp_flux_inner", doc="flux within the fit region, with no extrapolation"), Key<D>(offset=1376, nElements=1))
      (Field['D'](name="modelfit_CModel_flux_inner", doc="flux within the fit region, with no extrapolation"), Key<D>(offset=1000, nElements=1))
      

      As a result, we currently (with w_2018_40) can't even read in an older coadd catalog as a butler.get throws with:

      Field or subfield with name 'modelfit_CModel_instFlux' not found with type 'D'. {0}
      lsst::pex::exceptions::NotFoundError: 'Field or subfield with name 'modelfit_CModel_instFlux' not found with type 'D'.'
      

      This needs to be fixed for future processing, but still needs a workaround for old catalogs that do not have the units set properly.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jbosch Jim Bosch
                Reporter:
                lauren Lauren MacArthur
                Reviewers:
                Lauren MacArthur
                Watchers:
                Eli Rykoff, Jim Bosch, John Parejko, Lauren MacArthur, Yusra AlSayyad
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel