Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16068

Some flux fields are not getting their units set

    Details

    • Templates:
    • Story Points:
      1
    • Sprint:
      DRP F18-5
    • Team:
      Data Release Production

      Description

      Since the flux -> instFlux name change of DM-10302, some backwards compatibility issues with older catalogs were revealed and thought to be fixed on DM-15857. The idea was to set aliases for all flux fields, identifying them by their units: any field with unit "count", "dn", or "adu" gets an alias set. This relies on the proper units having been set for all flux fields in the catalog. I have just found several cases (two very important ones!) where units are not being set:

      (Field['D'](name="modelfit_CModel_flux", doc="flux from the final cmodel fit"), Key<D>(offset=984, nElements=1))
      (Field['D'](name="modelfit_CModel_fluxErr", doc="flux uncertainty from the final cmodel fit"), Key<D>(offset=992, nElements=1))
      (Field['D'](name="modelfit_CModel_initial_flux_inner", doc="flux within the fit region, with no extrapolation"), Key<D>(offset=928, nElements=1))
      (Field['D'](name="modelfit_CModel_dev_flux_inner", doc="flux within the fit region, with no extrapolation"), Key<D>(offset=976, nElements=1))
      (Field['D'](name="modelfit_CModel_exp_flux_inner", doc="flux within the fit region, with no extrapolation"), Key<D>(offset=1376, nElements=1))
      (Field['D'](name="modelfit_CModel_flux_inner", doc="flux within the fit region, with no extrapolation"), Key<D>(offset=1000, nElements=1))
      

      As a result, we currently (with w_2018_40) can't even read in an older coadd catalog as a butler.get throws with:

      Field or subfield with name 'modelfit_CModel_instFlux' not found with type 'D'. {0}
      lsst::pex::exceptions::NotFoundError: 'Field or subfield with name 'modelfit_CModel_instFlux' not found with type 'D'.'
      

      This needs to be fixed for future processing, but still needs a workaround for old catalogs that do not have the units set properly.

        Attachments

          Container Issues

            Issue Links

              Activity

                People

                • Assignee:
                  jbosch Jim Bosch
                  Reporter:
                  lauren Lauren MacArthur
                  Reviewers:
                  Lauren MacArthur
                  Watchers:
                  Eli Rykoff, Jim Bosch, John Parejko, Lauren MacArthur, Yusra AlSayyad
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  5 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Summary Panel