Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-30696

Add task to translate gen2 fgcmcal photocalibs to gen3 photocalib catalog

    XMLWordPrintable

Details

    • Story
    • Status: Done
    • Resolution: Done
    • None
    • obs_base
    • None

    Description

      Add a simple task to convert the gen2 fgcm photocalib individual files to the gen3 exposure catalog format.

      jbosch has offered to create the skeleton which will then be filled in. This will allow faro to be run on the gen2 to gen3 rc2 conversions.

      Attachments

        Issue Links

          Activity

            erykoff Eli Rykoff added a comment -

            jcarlin the converted catalogs are in the collection u/erykoff/RC2/w_2021_14/DM-29519/pc_wcs. This has fgcm photocalib catalogs in gen3 format and jointcal wcs catalogs in gen3 format.

            erykoff Eli Rykoff added a comment - jcarlin the converted catalogs are in the collection u/erykoff/RC2/w_2021_14/ DM-29519 /pc_wcs . This has fgcm photocalib catalogs in gen3 format and jointcal wcs catalogs in gen3 format.

            Great - I ran `faro` and compared the metrics from this gen2to3 conversion and the native gen3, and they are identical for all photometry and astrometry metrics. The translation seems to be fine.

            jcarlin Jeffrey Carlin added a comment - Great - I ran `faro` and compared the metrics from this gen2to3 conversion and the native gen3, and they are identical for all photometry and astrometry metrics. The translation seems to be fine.
            erykoff Eli Rykoff added a comment - - edited

            yusra For the record, here are the pipetask commands that I ran for the conversion done for this ticket (one for photocalib, one for wcs):

            pipetask run -b /repo/main -i HSC/runs/RC2/w_2021_14/DM-29519 -o u/erykoff/RC2/w_2021_14/DM-29519/pc
            _wcs -p pipeline_pc_conv.yaml -d "instrument='HSC'" --register-dataset-types
            pipetask run -b /repo/main -i HSC/runs/RC2/w_2021_14/DM-29519 -o u/erykoff/RC2/w_2021_14/DM-29519/pc
            _wcs -p pipeline_wcs_conv.yaml -d "instrument='HSC'" --register-dataset-types
            

            And here are the pipeline yamls: pipeline_pc_conv.yaml pipeline_wcs_conv.yaml

            erykoff Eli Rykoff added a comment - - edited yusra For the record, here are the pipetask commands that I ran for the conversion done for this ticket (one for photocalib, one for wcs): pipetask run -b /repo/main -i HSC/runs/RC2/w_2021_14/DM-29519 -o u/erykoff/RC2/w_2021_14/DM-29519/pc _wcs -p pipeline_pc_conv.yaml -d "instrument='HSC'" --register-dataset-types pipetask run -b /repo/main -i HSC/runs/RC2/w_2021_14/DM-29519 -o u/erykoff/RC2/w_2021_14/DM-29519/pc _wcs -p pipeline_wcs_conv.yaml -d "instrument='HSC'" --register-dataset-types And here are the pipeline yamls: pipeline_pc_conv.yaml pipeline_wcs_conv.yaml

            People

              erykoff Eli Rykoff
              erykoff Eli Rykoff
              Jeffrey Carlin
              Eli Rykoff, Jeffrey Carlin, Jim Bosch
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.