Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32553

Update faro to use parquet tables for matched catalog metric calculation

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: faro
    • Labels:

      Description

      Use the `sourceTable` and/or `objectTable` parquet files instead of FITS "src" catalog files to calculate metrics in `faro` on matched catalogs.

        Attachments

          Issue Links

          clones

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-31460 Update faro to use parquet tables for matched catalog metric calculation

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-31860 Add flux statistic task and sky object metrics into faro

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26214 Switch to using sourceTable and objectTable parquet files instead of the src FITS files

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            jcarlin Jeffrey Carlin added a comment - - edited

            Confirmed that it runs fine on lsst-devl using:

             

            pipetask run -b /repo/dc2/butler.yaml -p $FARO_DIR/pipelines/measurement/measurement_forced_table.yaml -i 2.2i/runs/test-med-1/w_2021_40/DM-32024 -o u/jcarlin/faro_forced_test --register-dataset-types 


            pipetask run -b /repo/dc2/butler.yaml -p $FARO_DIR/pipelines/measurement/measurement_forced_multi_table.yaml -i 2.2i/runs/test-med-1/w_2021_40/DM-32024 -o u/jcarlin/faro_forced_multi_test --register-dataset-types

            Show
            jcarlin Jeffrey Carlin added a comment - - edited Confirmed that it runs fine on lsst-devl using:   pipetask run -b /repo/dc2/butler.yaml -p $FARO_DIR/pipelines/measurement/measurement_forced_table.yaml -i 2.2i/runs/test-med-1/w_2021_40/DM-32024 -o u/jcarlin/faro_forced_test --register-dataset-types  pipetask run -b /repo/dc2/butler.yaml -p $FARO_DIR/pipelines/measurement/measurement_forced_multi_table.yaml -i 2.2i/runs/test-med-1/w_2021_40/DM-32024 -o u/jcarlin/faro_forced_multi_test --register-dataset-types
            Hide
            Permalink
            kbechtol Keith Bechtol added a comment -

            Accomplished by https://github.com/lsst/faro/pull/113

            Show
            kbechtol Keith Bechtol added a comment - Accomplished by https://github.com/lsst/faro/pull/113

              People

              Assignee:
              jcarlin Jeffrey Carlin
              Reporter:
              jcarlin Jeffrey Carlin
              Reviewers:
              Keith Bechtol
              Watchers:
              Jeffrey Carlin, Keith Bechtol, Lee Kelvin
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.