Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14868

Adapt validation_data_* processing to use HTM catalogs

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The "new" standard for the DM Stack processing is to use HTM style catalogs intead of astrometry.net formatted catalogs. The processing of the validation_data_hsc

      1. [x] Provide HTM reference catalogs for the validation_data_[cfht,decam,hsc]. DM-13701
      2. [x] Updating the processing configs to use these catalogs.
      3. [x] Update the HSC processing to include the transmission files.
      4. [x] Update the curated processed files based on these new reductions.
      5. [x] Update the examples in validate_drp/examples and the equivalent lsst_ci/scripts to use these catalogs.
      6. [x] Compare SRD performance with old-style and new-style catalogs to look for and characterize any significant differences.

        Attachments

          Issue Links

            Activity

            Hide
            Parejkoj John Parejko added a comment -

            Any more news on this?

            Show
            Parejkoj John Parejko added a comment - Any more news on this?
            Hide
            swinbank John Swinbank added a comment -

            Sorry, I should've updated this ticket. I've discussed this with Michael Wood-Vasey, and he reckons it'll be done by the end of this week.

            Show
            swinbank John Swinbank added a comment - Sorry, I should've updated this ticket. I've discussed this with Michael Wood-Vasey , and he reckons it'll be done by the end of this week.
            Hide
            wmwood-vasey Michael Wood-Vasey added a comment -

            Things are in shape and looking good. I'm running a final Jenkins job now.

            Show
            wmwood-vasey Michael Wood-Vasey added a comment - Things are in shape and looking good. I'm running a final Jenkins job now.
            Hide
            wmwood-vasey Michael Wood-Vasey added a comment -

            Jenkins passed. Merged.

            Again, my apologies for the delay. Thank you to everyone for your patience.

            Show
            wmwood-vasey Michael Wood-Vasey added a comment - Jenkins passed. Merged. Again, my apologies for the delay. Thank you to everyone for your patience.
            Hide
            swinbank John Swinbank added a comment -

            Thank you, Michael Wood-Vasey!

            Show
            swinbank John Swinbank added a comment - Thank you, Michael Wood-Vasey !

              People

              • Assignee:
                wmwood-vasey Michael Wood-Vasey
                Reporter:
                wmwood-vasey Michael Wood-Vasey
                Watchers:
                Chris Morrison, Colin Slater, John Parejko, John Swinbank, Michael Wood-Vasey, Simon Krughoff
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel