Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14868

Adapt validation_data_* processing to use HTM catalogs

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The "new" standard for the DM Stack processing is to use HTM style catalogs intead of astrometry.net formatted catalogs. The processing of the validation_data_hsc

      1. [x] Provide HTM reference catalogs for the validation_data_[cfht,decam,hsc]. DM-13701
      2. [x] Updating the processing configs to use these catalogs.
      3. [x] Update the HSC processing to include the transmission files.
      4. [x] Update the curated processed files based on these new reductions.
      5. [x] Update the examples in validate_drp/examples and the equivalent lsst_ci/scripts to use these catalogs.
      6. [x] Compare SRD performance with old-style and new-style catalogs to look for and characterize any significant differences.

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-14857 Switch the default matcher to PessimisticB.

          • Done
          duplicates

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. DM-13376 Replace testdata a.net refcats with Indexed refcats

          • Won't Fix
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. DM-13701 Provide HTM/PS1 refcats for validation_data_(hsc, decam, cfht)

          • Done
          is duplicated by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-11648 Switch validate_drp DECam test to use HTM reference catalog

          • Invalid
          is triggering

          Bug - A problem which impairs or prevents the functions of the product. DM-17544 new refcats in validation_data repos are invalid off lsst-dev

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-11395 Update testdata_jointcal refcats to new Indexed format

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-13298 change to using LSST style index files

          • Won't Fix

            Activity

            Ascending order - Click to sort in descending order
            15 older comments
            Hide
            Permalink
            Parejkoj John Parejko added a comment -

            Any more news on this?

            Show
            Parejkoj John Parejko added a comment - Any more news on this?
            Hide
            Permalink
            swinbank John Swinbank added a comment -

            Sorry, I should've updated this ticket. I've discussed this with Michael Wood-Vasey, and he reckons it'll be done by the end of this week.

            Show
            swinbank John Swinbank added a comment - Sorry, I should've updated this ticket. I've discussed this with Michael Wood-Vasey , and he reckons it'll be done by the end of this week.
            Hide
            Permalink
            wmwood-vasey Michael Wood-Vasey added a comment -

            Things are in shape and looking good. I'm running a final Jenkins job now.

            Show
            wmwood-vasey Michael Wood-Vasey added a comment - Things are in shape and looking good. I'm running a final Jenkins job now.
            Hide
            Permalink
            wmwood-vasey Michael Wood-Vasey added a comment -

            Jenkins passed. Merged.

            Again, my apologies for the delay. Thank you to everyone for your patience.

            Show
            wmwood-vasey Michael Wood-Vasey added a comment - Jenkins passed. Merged. Again, my apologies for the delay. Thank you to everyone for your patience.
            Hide
            Permalink
            swinbank John Swinbank added a comment -

            Thank you, Michael Wood-Vasey!

            Show
            swinbank John Swinbank added a comment - Thank you, Michael Wood-Vasey !

              People

              Assignee:
              wmwood-vasey Michael Wood-Vasey
              Reporter:
              wmwood-vasey Michael Wood-Vasey
              Watchers:
              Chris Morrison [X] (Inactive), Colin Slater, John Parejko, John Swinbank, Michael Wood-Vasey, Simon Krughoff
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.