Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32388

Create calib generation script for ap_verify datasets

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ap_verify
    • Labels:
      None

      Description

      Based on the results of DM-31281, create scripts for each ap_verify dataset that can regenerate the master calibs to be used with that dataset's science images. These scripts will cover only generation and certification, not ingestion into the ap_verify dataset (which will be covered on DM-29857). Talk to cp_pipe folks (Chris Waters?) to ensure these scripts conform to current best practices.

      This issue covers making scripts for ap_verify_ci_hits2015 and ap_verify_hits2015, based on Meredith Rawls's work for DM-30703. The same treatment can be done for ap_verify_ci_cosmos_pdr2 once we have a complete procedure in place (after DM-29857).

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-29857 Create pure Gen 3 dataset management scripts for ap_verify datasets

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-31681 Write a "definitive" version of ApTemplate.yaml

          • Done
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. DM-32598 Trim ap_verify_hits2015 to just g-band

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            krzys Krzysztof Findeisen added a comment -

            Hi Meredith Rawls, would you be willing to review this? It's about 200 lines if you ignore the mostly-redundant CI dataset.

            Show
            krzys Krzysztof Findeisen added a comment - Hi Meredith Rawls , would you be willing to review this? It's about 200 lines if you ignore the mostly-redundant CI dataset.
            Hide
            Permalink
            mrawls Meredith Rawls added a comment -

            These bash scripts are a marked improvement over my manual process, and nicely preserve the workflow for regenerating a new set of calibs. The only thing missing is example syntax for how to run them from the command line (so one doesn't necessarily have to wade through bash regex adventure land to figure out how to specify a collection name, for instance). Thank you!

            Show
            mrawls Meredith Rawls added a comment - These bash scripts are a marked improvement over my manual process, and nicely preserve the workflow for regenerating a new set of calibs. The only thing missing is example syntax for how to run them from the command line (so one doesn't necessarily have to wade through bash regex adventure land to figure out how to specify a collection name, for instance). Thank you!

              People

              Assignee:
              krzys Krzysztof Findeisen
              Reporter:
              krzys Krzysztof Findeisen
              Reviewers:
              Meredith Rawls
              Watchers:
              Ian Sullivan, Krzysztof Findeisen, Meredith Rawls
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.