Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-23616

Run converted ap_verify testdata through gen3 pipeline

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ap_verify, obs_decam
    • Labels:
      None
    • Story Points:
      2
    • Epic Link:
    • Sprint:
      AP S20-3 (February), AP S20-4 (March)
    • Team:
      Alert Production
    • Urgent?:
      No

      Description

      To more fully test DM-22655, we should run as much of the gen3 pipeline as we can on a converted ap_verify test dataset. As a first test, lets run on ap_verify_ci_hits, instead of the much larger non-ci dataset.

      I'll provide the command to run in a comment. You'll need to get three packages on branch tickets/DM-22655 and scons'd: daf_butler, obs_base, and obs_decam. If you setup ap_verify_ci_hits2015 before sconsing obs_decam, it will run a few extra tests.

        Attachments

          Issue Links

          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-22655 Genericize gen2to3.py to be useable with any gen2 repo

          • Done

          Improvement - An improvement or enhancement to an existing feature or task. DM-17169 Crosstalk sources dataset does not cleanly fit Gen3 butler concept

          • Done
          relates to

          Bug - A problem which impairs or prevents the functions of the product. DM-23985 Cannot do linearity corrections in Gen 3 DECam processing

          • Done

          Bug - A problem which impairs or prevents the functions of the product. DM-23992 Cannot load refcats in Gen 3 DECam processing

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-24429 Investigate change in fracDiaSourcesToSciSources in ap_verify CI

          • Done

          Improvement - An improvement or enhancement to an existing feature or task. DM-17169 Crosstalk sources dataset does not cleanly fit Gen3 butler concept

          • Done

          Bug - A problem which impairs or prevents the functions of the product. DM-23983 Cannot apply crosstalk in Gen 3 DECam processing

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21915 Support Gen 3 ingestion of ap_verify datasets

          • Done
          mentioned in

          Page Loading...

            Activity

            Ascending order - Click to sort in descending order
            Parejkoj John Parejko created issue -
            Parejkoj John Parejko made changes -
            Field Original Value New Value
            Link This issue blocks DM-22655 [ DM-22655 ]
            krzys Krzysztof Findeisen made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            Parejkoj John Parejko made changes -
            Description To more fully test DM-22655, we should run as much of the gen3 pipeline as we can on a converted ap_verify test dataset. As a first test, lets run on ap_verify_ci_hits, instead of the much larger non-ci dataset.

            I'll provide the command to run in a comment. You'll need to get three packages on branch {{tickets/DM-22655}} and scons'd: daf_butler, obs_base, and obs_decam. If you setup ap_verify_ci_hits2015 before sconsing obs_decam, it will run a few extra tests.             		To more fully test DM-22655, we should run as much of the gen3 pipeline as we can on a converted ap_verify test dataset. As a first test, lets run on ap_verify_ci_hits, instead of the much larger non-ci dataset.

            I'll provide the command to run in a comment. You'll need to get three packages on branch {{tickets/DM-22655}} and scons'd: daf_butler, obs_base, and obs_decam. -If you setup ap_verify_ci_hits2015 before sconsing obs_decam, it will run a few extra tests.-
            krzys Krzysztof Findeisen made changes -
            Epic Link DM-22633 [ 427742 ]
            swinbank John Swinbank made changes -
            Sprint AP S20-3 (February) [ 984 ] AP S20-3 (February), AP S20-4 (March) [ 984, 985 ]
            Parejkoj John Parejko made changes -
            Link This issue blocks DM-22655 [ DM-22655 ]
            Parejkoj John Parejko made changes -
            Link This issue is blocked by DM-22655 [ DM-22655 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-17169 [ DM-17169 ]
            Parejkoj John Parejko made changes -
            Watchers Eric Bellm, Ian Sullivan, John Parejko, Krzysztof Findeisen, Meredith Rawls [ Eric Bellm, Ian Sullivan, John Parejko, Krzysztof Findeisen, Meredith Rawls ] Eric Bellm, Ian Sullivan, John Parejko, Krzysztof Findeisen, Meredith Rawls, Tim Jenness [ Eric Bellm, Ian Sullivan, John Parejko, Krzysztof Findeisen, Meredith Rawls, Tim Jenness ]
            Parejkoj John Parejko made changes -
            Link This issue is blocked by DM-17169 [ DM-17169 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-23983 [ DM-23983 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-23985 [ DM-23985 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-23992 [ DM-23992 ]
            krzys Krzysztof Findeisen made changes -
            Reviewers John Parejko [ parejkoj ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            Parejkoj John Parejko made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            krzys Krzysztof Findeisen made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            ebellm Eric Bellm made changes -
            Remote Link This issue links to "Page (Confluence)" [ 23747 ]
            swinbank John Swinbank made changes -
            Epic Link DM-22633 [ 427742 ] DM-24341 [ 433028 ]
            swinbank John Swinbank made changes -
            Link This issue relates to DM-24429 [ DM-24429 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-21915 [ DM-21915 ]

              People

              Assignee:
              krzys Krzysztof Findeisen
              Reporter:
              Parejkoj John Parejko
              Reviewers:
              John Parejko
              Watchers:
              Christopher Waters, Eric Bellm, Ian Sullivan, John Parejko, Krzysztof Findeisen, Meredith Rawls, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.