Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22655

Genericize gen2to3.py to be useable with any gen2 repo

    XMLWordPrintable

    Details

    • Story Points:
      4
    • Epic Link:
    • Sprint:
      AP S20-1 (December), AP S20-2 (January), AP S20-3 (February), AP S20-4 (March)
    • Team:
      Alert Production

      Description

      To deal with the various obs_package gen3 support tickets, I'm going to try to make a more generic version of the gen2to3.py conversion script. This will serve as a useful stopgap for using test datasets, while the official "create a gen3 repo from scratch" code is sorted out.

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21865 Extend Gen3 butler support for obs_cfht

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21862 Extend Gen3 butler support for obs_decam

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23616 Run converted ap_verify testdata through gen3 pipeline

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21866 Extend Gen3 butler support for obs_sdss

          • Won't Fix

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21864 Extend Gen3 butler support for obs_lsst

          • Invalid
          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-22708 Fix decam gen3 ingest

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23630 fgcmcal failure Ubuntu

          • Done
          is triggering

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23728 Cleanup ci_hsc_gen2 to use new convert script instead of custom one

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23729 Generalize dataset to formatter mapping in obs packages

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23778 Write config and tests for obs_lsst gen2-gen3 convert

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23828 Create small test decam gen2 repo with calibs for test_convert2to3.py

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23640 Unify raw and calibration dataset types in gen2 mappers

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-22676 Create gaia dr2 refcat for ap_verify_hits2015

          • Done

          Improvement - An improvement or enhancement to an existing feature or task. DM-17444 dark exposure does not contain getVisitInfo()/getDarkTime()

          • Invalid

            Activity

            Ascending order - Click to sort in descending order
            Parejkoj John Parejko created issue -
            Parejkoj John Parejko made changes -
            Field Original Value New Value
            Link This issue blocks DM-21862 [ DM-21862 ]
            Parejkoj John Parejko made changes -
            Link This issue blocks DM-21866 [ DM-21866 ]
            Parejkoj John Parejko made changes -
            Link This issue blocks DM-21864 [ DM-21864 ]
            Parejkoj John Parejko made changes -
            Link This issue blocks DM-21865 [ DM-21865 ]
            Parejkoj John Parejko made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-22676 [ DM-22676 ]
            Parejkoj John Parejko made changes -
            Link This issue is blocked by DM-22708 [ DM-22708 ]
            swinbank John Swinbank made changes -
            Epic Link DM-22633 [ 427742 ]
            swinbank John Swinbank made changes -
            Sprint AP S20-1 (December) [ 981 ] AP S20-1 (December), AP S20-2 (January) [ 981, 983 ]
            ebellm Eric Bellm made changes -
            Labels gen2-deprecation-blocker gen3-middleware
            ebellm Eric Bellm made changes -
            Watchers Dino Bektesevic, Heather Kelly, James Chiang, Jim Bosch, John Parejko, John Swinbank, Meredith Rawls, Tim Jenness [ Dino Bektesevic, Heather Kelly, James Chiang, Jim Bosch, John Parejko, John Swinbank, Meredith Rawls, Tim Jenness ] Dino Bektesevic, Eric Bellm, Heather Kelly, James Chiang, Jim Bosch, John Parejko, John Swinbank, Meredith Rawls, Tim Jenness [ Dino Bektesevic, Eric Bellm, Heather Kelly, James Chiang, Jim Bosch, John Parejko, John Swinbank, Meredith Rawls, Tim Jenness ]
            swinbank John Swinbank made changes -
            Sprint AP S20-1 (December), AP S20-2 (January) [ 981, 983 ] AP S20-1 (December), AP S20-2 (January), AP S20-3 (February) [ 981, 983, 984 ]
            tjenness Tim Jenness made changes -
            Watchers Dino Bektesevic, Eric Bellm, Heather Kelly, James Chiang, Jim Bosch, John Parejko, John Swinbank, Meredith Rawls, Tim Jenness [ Dino Bektesevic, Eric Bellm, Heather Kelly, James Chiang, Jim Bosch, John Parejko, John Swinbank, Meredith Rawls, Tim Jenness ] Dino Bektesevic, Eric Bellm, Heather Kelly, James Chiang, Jim Bosch, John Parejko, John Swinbank, Kian-Tat Lim, Meredith Rawls, Tim Jenness [ Dino Bektesevic, Eric Bellm, Heather Kelly, James Chiang, Jim Bosch, John Parejko, John Swinbank, Kian-Tat Lim, Meredith Rawls, Tim Jenness ]
            Parejkoj John Parejko made changes -
            Link This issue is blocked by DM-23616 [ DM-23616 ]
            Parejkoj John Parejko made changes -
            Link This issue is blocked by DM-23630 [ DM-23630 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-23640 [ DM-23640 ]
            Parejkoj John Parejko made changes -
            Link This issue is triggering DM-23728 [ DM-23728 ]
            Parejkoj John Parejko made changes -
            Reviewers Tim Jenness [ tjenness ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            tjenness Tim Jenness made changes -
            Link This issue is triggering DM-23729 [ DM-23729 ]
            swinbank John Swinbank made changes -
            Sprint AP S20-1 (December), AP S20-2 (January), AP S20-3 (February) [ 981, 983, 984 ] AP S20-1 (December), AP S20-2 (January), AP S20-3 (February), AP S20-4 (March) [ 981, 983, 984, 985 ]
            tjenness Tim Jenness made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            tjenness Tim Jenness made changes -
            Component/s ci_hsc [ 13140 ]
            Parejkoj John Parejko made changes -
            Link This issue is triggering DM-23778 [ DM-23778 ]
            Parejkoj John Parejko made changes -
            Link This issue is triggering DM-23828 [ DM-23828 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-17444 [ DM-17444 ]
            Parejkoj John Parejko made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            Parejkoj John Parejko made changes -
            Link This issue is blocked by DM-23616 [ DM-23616 ]
            Parejkoj John Parejko made changes -
            Link This issue blocks DM-23616 [ DM-23616 ]
            swinbank John Swinbank made changes -
            Epic Link DM-22633 [ 427742 ] DM-24341 [ 433028 ]

              People

              Assignee:
              Parejkoj John Parejko
              Reporter:
              Parejkoj John Parejko
              Reviewers:
              Tim Jenness
              Watchers:
              Dino Bektesevic, Eric Bellm, Heather Kelly, James Chiang, Jim Bosch, John Parejko, John Swinbank, Kian-Tat Lim, Meredith Rawls, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.