Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22663

Reimplement make_apdb.py for Gen 3

    Details

    • Templates:
    • Story Points:
      6
    • Team:
      Alert Production

      Description

      make_apdb.py is a non-Task command-line script. To make it easy to keep database configuration consistent between it and ap_pipe.py, make_apdb.py takes exactly the same config arguments as ap_pipe.py. In Gen 2, it does this by internally reusing ApPipeConfig and two custom argparse.Action classes from CmdLineTask. All of these classes will be removed along with Gen 2.

      Develop a new make_apdb.py that matches the interface used to configure the AP Pipeline (or at least the APDB) with the pipetask activator:

      pipetask run -c label:config_var.sub_config=6
      pipetask run --config label:config_var.sub_config=6
      pipetask run -C label:path
      pipetask run --configfile label:path
      

      It may be useful to wait until DM-21939 is done, so that we can see exactly what the new ap_pipe.py interface will look like. The current make_apdb.py will work with the Gen 3 pipeline for as long as CmdLineTask is also supported.

      Unfortunately, the Gen 3 equivalents of ConfigFileAction and ConfigValueAction do not do any config processing, which is instead tightly coupled to the activator code itself. So the Gen 3 version will have to find a different way to give users a consistent UI.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                krzys Krzysztof Findeisen
                Watchers:
                Chris Morrison, John Swinbank, Krzysztof Findeisen, Meredith Rawls
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Summary Panel