Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9234

Clean up the "inputData" file used in the DM-8603 dax generating script

    Details

    • Type: Story
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently the interface of generating Pegasus XML is
      python path/generateDax.py -i path/inputData.py -o outputXml.dax
      The input data file contains data id information and is an input of the more generic Pegasus dax generating script. While the exact format of this file (or non-file) is TBD, in this ticket I shall clean up the inputData file of the DM-8603 workflow to contain only data and no codes. This ticket provides a a stop-gap.

        Attachments

          Issue Links

            Activity

            Hide
            mkowalik Mikolaj Kowalik added a comment - - edited

            I have already done something along that line on my branch in your repo, i.e. u/mxk62/Executor. Feel free to take a look. I'll be happy to answer any questions you may have.

            Show
            mkowalik Mikolaj Kowalik added a comment - - edited I have already done something along that line on my branch in your repo, i.e. u/mxk62/Executor . Feel free to take a look. I'll be happy to answer any questions you may have.
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            Thanks for the example. It seems to me the needed "input data" are somewhat more complicated than the yaml file in your u/mxk62/Executor branch. Also I would like to query against it, or is the file supposed to be built using queries against the to-be-MDS?

            As the interface format is too unclear at this moment, I'm marking this WontFix for now.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Thanks for the example. It seems to me the needed "input data" are somewhat more complicated than the yaml file in your u/mxk62/Executor branch. Also I would like to query against it, or is the file supposed to be built using queries against the to-be-MDS? As the interface format is too unclear at this moment, I'm marking this WontFix for now.
            Hide
            mkowalik Mikolaj Kowalik added a comment - - edited

            Fair enough! I totally agree that with non-existent MDS debate over the input file format would be a waste of time.

            Just to answer your question, YAML format I used is just kind of a mock up. I have nothing against the input file being a query to a database of choice. I wanted to have something which does not include any Python code, just data specification.

            Show
            mkowalik Mikolaj Kowalik added a comment - - edited Fair enough! I totally agree that with non-existent MDS debate over the input file format would be a waste of time. Just to answer your question, YAML format I used is just kind of a mock up. I have nothing against the input file being a query to a database of choice. I wanted to have something which does not include any Python code, just data specification.

              People

              • Assignee:
                hchiang2 Hsin-Fang Chiang
                Reporter:
                hchiang2 Hsin-Fang Chiang
                Watchers:
                Hsin-Fang Chiang, Mikolaj Kowalik
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel