Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-23212

pipetask run with multiple "-i" command line arguments fails

    Details

    • Story Points:
      0.5
    • Sprint:
      DB_S20_01
    • Team:
      Data Access and Database

      Description

      This ticket follows up the discussion of the gen3 middleware telecon on 2020-01-23.

      Specifying multiple -i command line options for input connection locations or one -i option with a comma separated list of connection locations should be equivalent. Please find example pipeline on the ci_hsc_gen3 data attached.

       

      # This one fails
       $ pipetask run -j 1 -b ../ci_hsc_gen3/DATA/butler.yaml -i raw/hsc -i calib/hsc -i ref_cats -o sPccd3_2020-01-27 --register-dataset-types -p simpleProcessCccd.yaml -d "detector = 22 AND visit = 903334 AND abstract_filter='r'" |& tee -a sPccd3_2020-01-27.log
       
      # This one works as expected
       $ pipetask run -j 1 -b ../ci_hsc_gen3/DATA/butler.yaml -i raw/hsc,calib/hsc,ref_cats -o sPccd4_2020-01-27 --register-dataset-types -p simpleProcessCccd.yaml -d "detector = 22 AND visit = 903334 AND abstract_filter='r'" |& tee -a sPccd4_2020-01-27.log
       
      

       

        Attachments

          Activity

          Hide
          salnikov Andy Salnikov added a comment -

          Gabor Kovacs, would you be able to review my changes? It is sort of trivial and I have unit tests for those new cases. I did not try your examples, you can also try to run those.

          Show
          salnikov Andy Salnikov added a comment - Gabor Kovacs , would you be able to review my changes? It is sort of trivial and I have unit tests for those new cases. I did not try your examples, you can also try to run those.
          Hide
          salnikov Andy Salnikov added a comment -

          Pull request does not show up in Jira for some reason, here it is: https://github.com/lsst/ctrl_mpexec/pull/42

          Show
          salnikov Andy Salnikov added a comment - Pull request does not show up in Jira for some reason, here it is: https://github.com/lsst/ctrl_mpexec/pull/42
          Hide
          gkovacs Gabor Kovacs added a comment - - edited

          Changes look good. The example command above also runs fine now (log attached), thanks.

           

          Show
          gkovacs Gabor Kovacs added a comment - - edited Changes look good. The example command above also runs fine now (log attached), thanks.  
          Hide
          salnikov Andy Salnikov added a comment -

          Thanks for review! Merged and done.

          Show
          salnikov Andy Salnikov added a comment - Thanks for review! Merged and done.

            People

            • Assignee:
              salnikov Andy Salnikov
              Reporter:
              gkovacs Gabor Kovacs
              Reviewers:
              Gabor Kovacs
              Watchers:
              Andy Salnikov, Gabor Kovacs
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel