Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-20288

ap_pipe --template argument broken

    Details

    • Type: Bug
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: ap_pipe
    • Labels:
      None

      Description

      Trying to run the following commands:

      ingest_dataset.py --dataset HiTS2015 --output repo_hits2015/ && \
      mkdir foo/ && \
      make_ppdb.py -C ${AP_VERIFY_HITS2015_DIR}/config/apPipe.py -c ppdb.isolation_level=READ_UNCOMMITTED -c ppdb.db_url="sqlite:///foo/association.db" && \
      ap_pipe.py repo_hits2015/ingested/ --calib repo_hits2015/calibingested/ --template ${AP_VERIFY_HITS2015_DIR}/templates/ --output foo -C ${AP_VERIFY_HITS2015_DIR}/config/apPipe.py -c ppdb.isolation_level=READ_UNCOMMITTED -c ppdb.db_url="sqlite:///foo/association.db" --id visit=411657 ccdnum=42..43 filter=g -j 2 --reuse-outputs-from all
      

      causes ap_pipe.py to crash with the following error:

      Traceback (most recent call last):
        File "lsstsw3/stack/Linux64/ap_pipe/17.0.1-5-g77a5af3/bin/ap_pipe.py", line 28, in <module>
          ApPipeTask.parseAndRun()
        File "lsstsw3/stack/Linux64/pipe_base/17.0.1-5-g3877d06/python/lsst/pipe/base/cmdLineTask.py", line 598, in parseAndRun
          parsedCmd = argumentParser.parse_args(config=config, args=args, log=log, override=cls.applyOverrides)
        File "lsstsw3/stack/Linux64/ap_pipe/17.0.1-5-g77a5af3/python/lsst/ap/pipe/apPipeParser.py", line 164, in parse_args
          self._makeButler(namespace)
        File "lsstsw3/stack/Linux64/ap_pipe/17.0.1-5-g77a5af3/python/lsst/ap/pipe/apPipeParser.py", line 232, in _makeButler
          namespace.butler = dafPersist.Butler(inputs=inputs, outputs=outputs)
        File "lsstsw3/stack/Linux64/daf_persistence/17.0.1-1-gfc6fb1f+10/python/lsst/daf/persistence/butler.py", line 525, in __init__
          self._setAndVerifyParentsLists(repoDataList)
        File "lsstsw3/stack/Linux64/daf_persistence/17.0.1-1-gfc6fb1f+10/python/lsst/daf/persistence/butler.py", line 890, in _setAndVerifyParentsLists
          repoData.cfg.addParents(parents)
        File "lsstsw3/stack/Linux64/daf_persistence/17.0.1-1-gfc6fb1f+10/python/lsst/daf/persistence/repositoryCfg.py", line 268, in addParents
          if newParent not in self._parents:
        File "lsstsw3/stack/Linux64/daf_persistence/17.0.1-1-gfc6fb1f+10/python/lsst/daf/persistence/repositoryCfg.py", line 97, in __eq__
          return self.root == other.root and \
      AttributeError: 'str' object has no attribute 'root'
      

      Identify the problem and make sure the command listed above works again.

      I don't think this is caused by there being two different dependency paths to the template repo (one from repo_hits2015 and one from the command line), as I originally encountered this bug with a repo that did not have the template repo as a parent.

        Attachments

          Activity

          Hide
          krzys Krzysztof Findeisen added a comment -

          The HSC demo at https://github.com/lsst-dm/ap_pipe-notebooks/pull/12 did not encounter this bug; it may be worth trying to reproduce the non-occurrence.

          Show
          krzys Krzysztof Findeisen added a comment - The HSC demo at https://github.com/lsst-dm/ap_pipe-notebooks/pull/12 did not encounter this bug; it may be worth trying to reproduce the non-occurrence.

            People

            • Assignee:
              Unassigned
              Reporter:
              krzys Krzysztof Findeisen
              Watchers:
              Krzysztof Findeisen, Meredith Rawls
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: