Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-24244

w_2020_13 makeButlerRepo.py missing left parens error with Oracle

    Details

    • Templates:
    • Story Points:
      1
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Doing weekly run of ci_hsc_gen3 using weekly stack and Oracle for w_2020_13.   makeButlerRepo.py dies with:  

      python /usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/daf_butler/19.0.0-41-g64a679d4/bin/makeButlerRepo.py /work/mgower/gen3work/weeklyCItest/git/ci_hsc_gen3/DATA
      Traceback (most recent call last):
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/engine/base.py", line 1249, in _execute_context
          cursor, statement, parameters, context
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/engine/default.py", line 552, in do_execute
          cursor.execute(statement, parameters)
      cx_Oracle.DatabaseError: ORA-00906: missing left parenthesisThe above exception was the direct cause of the following exception:Traceback (most recent call last):
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/daf_butler/19.0.0-41-g64a679d4/bin/makeButlerRepo.py", line 28, in <module>
          sys.exit(main())
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/daf_butler/19.0.0-41-g64a679d4/python/lsst/daf/butler/script/makeButlerRepo.py", line 91, in main
          makeButlerRepo(args.root, args.config, args.standalone, args.override, args.outfile)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/daf_butler/19.0.0-41-g64a679d4/python/lsst/daf/butler/script/makeButlerRepo.py", line 82, in makeButlerRepo
          outfile=outfile)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/daf_butler/19.0.0-41-g64a679d4/python/lsst/daf/butler/_butler.py", line 381, in makeRepo
          Registry.fromConfig(config, create=createRegistry, butlerRoot=root)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/daf_butler/19.0.0-41-g64a679d4/python/lsst/daf/butler/registry/_registry.py", line 178, in fromConfig
          create=create)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/daf_butler/19.0.0-41-g64a679d4/python/lsst/daf/butler/registry/_registry.py", line 191, in __init__
          self._opaque = opaque.initialize(self._db, context)
        File "/work/mgower/miniconda/envs/bps-lsst-scipipe-984c9f7/lib/python3.7/contextlib.py", line 119, in __exit__
          next(self.gen)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/daf_butler/19.0.0-41-g64a679d4/python/lsst/daf/butler/registry/interfaces/_database.py", line 384, in declareStaticTables
          self._metadata.create_all(self._connection)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/sql/schema.py", line 4294, in create_all
          ddl.SchemaGenerator, self, checkfirst=checkfirst, tables=tables
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/engine/base.py", line 1615, in _run_visitor
          visitorcallable(self.dialect, self, **kwargs).traverse_single(element)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/sql/visitors.py", line 132, in traverse_single
          return meth(obj, **kw)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/sql/ddl.py", line 781, in visit_metadata
          _is_metadata_operation=True,
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/sql/visitors.py", line 132, in traverse_single
          return meth(obj, **kw)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/sql/ddl.py", line 826, in visit_table
          include_foreign_key_constraints,
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/engine/base.py", line 988, in execute
          return meth(self, multiparams, params)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/sql/ddl.py", line 72, in _execute_on_connection
          return connection._execute_ddl(self, multiparams, params)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/engine/base.py", line 1050, in _execute_ddl
          compiled,
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/engine/base.py", line 1253, in _execute_context
          e, statement, parameters, cursor, context
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/engine/base.py", line 1473, in _handle_dbapi_exception
          util.raise_from_cause(sqlalchemy_exception, exc_info)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/util/compat.py", line 398, in raise_from_cause
          reraise(type(exception), exception, tb=exc_tb, cause=cause)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/util/compat.py", line 152, in reraise
          raise value.with_traceback(tb)
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/engine/base.py", line 1249, in _execute_context
          cursor, statement, parameters, context
        File "/usr/local/lsst_stack/w_2020_13/stack/miniconda3-4.7.12-984c9f7/Linux64/sqlalchemy/1.3.8/lib/python/SQLAlchemy-1.3.8-py3.7-linux-x86_64.egg/sqlalchemy/engine/default.py", line 552, in do_execute
          cursor.execute(statement, parameters)
      sqlalchemy.exc.DatabaseError: (cx_Oracle.DatabaseError) ORA-00906: missing left parenthesis
      [SQL: 
      CREATE TABLE quantum (
      	id NUMBER(19), 
      	task VARCHAR2(256 CHAR), 
      	start_time NUMBER(19), 
      	end_time NUMBER(19), 
      	host VARCHAR2(64 CHAR), 
      	run_name VARCHAR2 NOT NULL, 
      	PRIMARY KEY (id), 
      	CONSTRAINT fkey_quantum_run_name_run_name FOREIGN KEY(run_name) REFERENCES run (name) ON DELETE CASCADE
      )]
      (Background on this error at: http://sqlalche.me/e/4xp6)
      scons: *** [DATA/butler.yaml] Error 1
      scons: building terminated because of errors.
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jbosch Jim Bosch
                Reporter:
                mgower Michelle Gower
                Reviewers:
                Michelle Gower
                Watchers:
                Christopher Stephens, Jim Bosch, Michelle Gower
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel