[DM-5605] runQueries.py fails on IN2P3 cluster - Jira

Details

Type: Bug
Status: Done
Resolution: Done
Fix Version/s: None
Component/s: Qserv
Labels:
None

Story Points:
4
Team:
Data Access and Database

Description

Launching runQueries.py produces some errors:

fjammes@ccosvms0070:~/src/qserv/admin/tools/docker/deployment/in2p3 (tickets/DM-5402 *=)$ ./run-test-queries.sh

+--------------------+--------------------+

| ra                 | decl               |

+--------------------+--------------------+

| 29.308806347275485 | -86.30884046118973 |

+--------------------+--------------------+

real    1m20.725s

user    0m0.004s

sys     0m0.012s

Output directory: /afs/in2p3.fr/home/f/fjammes/runQueries_out

Exception in thread Thread-12:

Traceback (most recent call last):

  File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner

    self.run()

  File "/usr/lib64/python2.7/threading.py", line 764, in run

    self.__target(*self.__args, **self.__kwargs)

  File "/afs/in2p3.fr/home/f/fjammes/src/qserv/admin/tools/docker/deployment/in2p3/runQueries.py", line 185, in runQueries

    db='LSST')

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/__init__.py", line 81, in Connect

    return Connection(*args, **kwargs)

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/connections.py", line 187, in __init__

    super(Connection, self).__init__(*args, **kwargs2)

OperationalError: (2013, "Lost connection to MySQL server at 'reading authorization packet', system error: 0")

Exception in thread Thread-23:

Traceback (most recent call last):

  File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner

    self.run()

  File "/usr/lib64/python2.7/threading.py", line 764, in run

    self.__target(*self.__args, **self.__kwargs)

  File "/afs/in2p3.fr/home/f/fjammes/src/qserv/admin/tools/docker/deployment/in2p3/runQueries.py", line 185, in runQueries

    db='LSST')

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/__init__.py", line 81, in Connect

    return Connection(*args, **kwargs)

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/connections.py", line 187, in __init__

    super(Connection, self).__init__(*args, **kwargs2)

OperationalError: (1105, '(proxy) all backends are down')

Exception in thread Thread-16:

Traceback (most recent call last):

  File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner

    self.run()

  File "/usr/lib64/python2.7/threading.py", line 764, in run

    self.__target(*self.__args, **self.__kwargs)

  File "/afs/in2p3.fr/home/f/fjammes/src/qserv/admin/tools/docker/deployment/in2p3/runQueries.py", line 185, in runQueries

    db='LSST')

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/__init__.py", line 81, in Connect

    return Connection(*args, **kwargs)

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/connections.py", line 187, in __init__

    super(Connection, self).__init__(*args, **kwargs2)

OperationalError: (2013, "Lost connection to MySQL server at 'reading authorization packet', system error: 0")

Exception in thread Thread-21:

Traceback (most recent call last):

  File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner

    self.run()

  File "/usr/lib64/python2.7/threading.py", line 764, in run

    self.__target(*self.__args, **self.__kwargs)

  File "/afs/in2p3.fr/home/f/fjammes/src/qserv/admin/tools/docker/deployment/in2p3/runQueries.py", line 185, in runQueries

    db='LSST')

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/__init__.py", line 81, in Connect

    return Connection(*args, **kwargs)

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/connections.py", line 187, in __init__

    super(Connection, self).__init__(*args, **kwargs2)

OperationalError: (1105, '(proxy) all backends are down')

Exception in thread Thread-17:

Traceback (most recent call last):

  File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner

    self.run()

  File "/usr/lib64/python2.7/threading.py", line 764, in run

    self.__target(*self.__args, **self.__kwargs)

  File "/afs/in2p3.fr/home/f/fjammes/src/qserv/admin/tools/docker/deployment/in2p3/runQueries.py", line 185, in runQueries

    db='LSST')

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/__init__.py", line 81, in Connect

    return Connection(*args, **kwargs)

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/connections.py", line 187, in __init__

    super(Connection, self).__init__(*args, **kwargs2)

OperationalError: (2013, "Lost connection to MySQL server at 'reading authorization packet', system error: 0")

Exception in thread Thread-19:

Traceback (most recent call last):

  File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner

    self.run()

  File "/usr/lib64/python2.7/threading.py", line 764, in run

    self.__target(*self.__args, **self.__kwargs)

  File "/afs/in2p3.fr/home/f/fjammes/src/qserv/admin/tools/docker/deployment/in2p3/runQueries.py", line 185, in runQueries

    db='LSST')

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/__init__.py", line 81, in Connect

    return Connection(*args, **kwargs)

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/connections.py", line 187, in __init__

    super(Connection, self).__init__(*args, **kwargs2)

OperationalError: (2013, "Lost connection to MySQL server at 'reading authorization packet', system error: 0")

Exception in thread Thread-18:

Traceback (most recent call last):

  File "/usr/lib64/python2.7/threading.py", line 811, in __bootstrap_inner

    self.run()

  File "/usr/lib64/python2.7/threading.py", line 764, in run

    self.__target(*self.__args, **self.__kwargs)

  File "/afs/in2p3.fr/home/f/fjammes/src/qserv/admin/tools/docker/deployment/in2p3/runQueries.py", line 185, in runQueries

    db='LSST')

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/__init__.py", line 81, in Connect

    return Connection(*args, **kwargs)

  File "/qserv/stack/Linux64/mysqlpython/1.2.3.lsst1/lib/python/MySQL_python-1.2.3-py2.7-linux-x86_64.egg/MySQLdb/connections.py", line 187, in __init__

    super(Connection, self).__init__(*args, **kwargs2)

OperationalError: (2013, "Lost connection to MySQL server at 'reading authorization packet', system error: 0")

Attachments

Issue Links

relates to

DM-5307 Get high volume test script working again at IN2P3 cluster

Done

mentioned in: Page Loading...

Activity

Ascending order - Click to sort in descending order

Fabrice Jammes created issue - 24/Mar/16 7:45 AM

Tim Jenness made changes - 02/Oct/19 3:44 PM

Field	Original Value	New Value
Remote Link		This issue links to "Page (Confluence)" [ 22080 ]

Fritz Mueller made changes - 03/Oct/19 1:20 AM

Status

To Do [ 10001 ]

In Progress [ 3 ]

Fritz Mueller made changes - 03/Oct/19 1:20 AM

Resolution		Done [ 10000 ]
Status	In Progress [ 3 ]	Done [ 10002 ]

Tim Jenness made changes - 03/Oct/19 3:20 AM

Link

This issue relates to ~~DM-5307~~ [ ~~DM-5307~~ ]

Data Management

runQueries.py fails on IN2P3 cluster

Details

Description

Attachments

Issue Links

Activity

People

Dates