/var/log/kolla/neutron/neutron-dhcp-agent.log
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent [None req-75e840bd-0055-49cd-8fe9-bf1d45d684c2 - - - - - -] Failed reporting state!: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 50f250ffd2cf411693db81dc4872878e
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent Traceback (most recent call last):
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/agent/dhcp/agent.py", line 1098, in _report_state
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent     agent_status = self.state_rpc.report_state(
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/agent/rpc.py", line 105, in report_state
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent     return method(context, 'report_state', **kwargs)
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent     result = self.transport._send(
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent     return self._driver.send(target, ctxt, message,
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 789, in _send
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent     result = self._waiter.wait(msg_id, timeout,
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 654, in wait
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent     message = self.waiters.get(msg_id, timeout=timeout)
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 520, in get
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent     raise oslo_messaging.MessagingTimeout(
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 50f250ffd2cf411693db81dc4872878e
2025-05-27 10:51:30.086 280582 ERROR neutron.agent.dhcp.agent 
2025-05-27 10:52:10.259 280582 ERROR oslo.messaging._drivers.impl_rabbit [None req-1b2cfe72-d9fd-4169-a088-e487ae2c224c - - - - - -] [a16cdda7-d0a1-4f1f-a35f-409a1cff5ba5] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 1 seconds.: TimeoutError: timed out
2025-05-27 10:52:20.169 280582 ERROR oslo.messaging._drivers.impl_rabbit [None req-1b2cfe72-d9fd-4169-a088-e487ae2c224c - - - - - -] [a16cdda7-d0a1-4f1f-a35f-409a1cff5ba5] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 2 seconds.: TimeoutError: timed out
2025-05-27 10:52:29.585 280582 ERROR oslo.messaging._drivers.impl_rabbit [None req-1b2cfe72-d9fd-4169-a088-e487ae2c224c - - - - - -] [a16cdda7-d0a1-4f1f-a35f-409a1cff5ba5] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 4 seconds.: TimeoutError: timed out
2025-05-27 10:52:41.497 280582 ERROR oslo.messaging._drivers.impl_rabbit [None req-1b2cfe72-d9fd-4169-a088-e487ae2c224c - - - - - -] [a16cdda7-d0a1-4f1f-a35f-409a1cff5ba5] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 6 seconds.: TimeoutError: timed out
2025-05-27 10:52:57.858 280582 ERROR oslo.messaging._drivers.impl_rabbit [None req-1b2cfe72-d9fd-4169-a088-e487ae2c224c - - - - - -] [a16cdda7-d0a1-4f1f-a35f-409a1cff5ba5] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 8 seconds.: TimeoutError: timed out
2025-05-27 10:53:30.608 280582 ERROR oslo.messaging._drivers.impl_rabbit [None req-1b2cfe72-d9fd-4169-a088-e487ae2c224c - - - - - -] [a16cdda7-d0a1-4f1f-a35f-409a1cff5ba5] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 10 seconds.: TimeoutError: timed out
2025-05-27 10:58:51.368 280582 ERROR oslo.messaging._drivers.impl_rabbit [None req-1b2cfe72-d9fd-4169-a088-e487ae2c224c - - - - - -] [6934f11d-c2d0-46a0-a405-0cb7baa5b535] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:26.126 280582 ERROR oslo.messaging._drivers.impl_rabbit [None req-1b2cfe72-d9fd-4169-a088-e487ae2c224c - - - - - -] [a16cdda7-d0a1-4f1f-a35f-409a1cff5ba5] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 12 seconds.: TimeoutError: timed out
2025-05-27 11:00:26.135 280582 ERROR oslo.messaging._drivers.impl_rabbit [None req-1b2cfe72-d9fd-4169-a088-e487ae2c224c - - - - - -] [c0247926-cae2-4de7-ae2b-533f5e033785] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>

/var/log/kolla/neutron/neutron-server.log
2025-05-27 10:53:35.001 1051 ERROR oslo.messaging._drivers.impl_rabbit [None req-75e840bd-0055-49cd-8fe9-bf1d45d684c2 - - - - - -] [f196f00d-fadf-4e37-a5f1-24aea037263e] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool [None req-b2a07747-ebbe-4925-872c-4948d5762277 - - - - - -] Exception during reset or similar: pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last):
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1964, in _exec_single_context
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     self.dialect.do_execute(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 942, in do_execute
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     cursor.execute(statement, parameters)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     result = self._query(query)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     conn.query(q)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     result.read()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     first_packet = self.connection._read_packet()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 775, in _read_packet
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     packet.raise_for_error()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/protocol.py", line 219, in raise_for_error
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     err.raise_mysql_exception(self._data)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/err.py", line 150, in raise_mysql_exception
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     raise errorclass(errno, errval)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool pymysql.err.OperationalError: (9001, 'Max connect timeout reached while reaching hostgroup 0 after 21243ms')
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool 
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool The above exception was the direct cause of the following exception:
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool 
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last):
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 847, in _session
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     yield self.session
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1206, in _transaction_scope
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     yield resource
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/agents_db.py", line 386, in create_or_update_agent
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     agent = self._get_agent_by_type_and_host(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/agents_db.py", line 321, in _get_agent_by_type_and_host
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     agent_objs = agent_obj.Agent.get_objects(context,
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/base.py", line 671, in get_objects
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     db_objs = obj_db_api.get_objects(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool               ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/db/api.py", line 57, in get_objects
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     return model_query.get_collection(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in get_collection
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     items = [
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool             ^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in <listcomp>
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     items = [
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool             ^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2839, in __iter__
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     result = self._iter()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool              ^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     return self._execute_internal(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2251, in _execute_internal
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     result: Result[Any] = compile_state_cls.orm_execute_statement(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/context.py", line 305, in orm_execute_statement
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     result = conn.execute(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool              ^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1416, in execute
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     return meth(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool            ^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     return connection._execute_clauseelement(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1638, in _execute_clauseelement
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     ret = self._execute_context(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool           ^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1843, in _execute_context
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     return self._exec_single_context(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1983, in _exec_single_context
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     self._handle_dbapi_exception(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2349, in _handle_dbapi_exception
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1964, in _exec_single_context
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     self.dialect.do_execute(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 942, in do_execute
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     cursor.execute(statement, parameters)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     result = self._query(query)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     conn.query(q)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     result.read()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     first_packet = self.connection._read_packet()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 775, in _read_packet
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     packet.raise_for_error()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/protocol.py", line 219, in raise_for_error
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     err.raise_mysql_exception(self._data)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/err.py", line 150, in raise_mysql_exception
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     raise errorclass(errno, errval)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (9001, 'Max connect timeout reached while reaching hostgroup 0 after 21243ms')
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool [SQL: SELECT agents.agent_type AS agents_agent_type, agents.`binary` AS agents_binary, agents.topic AS agents_topic, agents.host AS agents_host, agents.availability_zone AS agents_availability_zone, agents.admin_state_up AS agents_admin_state_up, agents.created_at AS agents_created_at, agents.started_at AS agents_started_at, agents.heartbeat_timestamp AS agents_heartbeat_timestamp, agents.description AS agents_description, agents.configurations AS agents_configurations, agents.resource_versions AS agents_resource_versions, agents.`load` AS agents_load, agents.resources_synced AS agents_resources_synced, agents.id AS agents_id 
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool FROM agents 
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool WHERE agents.agent_type IN (%(agent_type_1_1)s) AND agents.host IN (%(host_1_1)s)]
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool [parameters: {'agent_type_1_1': 'Open vSwitch agent', 'host_1_1': 'primary'}]
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool 
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool During handling of the above exception, another exception occurred:
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool 
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last):
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 986, in _finalize_fairy
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     fairy._reset(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1432, in _reset
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     pool._dialect.do_rollback(self)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 700, in do_rollback
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     dbapi_connection.rollback()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 493, in rollback
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     self._read_ok_packet()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 453, in _read_ok_packet
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     pkt = self._read_packet()
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool           ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 744, in _read_packet
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     packet_header = self._read_bytes(4)
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool                     ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 798, in _read_bytes
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool     raise err.OperationalError(
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:34.933 1050 ERROR sqlalchemy.pool.impl.QueuePool 
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db [None req-97db8be4-cd34-44d7-a058-367281fa8311 - - - - - -] Exception encountered during network rescheduling: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db Traceback (most recent call last):
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     return self.pool.connect()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     return _ConnectionFairy._checkout(self)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     dbapi_connection = rec.get_connection()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 866, in get_connection
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     self.__connect()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 914, in __connect
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     )._exec_w_sync_on_first_run(self.dbapi_connection, self)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/event/attr.py", line 489, in _exec_w_sync_on_first_run
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     self(*args, **kw)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/event/attr.py", line 497, in __call__
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     fn(*args, **kw)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/sqlalchemy/engines.py", line 378, in _set_session_variables
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     cursor.execute("SET SESSION sql_mode = %s", [mysql_sql_mode])
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     result = self._query(query)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     conn.query(q)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     result.read()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     first_packet = self.connection._read_packet()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 744, in _read_packet
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     packet_header = self._read_bytes(4)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                     ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 798, in _read_bytes
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     raise err.OperationalError(
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db The above exception was the direct cause of the following exception:
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db Traceback (most recent call last):
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/agentschedulers_db.py", line 306, in remove_networks_from_down_agents
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     down_bindings = network.NetworkDhcpAgentBinding.get_down_bindings(
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/network.py", line 78, in get_down_bindings
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     agent_objs = agent_obj.Agent.get_objects(context)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/base.py", line 671, in get_objects
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     db_objs = obj_db_api.get_objects(
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db               ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/db/api.py", line 57, in get_objects
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     return model_query.get_collection(
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in get_collection
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     items = [
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db             ^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in <listcomp>
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     items = [
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db             ^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2839, in __iter__
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     result = self._iter()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db              ^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     return self._execute_internal(
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     conn = self._connection_for_bind(bind)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "<string>", line 2, in _connection_for_bind
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     conn = bind.connect()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     return self._connection_cls(self)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     return self.pool.connect()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     return _ConnectionFairy._checkout(self)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     dbapi_connection = rec.get_connection()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 866, in get_connection
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     self.__connect()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 914, in __connect
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     )._exec_w_sync_on_first_run(self.dbapi_connection, self)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/event/attr.py", line 489, in _exec_w_sync_on_first_run
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     self(*args, **kw)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/event/attr.py", line 497, in __call__
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     fn(*args, **kw)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/sqlalchemy/engines.py", line 378, in _set_session_variables
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     cursor.execute("SET SESSION sql_mode = %s", [mysql_sql_mode])
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     result = self._query(query)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     conn.query(q)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     result.read()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     first_packet = self.connection._read_packet()
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 744, in _read_packet
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     packet_header = self._read_bytes(4)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db                     ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 798, in _read_bytes
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db     raise err.OperationalError(
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:53:34.953 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server [None req-b2a07747-ebbe-4925-872c-4948d5762277 - - - - - -] Exception during message handling: sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (9001, 'Max connect timeout reached while reaching hostgroup 0 after 21243ms')
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1964, in _exec_single_context
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self.dialect.do_execute(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 942, in do_execute
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     cursor.execute(statement, parameters)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     result = self._query(query)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     conn.query(q)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     result.read()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     first_packet = self.connection._read_packet()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 775, in _read_packet
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     packet.raise_for_error()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/protocol.py", line 219, in raise_for_error
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     err.raise_mysql_exception(self._data)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/err.py", line 150, in raise_mysql_exception
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     raise errorclass(errno, errval)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server pymysql.err.OperationalError: (9001, 'Max connect timeout reached while reaching hostgroup 0 after 21243ms')
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server 
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server The above exception was the direct cause of the following exception:
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server 
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 223, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return f_with_retry(*args, **kwargs,
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 137, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self.force_reraise()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     raise self.value
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 135, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self.force_reraise()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     raise self.value
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 183, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self.force_reraise()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     raise self.value
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 181, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return f(*dup_args, **dup_kwargs)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/agents_db.py", line 526, in report_state
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     agent_status, agent_state = self.plugin.create_or_update_agent(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 223, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return f_with_retry(*args, **kwargs,
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 137, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self.force_reraise()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     raise self.value
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 135, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self.force_reraise()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     raise self.value
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 183, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self.force_reraise()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     raise self.value
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/api.py", line 181, in wrapped
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return f(*dup_args, **dup_kwargs)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/agents_db.py", line 386, in create_or_update_agent
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     agent = self._get_agent_by_type_and_host(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/agents_db.py", line 321, in _get_agent_by_type_and_host
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     agent_objs = agent_obj.Agent.get_objects(context,
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/base.py", line 671, in get_objects
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     db_objs = obj_db_api.get_objects(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/db/api.py", line 57, in get_objects
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return model_query.get_collection(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in get_collection
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     items = [
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server             ^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in <listcomp>
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     items = [
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server             ^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2839, in __iter__
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     result = self._iter()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return self._execute_internal(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2251, in _execute_internal
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     result: Result[Any] = compile_state_cls.orm_execute_statement(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/context.py", line 305, in orm_execute_statement
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     result = conn.execute(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1416, in execute
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return meth(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return connection._execute_clauseelement(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1638, in _execute_clauseelement
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     ret = self._execute_context(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1843, in _execute_context
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     return self._exec_single_context(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1983, in _exec_single_context
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self._handle_dbapi_exception(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2349, in _handle_dbapi_exception
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1964, in _exec_single_context
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self.dialect.do_execute(
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 942, in do_execute
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     cursor.execute(statement, parameters)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     result = self._query(query)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     conn.query(q)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     result.read()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     first_packet = self.connection._read_packet()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 775, in _read_packet
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     packet.raise_for_error()
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/protocol.py", line 219, in raise_for_error
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     err.raise_mysql_exception(self._data)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/err.py", line 150, in raise_mysql_exception
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server     raise errorclass(errno, errval)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (9001, 'Max connect timeout reached while reaching hostgroup 0 after 21243ms')
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server [SQL: SELECT agents.agent_type AS agents_agent_type, agents.`binary` AS agents_binary, agents.topic AS agents_topic, agents.host AS agents_host, agents.availability_zone AS agents_availability_zone, agents.admin_state_up AS agents_admin_state_up, agents.created_at AS agents_created_at, agents.started_at AS agents_started_at, agents.heartbeat_timestamp AS agents_heartbeat_timestamp, agents.description AS agents_description, agents.configurations AS agents_configurations, agents.resource_versions AS agents_resource_versions, agents.`load` AS agents_load, agents.resources_synced AS agents_resources_synced, agents.id AS agents_id 
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server FROM agents 
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server WHERE agents.agent_type IN (%(agent_type_1_1)s) AND agents.host IN (%(host_1_1)s)]
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server [parameters: {'agent_type_1_1': 'Open vSwitch agent', 'host_1_1': 'primary'}]
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:53:35.145 1050 ERROR oslo_messaging.rpc.server 
2025-05-27 10:53:35.199 1050 ERROR oslo.messaging._drivers.impl_rabbit [None req-b2a07747-ebbe-4925-872c-4948d5762277 - - - - - -] [4f4e97f3-13fb-43a0-bf76-4d6a35759f0e] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 10:58:43.944 1051 ERROR oslo.messaging._drivers.impl_rabbit [None req-75e840bd-0055-49cd-8fe9-bf1d45d684c2 - - - - - -] [f196f00d-fadf-4e37-a5f1-24aea037263e] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 10:58:50.785 1050 ERROR oslo.messaging._drivers.impl_rabbit [None req-b2a07747-ebbe-4925-872c-4948d5762277 - - - - - -] [4f4e97f3-13fb-43a0-bf76-4d6a35759f0e] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.807 1051 ERROR oslo.messaging._drivers.impl_rabbit [None req-75e840bd-0055-49cd-8fe9-bf1d45d684c2 - - - - - -] [f196f00d-fadf-4e37-a5f1-24aea037263e] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db [None req-97db8be4-cd34-44d7-a058-367281fa8311 - - - - - -] Exception encountered during network rescheduling: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db Traceback (most recent call last):
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     sock = socket.create_connection(
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     raise err
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     sock.connect(sa)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     socket_checkerr(fd)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     raise OSError(err, errno.errorcode[err])
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db During handling of the above exception, another exception occurred:
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db Traceback (most recent call last):
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return self.pool.connect()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 712, in checkout
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     rec = pool._do_get()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db           ^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 179, in _do_get
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return self._create_connection()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 390, in _create_connection
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return _ConnectionRecord(self)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 674, in __init__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     self.__connect()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     self.connect()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     raise exc
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db The above exception was the direct cause of the following exception:
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db Traceback (most recent call last):
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/agentschedulers_db.py", line 306, in remove_networks_from_down_agents
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     down_bindings = network.NetworkDhcpAgentBinding.get_down_bindings(
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/network.py", line 78, in get_down_bindings
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     agent_objs = agent_obj.Agent.get_objects(context)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/base.py", line 671, in get_objects
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     db_objs = obj_db_api.get_objects(
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db               ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/db/api.py", line 57, in get_objects
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return model_query.get_collection(
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in get_collection
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     items = [
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db             ^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in <listcomp>
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     items = [
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db             ^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2839, in __iter__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     result = self._iter()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db              ^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return self._execute_internal(
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     conn = self._connection_for_bind(bind)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "<string>", line 2, in _connection_for_bind
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     ret_value = fn(self, *arg, **kw)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     conn = bind.connect()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return self._connection_cls(self)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return self.pool.connect()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 712, in checkout
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     rec = pool._do_get()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db           ^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 179, in _do_get
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return self._create_connection()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 390, in _create_connection
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return _ConnectionRecord(self)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 674, in __init__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     self.__connect()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     self.connect()
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db     raise exc
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:25.879 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall [None req-97db8be4-cd34-44d7-a058-367281fa8311 - - - - - -] Fixed interval looping call 'neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._clean_garbage' failed: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall Traceback (most recent call last):
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     sock = socket.create_connection(
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     raise err
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     sock.connect(sa)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     socket_checkerr(fd)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     raise OSError(err, errno.errorcode[err])
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall 
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall During handling of the above exception, another exception occurred:
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall 
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall Traceback (most recent call last):
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return self.pool.connect()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     with util.safe_reraise():
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     dbapi_connection = rec.get_connection()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     self.__connect()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     with util.safe_reraise():
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     self.connect()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     raise exc
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall 
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall The above exception was the direct cause of the following exception:
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall 
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall Traceback (most recent call last):
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_service/backend/eventlet/loopingcall.py", line 151, in _run_loop
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     result = func(*self.args, **self.kw)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall              ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/l3_db.py", line 178, in _clean_garbage
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     candidates = self._get_dead_floating_port_candidates(context)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1183, in wrapper
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return fn(*args, **kwargs)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/l3_db.py", line 217, in _get_dead_floating_port_candidates
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return {p['id'] for p in query.all()}
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                              ^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2699, in all
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return self._iter().all()  # type: ignore
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return self._execute_internal(
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     conn = self._connection_for_bind(bind)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return trans._connection_for_bind(engine, execution_options)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "<string>", line 2, in _connection_for_bind
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     ret_value = fn(self, *arg, **kw)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     conn = bind.connect()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return self._connection_cls(self)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     Connection._handle_dbapi_exception_noconnection(
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return self.pool.connect()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     with util.safe_reraise():
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     dbapi_connection = rec.get_connection()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     self.__connect()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     with util.safe_reraise():
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     self.connect()
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall     raise exc
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:26.051 1052 ERROR oslo.service.backend.eventlet.loopingcall 
2025-05-27 11:00:26.112 1052 ERROR oslo.messaging._drivers.impl_rabbit [None req-97db8be4-cd34-44d7-a058-367281fa8311 - - - - - -] [9e0bff57-ae14-43ac-9176-609bcffb2f70] AMQP server on 192.0.2.1:5671 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db [None req-97db8be4-cd34-44d7-a058-367281fa8311 - - - - - -] Exception encountered during network rescheduling: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db Traceback (most recent call last):
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     sock = socket.create_connection(
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     raise err
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     sock.connect(sa)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     socket_checkerr(fd)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     raise OSError(err, errno.errorcode[err])
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db During handling of the above exception, another exception occurred:
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db Traceback (most recent call last):
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return self.pool.connect()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     self.__connect()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     self.connect()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     raise exc
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db The above exception was the direct cause of the following exception:
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db 
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db Traceback (most recent call last):
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/db/agentschedulers_db.py", line 306, in remove_networks_from_down_agents
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     down_bindings = network.NetworkDhcpAgentBinding.get_down_bindings(
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/network.py", line 78, in get_down_bindings
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     agent_objs = agent_obj.Agent.get_objects(context)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/base.py", line 671, in get_objects
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     db_objs = obj_db_api.get_objects(
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db               ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/objects/db/api.py", line 57, in get_objects
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return model_query.get_collection(
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in get_collection
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     items = [
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db             ^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron_lib/db/model_query.py", line 373, in <listcomp>
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     items = [
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db             ^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2839, in __iter__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     result = self._iter()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db              ^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return self._execute_internal(
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     conn = self._connection_for_bind(bind)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "<string>", line 2, in _connection_for_bind
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     ret_value = fn(self, *arg, **kw)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     conn = bind.connect()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return self._connection_cls(self)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return self.pool.connect()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     self.__connect()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     with util.safe_reraise():
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     self.connect()
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db     raise exc
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:26.114 1052 ERROR neutron.db.agentschedulers_db 

/var/log/kolla/neutron/neutron-l3-agent.log
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] Failed reporting state!: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 6db13e1bbc3f4398be87b4c2f8bbf477
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent Traceback (most recent call last):
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/agent/l3/agent.py", line 1005, in _report_state
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent     agent_status = self.state_rpc.report_state(self.context,
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/agent/rpc.py", line 105, in report_state
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent     return method(context, 'report_state', **kwargs)
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent     result = self.transport._send(
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent     return self._driver.send(target, ctxt, message,
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 789, in _send
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent     result = self._waiter.wait(msg_id, timeout,
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 654, in wait
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent     message = self.waiters.get(msg_id, timeout=timeout)
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 520, in get
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent     raise oslo_messaging.MessagingTimeout(
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 6db13e1bbc3f4398be87b4c2f8bbf477
2025-05-27 10:51:30.163 283450 ERROR neutron.agent.l3.agent 
2025-05-27 10:52:09.095 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [17ade267-3a64-466b-8334-8b8a8e910ac4] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 1 seconds.: TimeoutError: timed out
2025-05-27 10:52:16.670 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [17ade267-3a64-466b-8334-8b8a8e910ac4] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 2 seconds.: TimeoutError: timed out
2025-05-27 10:52:25.026 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [17ade267-3a64-466b-8334-8b8a8e910ac4] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 4 seconds.: TimeoutError: timed out
2025-05-27 10:52:43.291 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [17ade267-3a64-466b-8334-8b8a8e910ac4] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 6 seconds.: TimeoutError: timed out
2025-05-27 10:52:59.629 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [17ade267-3a64-466b-8334-8b8a8e910ac4] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 8 seconds.: TimeoutError: timed out
2025-05-27 10:53:31.071 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [17ade267-3a64-466b-8334-8b8a8e910ac4] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 10 seconds.: TimeoutError: timed out
2025-05-27 10:59:38.482 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [17ade267-3a64-466b-8334-8b8a8e910ac4] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 12 seconds.: TimeoutError: timed out
2025-05-27 11:00:25.831 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [807bfd28-6883-4f02-b578-a6e1a14cac60] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.834 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [7a861f0d-0240-4928-b456-2c29f36c7d05] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.835 283450 ERROR oslo.messaging._drivers.impl_rabbit [None req-52226210-1c76-4461-9d8e-9c1d2b6f1ccf - - - - - -] [dad96d5a-aeb1-4d2b-9b8f-df0d347afc27] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>

/var/log/kolla/neutron/neutron-openvswitch-agent.log
2025-05-27 10:21:02.742 7 ERROR neutron.agent.common.async_process [-] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: None
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Failed reporting state!: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 4af5a10c0d714502a9d56af1de7eeaf8
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last):
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 444, in _report_state
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent     agent_status = self.state_rpc.report_state(self.context,
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/agent/rpc.py", line 105, in report_state
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent     return method(context, 'report_state', **kwargs)
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent     result = self.transport._send(
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent     return self._driver.send(target, ctxt, message,
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 789, in _send
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent     result = self._waiter.wait(msg_id, timeout,
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 654, in wait
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent     message = self.waiters.get(msg_id, timeout=timeout)
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 520, in get
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent     raise oslo_messaging.MessagingTimeout(
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 4af5a10c0d714502a9d56af1de7eeaf8
2025-05-27 10:51:16.657 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent 
2025-05-27 10:52:17.461 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [64b096fe-80d4-4c99-817c-cca9eb59b017] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 1 seconds.: TimeoutError: timed out
2025-05-27 10:52:27.736 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [64b096fe-80d4-4c99-817c-cca9eb59b017] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 2 seconds.: TimeoutError: timed out
2025-05-27 10:53:00.954 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [64b096fe-80d4-4c99-817c-cca9eb59b017] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 4 seconds.: TimeoutError: timed out
2025-05-27 10:53:27.403 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] failed to send message <version=0x4,msg_type=0x12,msg_len=0x38,xid=0x4be5d3ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1)>
2025-05-27 10:53:34.956 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x4be5d3ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) error Datapath Invalid 239877214317898: os_ken.app.ofctl.exception.InvalidDatapath: Datapath Invalid 239877214317898
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Failed to communicate with the switch: RuntimeError: ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x4be5d3ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) error Datapath Invalid 239877214317898
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int Traceback (most recent call last):
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py", line 99, in _send_msg
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     result = self._send_msg_retry(self._app, msg, reply_cls,
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/tenacity/__init__.py", line 336, in wrapped_f
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     return copy(f, *args, **kw)
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int            ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/tenacity/__init__.py", line 475, in __call__
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     do = self.iter(retry_state=retry_state)
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/tenacity/__init__.py", line 376, in iter
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     result = action(retry_state)
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int              ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/tenacity/__init__.py", line 418, in exc_check
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     raise retry_exc.reraise()
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int           ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/tenacity/__init__.py", line 185, in reraise
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     raise self.last_attempt.result()
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int           ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/usr/lib/python3.11/concurrent/futures/_base.py", line 449, in result
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     return self.__get_result()
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     raise self._exception
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/tenacity/__init__.py", line 478, in __call__
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     result = fn(*args, **kwargs)
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int              ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py", line 88, in _send_msg_retry
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     return ofctl_api.send_msg(app, msg, reply_cls, reply_multi)
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/os_ken/app/ofctl/api.py", line 87, in send_msg
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     return app.send_request(event.SendMsgRequest(msg=msg,
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/os_ken/app/ofctl/event.py", line 61, in __call__
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     raise self.exception
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int os_ken.app.ofctl.exception.InvalidDatapath: Datapath Invalid 239877214317898
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int 
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int During handling of the above exception, another exception occurred:
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int 
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int Traceback (most recent call last):
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/br_int.py", line 175, in check_canary_table
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     flows = self.dump_flows(constants.CANARY_TABLE)
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py", line 169, in dump_flows
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     replies = self._send_msg(msg,
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int               ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int   File "/var/lib/kolla/venv/lib/python3.11/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py", line 108, in _send_msg
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int     raise RuntimeError(m)
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int RuntimeError: ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0x4be5d3ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) error Datapath Invalid 239877214317898
2025-05-27 10:53:34.966 7 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.br_int 
2025-05-27 10:53:35.147 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:08Z|00001|timeval|WARN|Unreasonably long 1240ms poll interval (0ms user, 140ms system)
2025-05-27 10:53:35.185 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:08Z|00002|timeval|WARN|faults: 9 minor, 93 major
2025-05-27 10:53:35.207 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:08Z|00003|timeval|WARN|disk: 20232 reads, 0 writes
2025-05-27 10:53:35.218 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:08Z|00004|timeval|WARN|context switches: 119 voluntary, 163 involuntary
2025-05-27 10:53:35.233 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:10Z|00005|coverage|INFO|Event coverage, avg rate over last: 5 seconds, last minute, last hour,  hash=cef4ac9d:
2025-05-27 10:53:35.256 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:10Z|00006|coverage|INFO|hmap_expand                0.4/sec     0.183/sec        0.2053/sec   total: 739
2025-05-27 10:53:35.269 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:12Z|00007|coverage|INFO|poll_create_node           0.4/sec     0.183/sec        0.0328/sec   total: 118
2025-05-27 10:53:35.282 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:12Z|00008|coverage|INFO|seq_change                 0.0/sec     0.000/sec        0.0008/sec   total: 3
2025-05-27 10:53:35.294 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:12Z|00009|coverage|INFO|stream_open                0.0/sec     0.000/sec        0.0003/sec   total: 1
2025-05-27 10:53:35.304 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:12Z|00010|coverage|INFO|util_xalloc                2.8/sec     3.483/sec        2.8800/sec   total: 10368
2025-05-27 10:53:35.310 7 ERROR neutron.agent.common.async_process [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] Error received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: 2025-05-27T10:53:12Z|00011|coverage|INFO|107 events never hit
2025-05-27 10:58:49.584 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [64b096fe-80d4-4c99-817c-cca9eb59b017] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 6 seconds.: TimeoutError: timed out
2025-05-27 11:00:25.872 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [ced62553-4b25-42f9-8b21-e5df168ac4a7] AMQP server on 192.0.2.1:5671 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed
2025-05-27 11:00:25.880 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [04aa2763-d378-4696-bde9-5f68beec37e9] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.883 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [559337e9-8be2-4593-ba90-6015148b4742] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.885 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [894b68ce-2072-42bc-a8bd-7621f5429dc2] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.886 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [7be87aa6-e69f-420e-935a-39a80df41063] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.888 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [6668fea9-9cfb-4855-b58d-9be0ae1e855b] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.889 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [3f45de1d-8c03-4cc2-ab85-6ab1350eff13] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.890 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [c499e36e-acfc-4d95-a51f-19e5fc7bf447] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.891 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] unknown dpid 239877214317898
2025-05-27 11:00:25.923 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [c8cd37b4-95b0-4fb5-a801-6a3e678ed62e] AMQP server on 192.0.2.1:5671 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed
2025-05-27 11:00:25.924 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] [dc29852d-8739-42fc-bf40-7b52eeec008c] AMQP server on 192.0.2.1:5671 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed
2025-05-27 11:00:25.949 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] unknown dpid 239877214317898
2025-05-27 11:00:25.990 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] unknown dpid 239877214317898
2025-05-27 11:00:26.078 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] unknown dpid 239877214317898
2025-05-27 11:00:26.240 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] unknown dpid 239877214317898
2025-05-27 11:00:26.561 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] unknown dpid 239877214317898
2025-05-27 11:00:27.597 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] unknown dpid 239877214317898
2025-05-27 11:00:28.605 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] unknown dpid 239877214317898
2025-05-27 11:00:29.607 7 ERROR OfctlService [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] failed to send message <version=0x4,msg_type=0x12,msg_len=0x38,xid=0xe490aeac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1)>
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager [None req-06993229-a21c-422e-9a3f-7cf8ea2e1d4a - - - - - -] ofctl_service: Exception occurred during handler processing. Backtrace from offending handler [_handle_send_msg] servicing event [SendMsgRequest] follows.: AssertionError
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager Traceback (most recent call last):
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager   File "/var/lib/kolla/venv/lib/python3.11/site-packages/os_ken/base/app_manager.py", line 289, in _event_loop
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager     handler(ev)
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager   File "/var/lib/kolla/venv/lib/python3.11/site-packages/os_ken/app/ofctl/service.py", line 163, in _handle_send_msg
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager     datapath.set_xid(msg)
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager   File "/var/lib/kolla/venv/lib/python3.11/site-packages/os_ken/controller/controller.py", line 425, in set_xid
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager     msg.set_xid(self.xid)
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager   File "/var/lib/kolla/venv/lib/python3.11/site-packages/os_ken/ofproto/ofproto_parser.py", line 218, in set_xid
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager     assert self.xid is None
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager            ^^^^^^^^^^^^^^^^
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager AssertionError
2025-05-27 11:00:30.610 7 ERROR os_ken.base.app_manager 

/var/log/kolla/heat/heat-engine.log
2025-05-27 10:53:34.951 7 ERROR heat.engine.service [None req-758be002-bf1d-46fd-a5c8-de3449a9d271 - - - - - -] Service 40067179-60c7-4128-91ea-f0d196f576f4 update failed: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:58:44.485 7 ERROR heat.engine.service [None req-9810858d-2005-4436-9e08-c9df75a7667d - - - - - -] Service 40067179-60c7-4128-91ea-f0d196f576f4 update failed: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:58:50.641 7 ERROR heat.engine.service [None req-52d967e8-d524-4482-af18-4d6c7aaaeba5 - - - - - -] Service 40067179-60c7-4128-91ea-f0d196f576f4 update failed: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.807 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [2687fc9d-1aae-41cd-869b-f8e07d9e05d1] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.813 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [b8d96fa6-2738-4f1a-8a88-81eca6e2295d] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.846 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [1b24640e-35db-4b95-890a-84853779fd59] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.863 7 ERROR heat.engine.service [None req-759cb553-5745-4d62-987b-1f9c601bb890 - - - - - -] Service 40067179-60c7-4128-91ea-f0d196f576f4 update failed: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")

/var/log/kolla/nova/nova-compute.log
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task [None req-0a3f7976-a081-403c-897d-78d6454260ab - - - - - -] Error during ComputeManager.update_available_resource: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID e8ac4d3d44194637bcdb9c281b704b3c
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     task(self, context)
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/compute/manager.py", line 11291, in update_available_resource
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     compute_nodes_in_db = self._get_compute_nodes_in_db(context,
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/compute/manager.py", line 11351, in _get_compute_nodes_in_db
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     return objects.ComputeNodeList.get_all_by_host(context, self.host,
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     result = cls.indirection_api.object_class_action_versions(
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     return cctxt.call(context, 'object_class_action_versions',
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     result = self.transport._send(
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     return self._driver.send(target, ctxt, message,
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 789, in _send
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     result = self._waiter.wait(msg_id, timeout,
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 654, in wait
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     message = self.waiters.get(msg_id, timeout=timeout)
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 520, in get
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task     raise oslo_messaging.MessagingTimeout(
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID e8ac4d3d44194637bcdb9c281b704b3c
2025-05-27 10:52:00.386 7 ERROR oslo_service.periodic_task 
2025-05-27 10:53:34.994 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [89e8b961-c9d5-470d-b958-a4c1cefc2095] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 1 seconds.: TimeoutError: timed out
2025-05-27 10:53:35.001 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-0a3f7976-a081-403c-897d-78d6454260ab - - - - - -] [cbcc4db0-7ff7-49d6-9e69-9a7cd0acabe5] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 1 seconds.: TimeoutError: timed out
2025-05-27 10:55:37.324 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [89e8b961-c9d5-470d-b958-a4c1cefc2095] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 2 seconds.: TimeoutError: timed out
2025-05-27 10:58:44.344 7 ERROR oslo.messaging._drivers.impl_rabbit [None req-0a3f7976-a081-403c-897d-78d6454260ab - - - - - -] [cbcc4db0-7ff7-49d6-9e69-9a7cd0acabe5] AMQP server on 192.0.2.1:5671 is unreachable: timed out. Trying again in 2 seconds.: TimeoutError: timed out
2025-05-27 11:00:26.305 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [383245c8-dad5-4769-8e58-6cf6b885d6ea] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:26.308 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [21440dee-ce6c-48f0-b213-62a48c400027] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task [None req-0a3f7976-a081-403c-897d-78d6454260ab - - - - - -] Error during ComputeManager._run_pending_deletes: oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task     task(self, context)
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/compute/manager.py", line 11872, in _run_pending_deletes
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task     instances = objects.InstanceList.get_by_filters(
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task     result = cls.indirection_api.object_class_action_versions(
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task     return cctxt.call(context, 'object_class_action_versions',
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task     result = self.transport._send(
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task     return self._driver.send(target, ctxt, message,
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 792, in _send
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task     raise result
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task ['Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect\n    sock = socket.create_connection(\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection\n    raise err\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection\n    sock.connect(sa)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect\n    socket_checkerr(fd)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr\n    raise OSError(err, errno.errorcode[err])\n', 'ConnectionRefusedError: [Errno 111] ECONNREFUSED\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout\n    dbapi_connection = rec.get_connection()\n                       ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n    return getattr(target, method)(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n    result = fn(cls, context, *args, **kwargs)\n             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/instance.py", line 1421, in get_by_filters\n    db_inst_list = cls._get_by_filters_impl(\n                   ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 179, in wrapper\n    return f(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/instance.py", line 1411, in _get_by_filters_impl\n    db_inst_list = db.instance_get_all_by_filters(\n                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/utils.py", line 35, in wrapper\n    return f(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 241, in wrapper\n    return f(context, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 1595, in instance_get_all_by_filters\n    return instance_get_all_by_filters_sort(context, filters, limit=limit,\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/utils.py", line 35, in wrapper\n    return f(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 241, in wrapper\n    return f(context, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 1854, in instance_get_all_by_filters_sort\n    instances = query_prefix.all()\n                ^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2699, in all\n    return self._iter().all()  # type: ignore\n           ^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter\n    result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n                                                  ^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute\n    return self._execute_internal(\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal\n    conn = self._connection_for_bind(bind)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind\n    return trans._connection_for_bind(engine, execution_options)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "<string>", line 2, in _connection_for_bind\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go\n    ret_value = fn(self, *arg, **kw)\n                ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind\n    conn = bind.connect()\n           ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect\n    return self._connection_cls(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__\n    Connection._handle_dbapi_exception_noconnection(\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection\n    raise newraise.with_traceback(exc_info[2]) from e\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout\n    dbapi_connection = rec.get_connection()\n                       ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n'].
2025-05-27 11:00:27.554 7 ERROR oslo_service.periodic_task 
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 209, in wrapper
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db     updates, result = self.indirection_api.object_action(
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/rpcapi.py", line 247, in object_action
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db     return cctxt.call(context, 'object_action', objinst=objinst,
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db     result = self.transport._send(
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db     return self._driver.send(target, ctxt, message,
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 792, in _send
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db     raise result
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db ['Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect\n    sock = socket.create_connection(\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection\n    raise err\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection\n    sock.connect(sa)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect\n    socket_checkerr(fd)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr\n    raise OSError(err, errno.errorcode[err])\n', 'ConnectionRefusedError: [Errno 111] ECONNREFUSED\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 712, in checkout\n    rec = pool._do_get()\n          ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 179, in _do_get\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n    return self._create_connection()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 390, in _create_connection\n    return _ConnectionRecord(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 674, in __init__\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n    return getattr(target, method)(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper\n    return fn(self, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save\n    db_service = db.service_update(self._context, self.id, updates)\n                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper\n    with excutils.save_and_reraise_exception() as ectxt:\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__\n    self.force_reraise()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n    raise self.value\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper\n    return f(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper\n    return f(context, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update\n    service_ref = service_get(context, service_id)\n                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper\n    return f(context, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get\n    result = query.first()\n             ^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first\n    return self.limit(1)._iter().first()  # type: ignore\n           ^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter\n    result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n                                                  ^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute\n    return self._execute_internal(\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal\n    conn = self._connection_for_bind(bind)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind\n    return trans._connection_for_bind(engine, execution_options)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "<string>", line 2, in _connection_for_bind\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go\n    ret_value = fn(self, *arg, **kw)\n                ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind\n    conn = bind.connect()\n           ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect\n    return self._connection_cls(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__\n    Connection._handle_dbapi_exception_noconnection(\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection\n    raise newraise.with_traceback(exc_info[2]) from e\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 712, in checkout\n    rec = pool._do_get()\n          ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 179, in _do_get\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n    return self._create_connection()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 390, in _create_connection\n    return _ConnectionRecord(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 674, in __init__\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n'].
2025-05-27 11:00:27.560 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver Traceback (most recent call last):
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/virt/libvirt/driver.py", line 5688, in _set_host_enabled
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver     service = objects.Service.get_by_compute_host(ctx, CONF.host)
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver     result = cls.indirection_api.object_class_action_versions(
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver     return cctxt.call(context, 'object_class_action_versions',
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver     result = self.transport._send(
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver     return self._driver.send(target, ctxt, message,
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 792, in _send
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver     raise result
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver ['Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect\n    sock = socket.create_connection(\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection\n    raise err\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection\n    sock.connect(sa)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect\n    socket_checkerr(fd)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr\n    raise OSError(err, errno.errorcode[err])\n', 'ConnectionRefusedError: [Errno 111] ECONNREFUSED\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 712, in checkout\n    rec = pool._do_get()\n          ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 179, in _do_get\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n    return self._create_connection()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 390, in _create_connection\n    return _ConnectionRecord(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 674, in __init__\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n    return getattr(target, method)(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n    result = fn(cls, context, *args, **kwargs)\n             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 460, in get_by_compute_host\n    db_service = cls._db_service_get_by_compute_host(context, host,\n                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 179, in wrapper\n    return f(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 456, in _db_service_get_by_compute_host\n    return db.service_get_by_compute_host(context, host)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 241, in wrapper\n    return f(context, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 523, in service_get_by_compute_host\n    first()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first\n    return self.limit(1)._iter().first()  # type: ignore\n           ^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter\n    result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n                                                  ^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute\n    return self._execute_internal(\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal\n    conn = self._connection_for_bind(bind)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind\n    return trans._connection_for_bind(engine, execution_options)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "<string>", line 2, in _connection_for_bind\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go\n    ret_value = fn(self, *arg, **kw)\n                ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind\n    conn = bind.connect()\n           ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect\n    return self._connection_cls(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__\n    Connection._handle_dbapi_exception_noconnection(\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection\n    raise newraise.with_traceback(exc_info[2]) from e\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 712, in checkout\n    rec = pool._do_get()\n          ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 179, in _do_get\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n    return self._create_connection()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 390, in _create_connection\n    return _ConnectionRecord(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 674, in __init__\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n'].
2025-05-27 11:00:27.601 7 ERROR nova.virt.libvirt.driver 
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task [None req-0a3f7976-a081-403c-897d-78d6454260ab - - - - - -] Error during ComputeManager._cleanup_incomplete_migrations: oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task     task(self, context)
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/compute/manager.py", line 11906, in _cleanup_incomplete_migrations
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task     migrations = objects.MigrationList.get_by_filters(context,
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task     result = cls.indirection_api.object_class_action_versions(
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task     return cctxt.call(context, 'object_class_action_versions',
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task     result = self.transport._send(
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task     return self._driver.send(target, ctxt, message,
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 792, in _send
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task     raise result
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task ['Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect\n    sock = socket.create_connection(\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection\n    raise err\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection\n    sock.connect(sa)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect\n    socket_checkerr(fd)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr\n    raise OSError(err, errno.errorcode[err])\n', 'ConnectionRefusedError: [Errno 111] ECONNREFUSED\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout\n    dbapi_connection = rec.get_connection()\n                       ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n    return getattr(target, method)(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n    result = fn(cls, context, *args, **kwargs)\n             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/migration.py", line 308, in get_by_filters\n    db_migrations = db.migration_get_all_by_filters(\n                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper\n    return f(context, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 3469, in migration_get_all_by_filters\n    return query.all()\n           ^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2699, in all\n    return self._iter().all()  # type: ignore\n           ^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter\n    result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n                                                  ^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute\n    return self._execute_internal(\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal\n    conn = self._connection_for_bind(bind)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind\n    return trans._connection_for_bind(engine, execution_options)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "<string>", line 2, in _connection_for_bind\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go\n    ret_value = fn(self, *arg, **kw)\n                ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind\n    conn = bind.connect()\n           ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect\n    return self._connection_cls(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__\n    Connection._handle_dbapi_exception_noconnection(\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection\n    raise newraise.with_traceback(exc_info[2]) from e\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout\n    dbapi_connection = rec.get_connection()\n                       ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n'].
2025-05-27 11:00:28.074 7 ERROR oslo_service.periodic_task 
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 209, in wrapper
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db     updates, result = self.indirection_api.object_action(
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/rpcapi.py", line 247, in object_action
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db     return cctxt.call(context, 'object_action', objinst=objinst,
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db     result = self.transport._send(
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db     return self._driver.send(target, ctxt, message,
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 792, in _send
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db     raise result
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db ['Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect\n    sock = socket.create_connection(\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection\n    raise err\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection\n    sock.connect(sa)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect\n    socket_checkerr(fd)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr\n    raise OSError(err, errno.errorcode[err])\n', 'ConnectionRefusedError: [Errno 111] ECONNREFUSED\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout\n    dbapi_connection = rec.get_connection()\n                       ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n    return getattr(target, method)(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper\n    return fn(self, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save\n    db_service = db.service_update(self._context, self.id, updates)\n                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper\n    with excutils.save_and_reraise_exception() as ectxt:\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__\n    self.force_reraise()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n    raise self.value\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper\n    return f(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper\n    return f(context, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update\n    service_ref = service_get(context, service_id)\n                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper\n    return f(context, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get\n    result = query.first()\n             ^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first\n    return self.limit(1)._iter().first()  # type: ignore\n           ^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter\n    result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n                                                  ^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute\n    return self._execute_internal(\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal\n    conn = self._connection_for_bind(bind)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind\n    return trans._connection_for_bind(engine, execution_options)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "<string>", line 2, in _connection_for_bind\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go\n    ret_value = fn(self, *arg, **kw)\n                ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind\n    conn = bind.connect()\n           ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect\n    return self._connection_cls(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__\n    Connection._handle_dbapi_exception_noconnection(\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection\n    raise newraise.with_traceback(exc_info[2]) from e\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout\n    dbapi_connection = rec.get_connection()\n                       ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n'].
2025-05-27 11:00:28.078 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task [None req-0a3f7976-a081-403c-897d-78d6454260ab - - - - - -] Error during ComputeManager._cleanup_expired_console_auth_tokens: oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task Traceback (most recent call last):
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task     task(self, context)
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/compute/manager.py", line 12002, in _cleanup_expired_console_auth_tokens
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task     objects.ConsoleAuthToken.clean_expired_console_auths(context)
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task     result = cls.indirection_api.object_class_action_versions(
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task     return cctxt.call(context, 'object_class_action_versions',
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/rpc/client.py", line 190, in call
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task     result = self.transport._send(
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task              ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/transport.py", line 123, in _send
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task     return self._driver.send(target, ctxt, message,
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task     return self._send(target, ctxt, message, wait_for_reply, timeout,
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 792, in _send
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task     raise result
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task ['Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect\n    sock = socket.create_connection(\n           ^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection\n    raise err\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection\n    sock.connect(sa)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect\n    socket_checkerr(fd)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr\n    raise OSError(err, errno.errorcode[err])\n', 'ConnectionRefusedError: [Errno 111] ECONNREFUSED\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout\n    dbapi_connection = rec.get_connection()\n                       ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n    return getattr(target, method)(*args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n    result = fn(cls, context, *args, **kwargs)\n             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/console_auth_token.py", line 202, in clean_expired_console_auths\n    db.console_auth_token_destroy_expired(context)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper\n    return f(context, *args, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 4903, in console_auth_token_destroy_expired\n    delete()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 3204, in delete\n    result: CursorResult[Any] = self.session.execute(\n                                ^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute\n    return self._execute_internal(\n           ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal\n    conn = self._connection_for_bind(bind)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind\n    return trans._connection_for_bind(engine, execution_options)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "<string>", line 2, in _connection_for_bind\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go\n    ret_value = fn(self, *arg, **kw)\n                ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind\n    conn = bind.connect()\n           ^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect\n    return self._connection_cls(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__\n    Connection._handle_dbapi_exception_noconnection(\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection\n    raise newraise.with_traceback(exc_info[2]) from e\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__\n    self._dbapi_connection = engine.raw_connection()\n                             ^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection\n    return self.pool.connect()\n           ^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect\n    return _ConnectionFairy._checkout(self)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout\n    fairy = _ConnectionRecord.checkout(pool)\n            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout\n    dbapi_connection = rec.get_connection()\n                       ^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection\n    self.__connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect\n    with util.safe_reraise():\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__\n    raise exc_value.with_traceback(exc_tb)\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect\n    self.dbapi_connection = connection = pool._invoke_creator(self)\n                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect\n    return dialect.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect\n    return self.loaded_dbapi.connect(*cargs, **cparams)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__\n    self.connect()\n', '  File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect\n    raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'192.0.2.10\' ([Errno 111] ECONNREFUSED)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n'].
2025-05-27 11:00:28.582 7 ERROR oslo_service.periodic_task 

/var/log/kolla/nova/nova-conductor.log
2025-05-27 10:53:35.084 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [03becd82-c56c-4993-8cd0-490259966604] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 866, in get_connection
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 914, in __connect
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     )._exec_w_sync_on_first_run(self.dbapi_connection, self)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/event/attr.py", line 489, in _exec_w_sync_on_first_run
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     self(*args, **kw)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/event/attr.py", line 497, in __call__
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     fn(*args, **kw)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 724, in on_connect
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     do_on_connect(dbapi_connection)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/dialects/mysql/mysqldb.py", line 162, in on_connect
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     cursor.execute("SET NAMES %s" % charset_name)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     result = self._query(query)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     conn.query(q)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     result.read()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     first_packet = self.connection._read_packet()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 744, in _read_packet
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     packet_header = self._read_bytes(4)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                     ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 798, in _read_bytes
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     raise err.OperationalError(
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 866, in get_connection
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 914, in __connect
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     )._exec_w_sync_on_first_run(self.dbapi_connection, self)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/event/attr.py", line 489, in _exec_w_sync_on_first_run
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     self(*args, **kw)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/event/attr.py", line 497, in __call__
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     fn(*args, **kw)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 724, in on_connect
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     do_on_connect(dbapi_connection)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/dialects/mysql/mysqldb.py", line 162, in on_connect
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     cursor.execute("SET NAMES %s" % charset_name)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     result = self._query(query)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     conn.query(q)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     result.read()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     first_packet = self.connection._read_packet()
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 744, in _read_packet
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     packet_header = self._read_bytes(4)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db                     ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 798, in _read_bytes
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db     raise err.OperationalError(
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:53:35.091 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     sock = socket.create_connection(
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise err
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     sock.connect(sa)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     socket_checkerr(fd)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise OSError(err, errno.errorcode[err])
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:53:35.291 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:54:48.270 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [03becd82-c56c-4993-8cd0-490259966604] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     sock = socket.create_connection(
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise err
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     sock.connect(sa)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     socket_checkerr(fd)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise OSError(err, errno.errorcode[err])
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:58:48.393 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.817 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [03becd82-c56c-4993-8cd0-490259966604] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.821 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [f47b9c07-1787-4df2-a30b-d809a98ffa96] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     sock = socket.create_connection(
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise err
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     sock.connect(sa)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     socket_checkerr(fd)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise OSError(err, errno.errorcode[err])
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:25.839 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     sock = socket.create_connection(
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise err
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     sock.connect(sa)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     socket_checkerr(fd)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise OSError(err, errno.errorcode[err])
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:25.926 7 ERROR nova.servicegroup.drivers.db 

/var/log/kolla/nova/nova-scheduler.log
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1964, in _exec_single_context
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self.dialect.do_execute(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 942, in do_execute
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     cursor.execute(statement, parameters)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     result = self._query(query)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     conn.query(q)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     result.read()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     first_packet = self.connection._read_packet()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 775, in _read_packet
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     packet.raise_for_error()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/protocol.py", line 219, in raise_for_error
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     err.raise_mysql_exception(self._data)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/err.py", line 150, in raise_mysql_exception
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise errorclass(errno, errval)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (9001, 'Max connect timeout reached while reaching hostgroup 0 after 50916ms')
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 4449, in _flush
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     flush_context.execute()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/unitofwork.py", line 466, in execute
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     rec.execute(self)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/unitofwork.py", line 642, in execute
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     util.preloaded.orm_persistence.save_obj(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/persistence.py", line 85, in save_obj
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     _emit_update_statements(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/persistence.py", line 912, in _emit_update_statements
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     c = connection.execute(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db         ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1416, in execute
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     return meth(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db            ^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/sql/elements.py", line 516, in _execute_on_connection
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     return connection._execute_clauseelement(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1638, in _execute_clauseelement
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     ret = self._execute_context(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db           ^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1843, in _execute_context
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     return self._exec_single_context(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1983, in _exec_single_context
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._handle_dbapi_exception(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2349, in _handle_dbapi_exception
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1964, in _exec_single_context
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self.dialect.do_execute(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 942, in do_execute
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     cursor.execute(statement, parameters)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 153, in execute
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     result = self._query(query)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/cursors.py", line 322, in _query
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     conn.query(q)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 563, in query
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 825, in _read_query_result
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     result.read()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 1199, in read
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     first_packet = self.connection._read_packet()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 775, in _read_packet
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     packet.raise_for_error()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/protocol.py", line 219, in raise_for_error
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     err.raise_mysql_exception(self._data)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/err.py", line 150, in raise_mysql_exception
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise errorclass(errno, errval)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (9001, 'Max connect timeout reached while reaching hostgroup 0 after 50916ms')
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db [SQL: UPDATE services SET report_count=%(report_count)s, last_seen_up=%(last_seen_up)s, updated_at=%(updated_at)s WHERE services.id = %(services_id)s]
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db [parameters: {'report_count': 191, 'last_seen_up': datetime.datetime(2025, 5, 27, 10, 51, 29, 644442), 'updated_at': datetime.datetime(2025, 5, 27, 10, 51, 30, 174902), 'services_id': 1}]
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1125, in _rollback_impl
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self.engine.dialect.do_rollback(self.connection)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 700, in do_rollback
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     dbapi_connection.rollback()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 493, in rollback
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._read_ok_packet()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 453, in _read_ok_packet
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     pkt = self._read_packet()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db           ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 744, in _read_packet
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     packet_header = self._read_bytes(4)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                     ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 798, in _read_bytes
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise err.OperationalError(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 206, in wrapper
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     with ctxt_mgr.writer.using(context):
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/usr/lib/python3.11/contextlib.py", line 144, in __exit__
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     next(self.gen)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 1199, in _transaction_scope
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     with current._produce_block(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/usr/lib/python3.11/contextlib.py", line 144, in __exit__
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     next(self.gen)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 850, in _session
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception():
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 848, in _session
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._end_session_transaction(self.session)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 761, in _end_session_transaction
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     session.commit()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2032, in commit
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     trans.commit(_to_root=True)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in commit
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1313, in commit
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._prepare_impl()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _prepare_impl
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1288, in _prepare_impl
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self.session.flush()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 4353, in flush
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._flush(objects)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 4488, in _flush
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 150, in __exit__
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise value.with_traceback(traceback)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 4489, in _flush
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     transaction.rollback(_capture_exception=True)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in rollback
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1395, in rollback
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise rollback_err[1].with_traceback(rollback_err[2])
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1360, in rollback
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     t[1].rollback()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2608, in rollback
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._do_rollback()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2727, in _do_rollback
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._close_impl(try_deactivate=True)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2710, in _close_impl
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._connection_rollback_impl()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2702, in _connection_rollback_impl
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self.connection._rollback_impl()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1127, in _rollback_impl
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._handle_dbapi_exception(e, None, None, None, None)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2349, in _handle_dbapi_exception
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 1125, in _rollback_impl
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self.engine.dialect.do_rollback(self.connection)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 700, in do_rollback
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     dbapi_connection.rollback()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 493, in rollback
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     self._read_ok_packet()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 453, in _read_ok_packet
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     pkt = self._read_packet()
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db           ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 744, in _read_packet
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     packet_header = self._read_bytes(4)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db                     ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 798, in _read_bytes
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db     raise err.OperationalError(
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:53:34.951 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     sock = socket.create_connection(
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise err
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     sock.connect(sa)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     socket_checkerr(fd)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise OSError(err, errno.errorcode[err])
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:53:35.236 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     sock = socket.create_connection(
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise err
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     sock.connect(sa)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     socket_checkerr(fd)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise OSError(err, errno.errorcode[err])
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:55:45.352 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     sock = socket.create_connection(
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise err
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     sock.connect(sa)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     socket_checkerr(fd)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise OSError(err, errno.errorcode[err])
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 10:58:50.465 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.818 7 ERROR oslo.messaging._drivers.impl_rabbit [-] [ff64d486-766e-453b-9d55-7213e512b9e9] AMQP server on 192.0.2.1:5671 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     sock = socket.create_connection(
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise err
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     sock.connect(sa)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     socket_checkerr(fd)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise OSError(err, errno.errorcode[err])
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:25.821 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db [-] Unexpected error while reporting service status: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 649, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     sock = socket.create_connection(
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 63, in create_connection
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise err
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/green/socket.py", line 53, in create_connection
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     sock.connect(sa)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 265, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     socket_checkerr(fd)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/eventlet/greenio/base.py", line 50, in socket_checkerr
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise OSError(err, errno.errorcode[err])
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db ConnectionRefusedError: [Errno 111] ECONNREFUSED
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db During handling of the above exception, another exception occurred:
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db The above exception was the direct cause of the following exception:
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db 
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db Traceback (most recent call last):
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     service.service_ref.save()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_versionedobjects/base.py", line 226, in wrapper
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return fn(self, *args, **kwargs)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/objects/service.py", line 516, in save
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     db_service = db.service_update(self._context, self.id, updates)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 144, in wrapper
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     with excutils.save_and_reraise_exception() as ectxt:
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     self.force_reraise()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise self.value
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/oslo_db/api.py", line 142, in wrapper
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return f(*args, **kwargs)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 207, in wrapper
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 563, in service_update
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     service_ref = service_get(context, service_id)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 224, in wrapper
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return f(context, *args, **kwargs)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/nova/db/main/api.py", line 398, in service_get
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     result = query.first()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db              ^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2754, in first
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return self.limit(1)._iter().first()  # type: ignore
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/query.py", line 2853, in _iter
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                                                   ^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2365, in execute
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return self._execute_internal(
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2241, in _execute_internal
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     conn = self._connection_for_bind(bind)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 2110, in _connection_for_bind
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return trans._connection_for_bind(engine, execution_options)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "<string>", line 2, in _connection_for_bind
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/state_changes.py", line 139, in _go
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     ret_value = fn(self, *arg, **kw)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                 ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/orm/session.py", line 1189, in _connection_for_bind
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     conn = bind.connect()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3274, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return self._connection_cls(self)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 148, in __init__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     Connection._handle_dbapi_exception_noconnection(
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 2436, in _handle_dbapi_exception_noconnection
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise newraise.with_traceback(exc_info[2]) from e
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 146, in __init__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     self._dbapi_connection = engine.raw_connection()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                              ^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/base.py", line 3298, in raw_connection
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return self.pool.connect()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 449, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return _ConnectionFairy._checkout(self)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 1263, in _checkout
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     fairy = _ConnectionRecord.checkout(pool)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 717, in checkout
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 715, in checkout
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     dbapi_connection = rec.get_connection()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                        ^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 837, in get_connection
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     self.__connect()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 900, in __connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     with util.safe_reraise():
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/util/langhelpers.py", line 146, in __exit__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise exc_value.with_traceback(exc_tb)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/pool/base.py", line 896, in __connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     self.dbapi_connection = connection = pool._invoke_creator(self)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/create.py", line 646, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return dialect.connect(*cargs, **cparams)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/sqlalchemy/engine/default.py", line 622, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     return self.loaded_dbapi.connect(*cargs, **cparams)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 361, in __init__
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     self.connect()
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db   File "/var/lib/kolla/venv/lib/python3.11/site-packages/pymysql/connections.py", line 716, in connect
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db     raise exc
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.0.2.10' ([Errno 111] ECONNREFUSED)")
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/20/e3q8)
2025-05-27 11:00:25.861 7 ERROR nova.servicegroup.drivers.db 

/var/log/kolla/nova/nova-manage.log
2025-05-27 10:42:17.230 20 ERROR nova.objects.instance [None req-31075c38-a524-4b31-b76c-3920639e707d - - - - - -] [instance: 00000000-0000-0000-0000-000000000000] Unable to migrate instance because host None with node None not found: nova.exception.ComputeHostNotFound: Compute host None could not be found.