Open Stack

Hi

After diagnosis the issue we found following errors on controller node.


root at controller:/etc/rabbitmq# cat /var/log/nova/nova-* | grep -i error
2015-06-08 17:50:52.627 29174 DEBUG nova.openstack.common.service [-]
fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:50:52.647 29174 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:52:56.942 29346 DEBUG nova.openstack.common.service [-]
fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:52:56.962 29346 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:54:26.049 29629 DEBUG nova.openstack.common.service [-]
fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:54:26.069 29629 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:57:19.493 29712 DEBUG nova.openstack.common.service [-]
fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:57:19.514 29712 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:59:05.496 29722 DEBUG oslo.db.sqlalchemy.session
[req-48515a1e-d5c0-48e3-b08d-b2c6d17eb6ff ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:59:30.267 29724 DEBUG oslo.db.sqlalchemy.session
[req-89ffb4ea-a479-413c-87df-1aa7d7cd885d ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:59:37.612 29723 DEBUG oslo.db.sqlalchemy.session
[req-b0aa3876-225d-4683-931c-8d02fe05f327 ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:59:39.035 29725 DEBUG oslo.db.sqlalchemy.session
[req-1482dbcb-dce6-4203-a904-ef6f2bc152c5 ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 16:32:47.353 22717 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: (0, 0): (320) CONNECTION_FORCED -
broker forced connection closure with reason 'shutdown'
2015-06-08 16:32:47.353 22717 TRACE oslo.messaging._drivers.impl_rabbit
(class_id, method_id), ConnectionError)
2015-06-08 16:32:48.383 22717 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:32:50.390 22717 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:58:46.979 22717 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.979 22717 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:58:47.991 22717 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:58:50.000 22717 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:20:45.976 22717 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.976 22717 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:20:46.985 22717 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 17:20:48.992 22717 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:50:57.946 29211 DEBUG nova.openstack.common.service [-]
fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:50:57.959 29211 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:50:58.188 29211 DEBUG oslo.db.sqlalchemy.session
[req-79c36c8a-6bbc-48f7-a32c-0249882fe494 ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-03 16:46:06.831 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:11.845 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:18.860 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:27.877 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:38.896 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:51.917 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:47:06.940 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:47:23.965 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:47:42.992 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:48:04.006 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:48:27.029 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:48:52.061 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:49:19.076 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:49:48.112 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:50:19.151 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:50:52.174 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:51:26.194 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:52:00.213 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:52:34.232 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:53:08.271 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:53:42.288 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:54:16.303 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:54:50.326 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:55:24.344 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:55:58.367 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:56:32.388 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:57:06.402 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:57:40.423 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:58:14.438 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:58:48.457 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:59:22.479 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:59:56.512 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:00:30.549 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:01:04.585 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:01:38.621 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:02:12.637 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:02:46.673 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:03:20.689 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:03:54.731 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:04:28.748 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:05:02.790 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:05:36.806 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:06:10.840 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:06:44.862 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:07:18.897 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:07:52.936 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:08:26.971 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:09:00.986 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:09:35.009 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:10:09.026 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:10:43.058 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:11:17.100 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:11:51.142 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:12:25.182 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:12:59.221 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:13:33.241 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:14:07.264 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:14:41.305 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:15:15.346 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:15:49.388 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:16:23.429 21139 ERROR oslo.messaging._drivers.impl_rabbit
[req-9e1c7748-8b55-49d8-b747-ea18d110c887 ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-04 13:57:10.964 1121 ERROR nova.openstack.common.threadgroup [-]
(OperationalError) (2003, "Can't connect to MySQL server on 'controller'
(111)") None None
2015-06-04 13:57:10.964 1121 TRACE nova.openstack.common.threadgroup
OperationalError: (OperationalError) (2003, "Can't connect to MySQL server
on 'controller' (111)") None None
2015-06-04 14:59:43.534 1166 ERROR nova.openstack.common.threadgroup [-]
(OperationalError) (2003, "Can't connect to MySQL server on 'controller'
(111)") None None
2015-06-04 14:59:43.534 1166 TRACE nova.openstack.common.threadgroup
OperationalError: (OperationalError) (2003, "Can't connect to MySQL server
on 'controller' (111)") None None
2015-06-08 11:50:54.851 2021 ERROR nova.scheduler.driver
[req-d2f22cfe-bcc7-4d3a-9600-901ffb71a340 None] Exception during
scheduler.run_instance
2015-06-08 11:50:54.853 2021 WARNING nova.scheduler.driver
[req-d2f22cfe-bcc7-4d3a-9600-901ffb71a340 None] [instance:
fb120071-2a6c-4d39-b088-a330ed08e019] Setting instance to ERROR state.
2015-06-08 13:38:11.059 2167 ERROR nova.scheduler.driver
[req-606da791-715b-4a91-abef-09f445f23a13 None] Exception during
scheduler.run_instance
2015-06-08 13:38:11.061 2167 WARNING nova.scheduler.driver
[req-606da791-715b-4a91-abef-09f445f23a13 None] [instance:
e647ccf2-253e-476d-a6c4-6c6408e11614] Setting instance to ERROR state.
2015-06-08 15:28:59.327 1875 WARNING nova.scheduler.driver
[req-6551acbe-af92-4a36-baaa-3e810e166bf0 None] [instance:
31fde177-33e6-4cf1-9d17-883fc0e320ea] Setting instance to ERROR state.
2015-06-08 15:30:00.648 1960 WARNING nova.scheduler.driver
[req-3f1599c4-941a-41ae-b639-ecfd9d7db741 None] [instance:
63bdd0df-d08a-417d-99e3-865e2d62bfbe] Setting instance to ERROR state.
2015-06-08 16:19:57.506 2021 WARNING nova.scheduler.driver
[req-8858f73a-74b2-4bfc-9692-0c411fb497c2 None] [instance:
797875d1-10ee-4bf6-ade7-cd5ab7ad94a8] Setting instance to ERROR state.
2015-06-08 16:24:05.158 2167 WARNING nova.scheduler.driver
[req-0514446c-790f-4e74-a9a7-045b7da81e05 None] [instance:
e5045010-39dc-4966-bdb8-011a776570fb] Setting instance to ERROR state.
2015-06-08 16:32:47.345 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: (0, 0): (320) CONNECTION_FORCED -
broker forced connection closure with reason 'shutdown'
2015-06-08 16:32:47.345 1960 TRACE oslo.messaging._drivers.impl_rabbit
(class_id, method_id), ConnectionError)
2015-06-08 16:32:47.349 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:32:47.349 2167 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:32:47.343 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:32:47.343 2021 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:32:47.341 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:32:47.341 1875 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:32:48.383 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:32:48.520 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:32:48.524 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:32:48.526 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:32:50.389 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:32:50.526 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:32:50.529 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:32:50.531 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:37:01.544 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_3c781b2d789e4ba587ea4989b79c1c4b': [Errno 104] Connection reset by
peer
2015-06-08 16:37:01.544 1960 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:37:02.659 1875 ERROR oslo.messaging._drivers.impl_rabbit
[req-4dd94b28-0c0b-42ac-ab71-0716fb64c491 ] Failed to publish message to
topic 'reply_3c781b2d789e4ba587ea4989b79c1c4b': [Errno 104] Connection
reset by peer
2015-06-08 16:37:02.659 1875 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:37:03.711 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_3c781b2d789e4ba587ea4989b79c1c4b': [Errno 104] Connection reset by
peer
2015-06-08 16:37:03.711 2021 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:37:04.737 2167 ERROR oslo.messaging._drivers.impl_rabbit
[req-446c1ab0-1a4a-4f19-af29-30e8ce97d089 ] Failed to publish message to
topic 'reply_3c781b2d789e4ba587ea4989b79c1c4b': [Errno 104] Connection
reset by peer
2015-06-08 16:37:04.737 2167 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.979 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.979 2167 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.981 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.981 2021 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.982 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.982 1875 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.996 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.996 1960 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:58:47.990 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:58:47.994 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:58:47.996 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:58:48.001 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:58:50.000 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:58:50.002 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:58:50.007 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:58:50.008 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:18:05.868 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_be2a40b32243469c8319768613f11113': [Errno 104] Connection reset by
peer
2015-06-08 17:18:05.868 2167 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:18:06.929 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_be2a40b32243469c8319768613f11113': [Errno 104] Connection reset by
peer
2015-06-08 17:18:06.929 1960 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:18:07.975 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_be2a40b32243469c8319768613f11113': [Errno 104] Connection reset by
peer
2015-06-08 17:18:07.975 1875 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:18:09.001 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_be2a40b32243469c8319768613f11113': [Errno 104] Connection reset by
peer
2015-06-08 17:18:09.001 2021 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.968 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.968 1875 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.979 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.979 2167 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.979 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.979 2021 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.983 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.983 1960 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:20:46.980 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 17:20:46.986 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 17:20:46.987 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 17:20:46.992 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 17:20:48.985 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:20:48.992 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:20:48.998 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:20:48.998 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:20:55.744 1960 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_66a0063861144f23a6f06af1fd3e71f8': [Errno 104] Connection reset by
peer
2015-06-08 17:20:55.744 1960 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:21:04.735 2167 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_66a0063861144f23a6f06af1fd3e71f8': [Errno 104] Connection reset by
peer
2015-06-08 17:21:04.735 2167 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:21:09.249 2021 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_66a0063861144f23a6f06af1fd3e71f8': [Errno 104] Connection reset by
peer
2015-06-08 17:21:09.249 2021 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:21:10.285 1875 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to publish message to topic
'reply_66a0063861144f23a6f06af1fd3e71f8': [Errno 104] Connection reset by
peer
2015-06-08 17:21:10.285 1875 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:49:48.953 1960 ERROR oslo.messaging.rpc.dispatcher
[req-a13556b5-e4a6-4bde-8bfb-797c765a6e60 ] Exception during message
handling: (OperationalError) (2003, "Can't connect to MySQL server on
'controller' (111)") None None
2015-06-08 17:49:48.953 1960 TRACE oslo.messaging.rpc.dispatcher
OperationalError: (OperationalError) (2003, "Can't connect to MySQL server
on 'controller' (111)") None None
2015-06-08 17:49:48.963 1960 ERROR oslo.messaging._drivers.common
[req-a13556b5-e4a6-4bde-8bfb-797c765a6e60 ] Returning exception
(OperationalError) (2003, "Can't connect to MySQL server on 'controller'
(111)") None None to caller
2015-06-08 17:49:48.963 1960 ERROR oslo.messaging._drivers.common
[req-a13556b5-e4a6-4bde-8bfb-797c765a6e60 ] ['Traceback (most recent call
last):\n', '  File
"/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line
134, in _dispatch_and_reply\n    incoming.message))\n', '  File
"/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line
177, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt,
args)\n', '  File
"/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line
123, in _do_dispatch\n    result = getattr(endpoint, method)(ctxt,
**new_args)\n', '  File
"/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/server.py", line 139,
in inner\n    return func(*args, **kwargs)\n', '  File
"/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 320, in
service_update\n    svc = self.db.service_update(context, service[\'id\'],
values)\n', '  File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line
150, in service_update\n    return IMPL.service_update(context, service_id,
values)\n', '  File
"/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 125, in
wrapper\n    return f(*args, **kwargs)\n', '  File
"/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 181, in
wrapped\n    return f(*args, **kwargs)\n', '  File
"/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 524, in
service_update\n    with_compute_node=False, session=session)\n', '  File
"/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 424, in
_service_get\n    result = query.first()\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2341, in
first\n    ret = list(self[0:1])\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2208, in
__getitem__\n    return list(res)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2412, in
__iter__\n    return self._execute_and_instances(context)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2425, in
_execute_and_instances\n    close_with_result=True)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2416, in
_connection_from_session\n    **kw)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 854, in
connection\n    close_with_result=close_with_result)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 858, in
_connection_for_bind\n    return
self.transaction._connection_for_bind(engine)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 329, in
_connection_for_bind\n    transaction = conn.begin()\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 420, in
begin\n    self.__transaction = RootTransaction(self)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1357, in
__init__\n    self.connection._begin_impl(self)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 490, in
_begin_impl\n    self.dispatch.begin(self)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/event/attr.py", line 260, in
__call__\n    fn(*args, **kw)\n', '  File
"/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py", line 331,
in _begin_ping_listener\n    connection.scalar(select([1]))\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 659, in
scalar\n    return self.execute(object, *multiparams,
**params).scalar()\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 729, in
execute\n    return meth(self, multiparams, params)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 321, in
_execute_on_connection\n    return connection._execute_clauseelement(self,
multiparams, params)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 826, in
_execute_clauseelement\n    compiled_sql, distilled_params\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 893, in
_execute_context\n    None, None)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1169, in
_handle_dbapi_exception\n    dbapi_conn_wrapper = self.connection\n', '
File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line
236, in connection\n    return self._revalidate_connection()\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 244, in
_revalidate_connection\n    self.__connection =
self.engine.raw_connection()\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1848, in
raw_connection\n    return self.pool.unique_connection()\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 280, in
unique_connection\n    return _ConnectionFairy._checkout(self)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 641, in
_checkout\n    fairy = _ConnectionRecord.checkout(pool)\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 442, in
checkout\n    dbapi_connection = rec.get_connection()\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 505, in
get_connection\n    self.connection = self.__connect()\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 537, in
__connect\n    connection = self.__pool._creator()\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py", line
96, in connect\n    connection_invalidated=invalidated\n', '  File
"/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 199, in
raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '
File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py",
line 90, in connect\n    return dialect.connect(*cargs, **cparams)\n', '
File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line
377, in connect\n    return self.dbapi.connect(*cargs, **cparams)\n', '
File "/usr/lib/python2.7/dist-packages/MySQLdb/__init__.py", line 81, in
Connect\n    return Connection(*args, **kwargs)\n', '  File
"/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 187, in
__init__\n    super(Connection, self).__init__(*args, **kwargs2)\n',
'OperationalError: (OperationalError) (2003, "Can\'t connect to MySQL
server on \'controller\' (111)") None None\n']
2015-06-08 17:52:26.356 29313 DEBUG nova.openstack.common.service [-]
fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:52:26.370 29313 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:52:26.568 29319 DEBUG oslo.db.sqlalchemy.session
[req-3c8214f9-8ef4-4eaa-afea-900b1bc6bc1b ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:52:26.571 29322 DEBUG oslo.db.sqlalchemy.session
[req-e710fee3-6820-4ac3-98a6-c5496ebe8efd ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:52:26.607 29320 DEBUG oslo.db.sqlalchemy.session
[req-93902e98-a914-4c31-917a-0c84ffaf16be ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:52:26.616 29321 DEBUG oslo.db.sqlalchemy.session
[req-54b83532-2809-4c27-a5af-da0df3127282 ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:53:04.321 29405 DEBUG nova.openstack.common.service [-]
fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:53:04.334 29405 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:53:04.534 29411 DEBUG oslo.db.sqlalchemy.session
[req-d9de0ea9-acd3-4da3-8ca1-75db5b53738f ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:53:04.541 29412 DEBUG oslo.db.sqlalchemy.session
[req-b8ee9150-6245-4936-8fda-186a476cb477 ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:53:04.566 29414 DEBUG oslo.db.sqlalchemy.session
[req-b1334dd4-04b1-47e5-b7fd-c99080b46c62 ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 17:53:04.568 29413 DEBUG oslo.db.sqlalchemy.session
[req-8628e7f4-f06a-4cad-812f-111fb6d396ee ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-05 17:05:49.917 2021 ERROR nova.scheduler.driver
[req-359bf5a3-39bc-4445-a142-3c2904f99260 None] Exception during
scheduler.run_instance
2015-06-05 17:05:49.970 2021 WARNING nova.scheduler.driver
[req-359bf5a3-39bc-4445-a142-3c2904f99260 None] [instance:
11fd949a-14c9-44d7-9aa4-bef33b8638aa] Setting instance to ERROR state.
2015-06-05 17:05:50.079 2021 ERROR nova.scheduler.driver
[req-359bf5a3-39bc-4445-a142-3c2904f99260 None] Exception during
scheduler.run_instance
2015-06-05 17:05:50.081 2021 WARNING nova.scheduler.driver
[req-359bf5a3-39bc-4445-a142-3c2904f99260 None] [instance:
47dd5684-91a9-4274-8604-dd285aa766eb] Setting instance to ERROR state.
2015-06-05 17:11:34.530 2167 ERROR nova.scheduler.driver
[req-a5623b2c-fb56-4070-9278-99395d4c2d98 None] Exception during
scheduler.run_instance
2015-06-05 17:11:34.533 2167 WARNING nova.scheduler.driver
[req-a5623b2c-fb56-4070-9278-99395d4c2d98 None] [instance:
9f9af778-0329-480e-896b-9289996ce19b] Setting instance to ERROR state.
2015-06-05 17:11:34.599 2167 ERROR nova.scheduler.driver
[req-a5623b2c-fb56-4070-9278-99395d4c2d98 None] Exception during
scheduler.run_instance
2015-06-05 17:11:34.601 2167 WARNING nova.scheduler.driver
[req-a5623b2c-fb56-4070-9278-99395d4c2d98 None] [instance:
ea384545-c644-40e4-a9fc-648573272f45] Setting instance to ERROR state.
2015-06-05 17:23:18.196 1875 ERROR nova.scheduler.driver
[req-4689efb0-b1c3-4a7a-a082-287c545521e0 None] Exception during
scheduler.run_instance
2015-06-05 17:23:18.198 1875 WARNING nova.scheduler.driver
[req-4689efb0-b1c3-4a7a-a082-287c545521e0 None] [instance:
d2419921-ceba-40b3-9d3a-40cb4a934baa] Setting instance to ERROR state.
2015-06-05 18:20:37.762 1960 ERROR nova.scheduler.driver
[req-c173571f-ab41-4eb8-bb5e-a922afef6738 None] Exception during
scheduler.run_instance
2015-06-05 18:20:37.765 1960 WARNING nova.scheduler.driver
[req-c173571f-ab41-4eb8-bb5e-a922afef6738 None] [instance:
3cb92e23-9d37-4071-b068-9009152bd353] Setting instance to ERROR state.
2015-06-05 18:25:11.574 2021 ERROR nova.scheduler.driver
[req-2b3c3705-006a-4c0b-97ce-e813bbab7c38 None] Exception during
scheduler.run_instance
2015-06-05 18:25:11.576 2021 WARNING nova.scheduler.driver
[req-2b3c3705-006a-4c0b-97ce-e813bbab7c38 None] [instance:
bc9680ac-fe6e-407e-849f-bcec3d0e1580] Setting instance to ERROR state.
2015-06-05 18:25:11.623 2021 ERROR nova.scheduler.driver
[req-2b3c3705-006a-4c0b-97ce-e813bbab7c38 None] Exception during
scheduler.run_instance
2015-06-05 18:25:11.625 2021 WARNING nova.scheduler.driver
[req-2b3c3705-006a-4c0b-97ce-e813bbab7c38 None] [instance:
3c8a5ac9-5c4e-4390-8877-46befea3935f] Setting instance to ERROR state.
2015-06-05 18:37:38.073 2167 ERROR nova.scheduler.driver
[req-5ed02c12-fc32-414e-bd7d-989442be1221 None] Exception during
scheduler.run_instance
2015-06-05 18:37:38.075 2167 WARNING nova.scheduler.driver
[req-5ed02c12-fc32-414e-bd7d-989442be1221 None] [instance:
d7b11370-5516-4cb0-81c9-4f1aac43ee32] Setting instance to ERROR state.
2015-06-05 19:28:17.359 1875 ERROR nova.scheduler.driver
[req-f67dd811-d90e-4f56-b44b-c93a58ec1ad1 None] Exception during
scheduler.run_instance
2015-06-05 19:28:17.361 1875 WARNING nova.scheduler.driver
[req-f67dd811-d90e-4f56-b44b-c93a58ec1ad1 None] [instance:
2941f11b-02a6-4c98-a79b-fd5e50c1dafd] Setting instance to ERROR state.
2015-06-05 19:32:47.723 1960 ERROR nova.scheduler.driver
[req-df38c72a-5f83-4118-952a-2fa288b5d6af None] Exception during
scheduler.run_instance
2015-06-05 19:32:47.725 1960 WARNING nova.scheduler.driver
[req-df38c72a-5f83-4118-952a-2fa288b5d6af None] [instance:
21562e10-ffaa-4275-b270-7766a3651411] Setting instance to ERROR state.
▒3
▒▒▒)1
▒▒▒▒▒ΠaX▒g▒▒s▒a▒^▒▒▒e▒▒l/▒▒▒▒Ū,▒e1^n▒▒q▒:[▒▒2ێ▒բ▒▒▒bg▒ݫ▒-▒▒y▒▒.l_Lw/▒▒M=ϲ▒▒▒n▒▒▒▒▒)▒jW▒,▒▒e▒▒e▒_▒d▒r2▒▒▒▒▒u4▒▒v▒-▒▒▒▒▒q▒▒N▒▒Y=<▒▒t▒ؖ˹E▒▒▒gm▒}Xؾ▒▒Q▒▒▒▒5ڇ˶▒격▒_̞ز▒3▒▒▒;▒▒D{▒ʹ▒▒▒▒j^1▒o^▒▒▒▒-▒▒?*▒i▒ʿy0▒▒▒eHe▒bV▒+슯i▒ʿy▒:▒▒▒CZ▒-▒m▒:▒I▒i▒ҿy▒▒▒:K▒▒▒2015-06-08
16:32:47.340 1871 ERROR oslo.messaging._drivers.impl_rabbit [-] Failed to
consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:32:47.340 1871 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:32:48.520 1871 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:32:50.527 1871 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:58:46.989 1871 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.989 1871 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:58:47.996 1871 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:58:50.006 1871 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:20:45.988 1871 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.988 1871 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:20:46.996 1871 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 17:20:49.003 1871 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:51:02.646 29233 DEBUG nova.openstack.common.service [-]
fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:51:02.660 29233 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:51:02.885 29233 DEBUG oslo.db.sqlalchemy.session
[req-500f71f2-1782-459a-ab90-20524d05eaf6 ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-08 16:32:47.352 22642 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:32:47.352 22642 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:32:48.520 22642 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:32:50.528 22642 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 16:58:46.984 22642 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 16:58:46.984 22642 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 16:58:47.993 22642 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 16:58:50.002 22642 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:20:45.977 22642 ERROR oslo.messaging._drivers.impl_rabbit [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2015-06-08 17:20:45.977 22642 TRACE oslo.messaging._drivers.impl_rabbit
error: [Errno 104] Connection reset by peer
2015-06-08 17:20:46.985 22642 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 1 seconds.
2015-06-08 17:20:48.996 22642 ERROR oslo.messaging._drivers.impl_rabbit [-]
AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED.
Trying again in 3 seconds.
2015-06-08 17:51:07.143 29253 DEBUG nova.openstack.common.service [-]
fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:51:07.157 29253 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:51:07.390 29253 DEBUG oslo.db.sqlalchemy.session
[req-dc289654-686f-4a28-af04-56430de70550 ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
PuTTYPuTTY2015-06-08 17:53:00.371 29383 DEBUG nova.openstack.common.service
[-] fatal_exception_format_errors  = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:53:00.385 29383 DEBUG nova.openstack.common.service [-]
publish_errors                 = False log_opt_values
/usr/lib/python2.7/dist-packages/oslo/config/cfg.py:1992
2015-06-08 17:53:00.615 29383 DEBUG oslo.db.sqlalchemy.session
[req-12b80e2f-28fb-4f95-aca0-e72dde7c7dc4 ] MySQL server mode set to
STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
_init_events
/usr/lib/python2.7/dist-packages/oslo/db/sqlalchemy/session.py:461
2015-06-03 16:46:08.989 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:14.003 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:21.017 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:30.033 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:41.052 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:46:54.073 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:47:09.096 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:47:26.115 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:47:45.129 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:48:06.151 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:48:29.166 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:48:54.182 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:49:21.200 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:49:50.237 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:50:21.274 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:50:54.315 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:51:28.356 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:52:02.372 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:52:36.414 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:53:10.436 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:53:44.475 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:54:18.516 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:54:52.532 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:55:26.574 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:56:00.616 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:56:34.657 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:57:08.693 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:57:42.735 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:58:16.777 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:58:50.819 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:59:24.836 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 16:59:58.877 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:00:32.894 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:01:06.936 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:01:40.978 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:02:15.019 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:02:49.060 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:03:23.100 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:03:57.141 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:04:31.182 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:05:05.201 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:05:39.241 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:06:13.282 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:06:47.304 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:07:21.337 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:07:55.373 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:08:29.414 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:09:03.456 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:09:37.490 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:10:11.531 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:10:45.573 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:11:19.595 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:11:53.618 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:12:27.654 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:13:01.684 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:13:35.698 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:14:09.721 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:14:43.763 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:15:17.803 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:15:51.820 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:16:25.862 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-03 17:16:59.881 21351 ERROR oslo.messaging._drivers.impl_rabbit
[req-517047c1-5b04-4ca6-964f-159d06fa772e ] AMQP server localhost:5672
closed the connection. Check login credentials: Socket closed
2015-06-04 13:57:10.964 1126 ERROR nova.openstack.common.threadgroup [-]
(OperationalError) (2003, "Can't connect to MySQL server on 'controller'
(111)") None None
2015-06-04 13:57:10.964 1126 TRACE nova.openstack.common.threadgroup
OperationalError: (OperationalError) (2003, "Can't connect to MySQL server
on 'controller' (111)") None None
2015-06-04 14:59:43.576 1169 ERROR nova.openstack.common.threadgroup [-]
(OperationalError) (2003, "Can't connect to MySQL server on 'controller'
(111)") None None
2015-06-04 14:59:43.576 1169 TRACE nova.openstack.common.threadgroup
OperationalError: (OperationalError) (2003, "Can't connect to MySQL server
on 'controller' (111)") None None

We have checked all conf files but we couldn't find localhost entry.

Any help regrading this issue, as we are stuck here and cannot move further.

Thanks
Vikrant


On Mon, Jun 8, 2015 at 11:58 AM, Abhishek Shrivastava <
abhishek at cloudbyte.com> wrote:

> Well Vikrant, as you mentioned that you are not using devstack so in that
> case you need to add the services manually to the compute node (or better
> try to search for nova.conf), so that you can use console services of nova.
> Also after adding those service you need to restart the services in all of
> the nodes.
>
> On Mon, Jun 8, 2015 at 11:41 AM, vikrant ambedkar <ambedkar.viki at gmail.com
> > wrote:
>
>> Hi Abhishek,
>>
>> We don't use devstack or any other available ready made packages for
>> installation. As we are using it for production purposes and we have
>> followed official document of openstack Juno.
>>
>> Is it related to network configuration which we done on network node or
>> controller node ?
>>
>> Or related to private and external network created on dashboard before
>> launching any instance ?
>>
>> Thanks
>> Vikrant
>>
>> On Mon, Jun 8, 2015 at 11:18 AM, Abhishek Shrivastava <
>> abhishek at cloudbyte.com> wrote:
>>
>>> Hi Vikrant,
>>>
>>> Sorry for the late reply. So you need to add it on that node where
>>> DevStack has been installed. If you have not installed devstack then the
>>> documentation which you are following is outdated, so you have to search
>>> for the updated document where they have included those services.
>>>
>>> On Sun, Jun 7, 2015 at 1:26 AM, vikrant ambedkar <
>>> ambedkar.viki at gmail.com> wrote:
>>>
>>>> Hi Abhishek,
>>>>
>>>> Thank you for valuable response.
>>>> Just wanted to know that on which node we suppose to add this
>>>> configuration ?
>>>>
>>>> We have controller, network and compute node.
>>>>
>>>> Also as we already have added Ubuntu and windows bootable ISO image and
>>>> we are using the same.
>>>>
>>>> Thanks
>>>> Vikrant
>>>> On Jun 6, 2015 11:29 PM, "Abhishek Shrivastava" <abhishek at cloudbyte.com>
>>>> wrote:
>>>>
>>>>> Hi Vikrant,
>>>>>
>>>>> To solve this issue, you need to include following in the
>>>>> ENABLED_SERVICES in your local.conf file:
>>>>>
>>>>>    - ENABLED_SERVICES+=n-novnc,n-xvnc,n-cauth
>>>>>
>>>>> Also while creating an instance, create a bootable volume from the
>>>>> image then create the instance it will be easy and more efficient.
>>>>>
>>>>> On Sat, Jun 6, 2015 at 7:26 PM, vikrant ambedkar <
>>>>> ambedkar.viki at gmail.com> wrote:
>>>>>
>>>>>> Hi
>>>>>>
>>>>>>
>>>>>>
>>>>>> Followed your open stack installation juno guide and successfully
>>>>>> done with the same.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Now we are trying to launch an instance but getting an error.
>>>>>>
>>>>>>
>>>>>>
>>>>>> Please provide the solution ASAP.
>>>>>>
>>>>>>
>>>>>> Just for the information we haven't configure cinder. We only
>>>>>> configure keystone, nova, neutron, glance.
>>>>>>
>>>>>>
>>>>>> Following are the configuration of our OpneStack Setup.
>>>>>>
>>>>>> Controller node - keystone, mysql, rasbbitmq, and remaining
>>>>>> recommended nova and neutron api.
>>>>>>
>>>>>> Neutron node - neutron service
>>>>>>
>>>>>> compute - nova service
>>>>>>
>>>>>>
>>>>>>
>>>>>> PFA Screenshot .
>>>>>>
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>> Vikrant
>>>>>>
>>>>>> _______________________________________________
>>>>>> Mailing list:
>>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>>> Post to     : openstack at lists.openstack.org
>>>>>> Unsubscribe :
>>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>> *Thanks & Regards,*
>>>>> *Abhishek*
>>>>> *Cloudbyte Inc. <http://www.cloudbyte.com>*
>>>>>
>>>>
>>>
>>>
>>> --
>>>
>>>
>>> *Thanks & Regards,*
>>> *Abhishek*
>>> *Cloudbyte Inc. <http://www.cloudbyte.com>*
>>>
>>
>>
>
>
> --
>
>
> *Thanks & Regards,*
> *Abhishek*
> *Cloudbyte Inc. <http://www.cloudbyte.com>*
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20150608/96ae91d5/attachment.html>