[Openstack] gateway in router is in down state

Srinivasreddy R srinivasreddy4390 at gmail.com
Tue Sep 16 18:01:30 UTC 2014


hi,
frequently i am getting the error  on my compute node and network node
when i run commands for ovs .
but if is restarted the openvswitch services it is working fine and after
some time giving same error  .

2014-09-17T01:38:54Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)
ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed
(Protocol error)

pls fine logs in /var/log/neutron/



=================================================================

openvswitch-agent.log :

================================================================


 stdout: ''
Stderr: 'sudo: unable to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:19Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:19.942 1860 ERROR
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while
processing VIF ports
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent
call last):
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 1322, in rpc_loop
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info =
self.scan_ports(reg_ports, updated_ports_copy)
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 873, in scan_ports
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports =
self.int_br.get_vif_port_set()
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
330, in get_vif_port_set
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names =
self.get_port_name_list()
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
286, in get_port_name_list
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     res =
self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 75,
in run_vsctl
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/excutils.py",
line 82, in __exit__
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
six.reraise(self.type_, self.value, self.tb)
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 68,
in run_vsctl
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     return
utils.execute(full_args, root_helper=self.root_helper)
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 76,
in execute
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise
RuntimeError(m)
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError:
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo',
'/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl',
'--timeout=10', 'list-ports', 'br-int']
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'sudo: unable
to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:19Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:19.942 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
2014-09-17 06:59:21.855 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync
with plugin!
2014-09-17 06:59:21.943 1860 ERROR neutron.agent.linux.ovs_lib [-] Unable
to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'].
Exception:
Command: ['sudo', '/usr/bin/neutron-rootwrap',
'/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports',
'br-int']
Exit code: 1
Stdout: ''
Stderr: 'sudo: unable to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:21Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:21.943 1860 ERROR
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while
processing VIF ports
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent
call last):
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 1322, in rpc_loop
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info =
self.scan_ports(reg_ports, updated_ports_copy)
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 873, in scan_ports
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports =
self.int_br.get_vif_port_set()
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
330, in get_vif_port_set
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names =
self.get_port_name_list()
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
286, in get_port_name_list
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     res =
self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 75,
in run_vsctl
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/excutils.py",
line 82, in __exit__
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
six.reraise(self.type_, self.value, self.tb)
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 68,
in run_vsctl
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     return
utils.execute(full_args, root_helper=self.root_helper)
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 76,
in execute
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise
RuntimeError(m)
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError:
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo',
'/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl',
'--timeout=10', 'list-ports', 'br-int']
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'sudo: unable
to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:21Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:21.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
2014-09-17 06:59:23.857 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync
with plugin!
2014-09-17 06:59:23.939 1860 ERROR neutron.agent.linux.ovs_lib [-] Unable
to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'].
Exception:
Command: ['sudo', '/usr/bin/neutron-rootwrap',
'/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports',
'br-int']
Exit code: 1
Stdout: ''
Stderr: 'sudo: unable to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:23Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:23.940 1860 ERROR
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while
processing VIF ports
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent
call last):
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 1322, in rpc_loop
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info =
self.scan_ports(reg_ports, updated_ports_copy)
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 873, in scan_ports
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports =
self.int_br.get_vif_port_set()
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
330, in get_vif_port_set
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names =
self.get_port_name_list()
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
286, in get_port_name_list
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     res =
self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 75,
in run_vsctl
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/excutils.py",
line 82, in __exit__
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
six.reraise(self.type_, self.value, self.tb)
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 68,
in run_vsctl
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     return
utils.execute(full_args, root_helper=self.root_helper)
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 76,
in execute
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise
RuntimeError(m)
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError:
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo',
'/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl',
'--timeout=10', 'list-ports', 'br-int']
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'sudo: unable
to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:23Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:23.940 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
2014-09-17 06:59:25.858 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync
with plugin!
2014-09-17 06:59:25.921 1860 ERROR neutron.agent.linux.ovs_lib [-] Unable
to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'].
Exception:
Command: ['sudo', '/usr/bin/neutron-rootwrap',
'/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports',
'br-int']
Exit code: 1
Stdout: ''
Stderr: 'sudo: unable to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:25Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:25.921 1860 ERROR
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while
processing VIF ports
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent
call last):
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 1322, in rpc_loop
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info =
self.scan_ports(reg_ports, updated_ports_copy)
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 873, in scan_ports
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports =
self.int_br.get_vif_port_set()
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
330, in get_vif_port_set
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names =
self.get_port_name_list()
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
286, in get_port_name_list
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     res =
self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 75,
in run_vsctl
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/excutils.py",
line 82, in __exit__
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
six.reraise(self.type_, self.value, self.tb)
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 68,
in run_vsctl
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     return
utils.execute(full_args, root_helper=self.root_helper)
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 76,
in execute
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise
RuntimeError(m)
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError:
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo',
'/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl',
'--timeout=10', 'list-ports', 'br-int']
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'sudo: unable
to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:25Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:25.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
2014-09-17 06:59:27.860 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync
with plugin!
2014-09-17 06:59:27.921 1860 ERROR neutron.agent.linux.ovs_lib [-] Unable
to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'].
Exception:
Command: ['sudo', '/usr/bin/neutron-rootwrap',
'/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports',
'br-int']
Exit code: 1
Stdout: ''
Stderr: 'sudo: unable to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:27Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:27.921 1860 ERROR
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while
processing VIF ports
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent
call last):
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 1322, in rpc_loop
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info =
self.scan_ports(reg_ports, updated_ports_copy)
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 873, in scan_ports
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports =
self.int_br.get_vif_port_set()
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
330, in get_vif_port_set
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names =
self.get_port_name_list()
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
286, in get_port_name_list
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     res =
self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 75,
in run_vsctl
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/excutils.py",
line 82, in __exit__
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
six.reraise(self.type_, self.value, self.tb)
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 68,
in run_vsctl
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     return
utils.execute(full_args, root_helper=self.root_helper)
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 76,
in execute
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise
RuntimeError(m)
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError:
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo',
'/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl',
'--timeout=10', 'list-ports', 'br-int']
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'sudo: unable
to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:27Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:27.921 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
2014-09-17 06:59:29.862 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync
with plugin!
2014-09-17 06:59:29.943 1860 ERROR neutron.agent.linux.ovs_lib [-] Unable
to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'].
Exception:
Command: ['sudo', '/usr/bin/neutron-rootwrap',
'/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports',
'br-int']
Exit code: 1
Stdout: ''
Stderr: 'sudo: unable to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:29Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:29.943 1860 ERROR
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while
processing VIF ports
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent
call last):
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 1322, in rpc_loop
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info =
self.scan_ports(reg_ports, updated_ports_copy)
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 873, in scan_ports
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports =
self.int_br.get_vif_port_set()
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
330, in get_vif_port_set
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names =
self.get_port_name_list()
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
286, in get_port_name_list
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     res =
self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 75,
in run_vsctl
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/excutils.py",
line 82, in __exit__
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
six.reraise(self.type_, self.value, self.tb)
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 68,
in run_vsctl
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     return
utils.execute(full_args, root_helper=self.root_helper)
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 76,
in execute
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise
RuntimeError(m)
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError:
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo',
'/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl',
'--timeout=10', 'list-ports', 'br-int']
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'sudo: unable
to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:29Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:29.943 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
2014-09-17 06:59:31.861 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync
with plugin!
2014-09-17 06:59:31.931 1860 ERROR neutron.agent.linux.ovs_lib [-] Unable
to execute ['ovs-vsctl', '--timeout=10', 'list-ports', 'br-int'].
Exception:
Command: ['sudo', '/usr/bin/neutron-rootwrap',
'/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', 'list-ports',
'br-int']
Exit code: 1
Stdout: ''
Stderr: 'sudo: unable to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:31Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:31.931 1860 ERROR
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while
processing VIF ports
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent
call last):
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 1322, in rpc_loop
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info =
self.scan_ports(reg_ports, updated_ports_copy)
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py",
line 873, in scan_ports
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     cur_ports =
self.int_br.get_vif_port_set()
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
330, in get_vif_port_set
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_names =
self.get_port_name_list()
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line
286, in get_port_name_list
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     res =
self.run_vsctl(["list-ports", self.br_name], check_error=True)
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 75,
in run_vsctl
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     ctxt.reraise = False
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/excutils.py",
line 82, in __exit__
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
six.reraise(self.type_, self.value, self.tb)
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovs_lib.py", line 68,
in run_vsctl
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     return
utils.execute(full_args, root_helper=self.root_helper)
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 76,
in execute
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent     raise
RuntimeError(m)
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent RuntimeError:
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Command: ['sudo',
'/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl',
'--timeout=10', 'list-ports', 'br-int']
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Exit code: 1
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stdout: ''
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent Stderr: 'sudo: unable
to resolve host
user-ThinkCentre-M73\n2014-09-17T01:29:31Z|00001|reconnect|WARN|unix:/var/run/openvswitch/db.sock:
connection attempt failed (Protocol error)\novs-vsctl:
unix:/var/run/openvswitch/db.sock: database connection failed (Protocol
error)\n'
2014-09-17 06:59:31.931 1860 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent
2014-09-17 06:59:33.861 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync
with plugin!
2014-09-17 06:59:35.058 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent tunnel out of
sync with plugin!
2014-09-17 06:59:35.465 1860 INFO neutron.agent.securitygroups_rpc [-]
Preparing filters for devices set([u'ca97287a-ea49-4f8e-907e-e1b1e579c07f',
u'72d38d5b-5c5d-4e93-a5bd-76b4f2520fef',
u'f2369cf5-a41f-4dca-ab86-fd9be2f65aff'])
2014-09-17 06:59:36.435 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port
ca97287a-ea49-4f8e-907e-e1b1e579c07f updated. Details: {u'admin_state_up':
True, u'network_id': u'8bf0432f-494e-4320-8bbf-86b47a2754af',
u'segmentation_id': 1, u'physical_network': None, u'device':
u'ca97287a-ea49-4f8e-907e-e1b1e579c07f', u'port_id':
u'ca97287a-ea49-4f8e-907e-e1b1e579c07f', u'network_type': u'gre'}
2014-09-17 06:59:36.436 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 1 as
local vlan for net-id=8bf0432f-494e-4320-8bbf-86b47a2754af
2014-09-17 06:59:36.705 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for
device ca97287a-ea49-4f8e-907e-e1b1e579c07f completed.
2014-09-17 06:59:36.796 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port
72d38d5b-5c5d-4e93-a5bd-76b4f2520fef updated. Details: {u'admin_state_up':
True, u'network_id': u'8873c70c-7723-4078-b972-1086af0367da',
u'segmentation_id': 2, u'physical_network': None, u'device':
u'72d38d5b-5c5d-4e93-a5bd-76b4f2520fef', u'port_id':
u'72d38d5b-5c5d-4e93-a5bd-76b4f2520fef', u'network_type': u'gre'}
2014-09-17 06:59:36.796 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 2 as
local vlan for net-id=8873c70c-7723-4078-b972-1086af0367da
2014-09-17 06:59:37.051 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for
device 72d38d5b-5c5d-4e93-a5bd-76b4f2520fef completed.
2014-09-17 06:59:37.151 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port
f2369cf5-a41f-4dca-ab86-fd9be2f65aff updated. Details: {u'admin_state_up':
True, u'network_id': u'8873c70c-7723-4078-b972-1086af0367da',
u'segmentation_id': 2, u'physical_network': None, u'device':
u'f2369cf5-a41f-4dca-ab86-fd9be2f65aff', u'port_id':
u'f2369cf5-a41f-4dca-ab86-fd9be2f65aff', u'network_type': u'gre'}
2014-09-17 06:59:37.151 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 2 as
local vlan for net-id=8873c70c-7723-4078-b972-1086af0367da
2014-09-17 06:59:37.378 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for
device f2369cf5-a41f-4dca-ab86-fd9be2f65aff completed.
2014-09-17 06:59:40.045 1860 ERROR neutron.agent.linux.ovsdb_monitor [-]
Error received from ovsdb monitor: sudo: unable to resolve host
user-ThinkCentre-M73
2014-09-17 07:00:10.116 1860 ERROR neutron.agent.linux.ovsdb_monitor [-]
Error received from ovsdb monitor: sudo: unable to resolve host
user-ThinkCentre-M73


 ===========================================================================



 ============


 l3-agent.log


 ===========================================================================

014-09-17 06:05:22.628 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:05:22.628 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:05:22.628 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:05:22.628 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:05:22.628 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:05:22.628 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:05:22.628 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:06:02.606 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:06:02.606 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:06:02.606 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:06:02.606 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:06:02.606 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:06:02.606 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:06:02.606 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:06:02.606 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:06:02.606 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:06:02.606 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:06:42.602 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:06:42.602 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:06:42.602 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:06:42.602 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:06:42.602 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:06:42.602 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:06:42.602 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:06:42.602 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:06:42.602 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:06:42.602 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:07:22.599 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:07:22.599 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:07:22.599 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:07:22.599 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:07:22.599 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:07:22.599 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:07:22.599 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:07:22.599 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:07:22.599 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:07:22.599 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:08:02.621 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:08:02.621 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:08:02.621 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:08:02.621 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:08:02.621 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:08:02.621 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:08:02.621 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:08:02.621 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:08:02.621 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:08:02.621 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:08:42.603 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:08:42.603 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:08:42.603 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:08:42.603 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:08:42.603 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:08:42.603 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:08:42.603 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:08:42.603 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:08:42.603 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:08:42.603 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:09:22.605 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:09:22.605 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:09:22.605 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:09:22.605 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:09:22.605 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:09:22.605 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:09:22.605 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:09:22.605 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:09:22.605 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:09:22.605 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:10:02.606 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:10:02.606 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:10:02.606 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:10:02.606 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:10:02.606 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:10:02.606 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:10:02.606 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:10:02.606 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:10:02.606 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:10:02.606 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:10:42.629 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:10:42.629 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:10:42.629 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:10:42.629 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:10:42.629 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:10:42.629 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:10:42.629 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:10:42.629 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:10:42.629 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:10:42.629 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:11:22.597 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:11:22.597 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:11:22.597 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:11:22.597 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:11:22.597 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:11:22.597 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:11:22.597 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:11:22.597 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:11:22.597 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:11:22.597 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:12:02.623 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:12:02.623 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:12:02.623 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:12:02.623 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:12:02.623 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:12:02.623 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:12:02.623 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:12:02.623 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:12:02.623 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:12:02.623 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:12:42.624 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:12:42.624 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:12:42.624 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:12:42.624 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:12:42.624 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:12:42.624 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:12:42.624 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:12:42.624 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:12:42.624 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:12:42.624 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:13:22.604 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:13:22.604 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:13:22.604 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:13:22.604 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:13:22.604 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:13:22.604 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:13:22.604 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:13:22.604 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:13:22.604 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:13:22.604 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:14:02.657 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:14:02.657 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:14:02.657 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:14:02.657 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:14:02.657 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:14:02.657 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:14:02.657 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:14:02.657 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:14:02.657 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:14:02.657 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:14:37.831 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:14:37.831 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:14:37.831 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 830, in
_rpc_loop
2014-09-17 06:14:37.831 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers)
2014-09-17 06:14:37.831 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:14:37.831 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:14:37.831 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:14:37.831 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:14:37.831 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:14:37.831 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:14:42.621 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 06:14:42.621 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 06:14:42.621 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 06:14:42.621 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 06:14:42.621 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 06:14:42.621 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 06:14:42.621 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 06:14:42.621 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 06:14:42.621 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 06:14:42.621 1863 TRACE neutron.agent.l3_agent
2014-09-17 06:14:58.814 1863 WARNING neutron.agent.l3_agent [-] Info for
router b68b98e4-ca9c-40ff-8d3a-57c7914a97b6 were not found. Skipping router
removal





 ========================================================================


 l3-agent.log.1

=========================================================================



 14-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqp.py", line 90,
in drain_events
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
return connection.drain_events(**kwargs)
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 303, in
drain_events
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
return amqp_method(channel, args)
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 506, in
_close
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
self._x_close_ok()
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 534, in
_x_close_ok
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
self._send_method((10, 51))
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 62,
in _send_method
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
self.channel_id, method_sig, args, content,
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/method_framing.py", line 227,
in write_method
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
write_frame(1, channel, payload)
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/transport.py", line 183, in
write_frame
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
frame_type, channel, size, payload, 0xce,
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 307, in
sendall
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
tail = self.send(data, flags)
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 293, in
send
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
total_sent += fd.send(data[total_sent:], flags)
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
error: [Errno 104] Connection reset by peer
2014-09-17 04:46:43.193 1863 TRACE neutron.openstack.common.rpc.common
2014-09-17 04:46:43.194 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:46:43.198 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1
seconds.
2014-09-17 04:46:43.199 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1
seconds.
2014-09-17 04:46:44.199 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:46:44.203 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:46:44.206 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3
seconds.
2014-09-17 04:46:44.206 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 3
seconds.
2014-09-17 04:46:47.206 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:46:47.213 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:46:47.219 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5
seconds.
2014-09-17 04:46:47.219 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 5
seconds.
2014-09-17 04:46:49.451 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Failed to publish message
to topic 'q-plugin': [Errno 104] Connection reset by peer
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
Traceback (most recent call last):
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/impl_kombu.py",
line 579, in ensure
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
return method(*args, **kwargs)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/impl_kombu.py",
line 690, in _publish
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
publisher = cls(self.conf, self.channel, topic, **kwargs)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/impl_kombu.py",
line 368, in __init__
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
**options)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/impl_kombu.py",
line 315, in __init__
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
self.reconnect(channel)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/impl_kombu.py",
line 323, in reconnect
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
routing_key=self.routing_key)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 82, in
__init__
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
self.revive(self._channel)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 216, in
revive
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
self.declare()
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/kombu/messaging.py", line 102, in
declare
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
self.exchange.declare()
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/kombu/entity.py", line 166, in
declare
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
nowait=nowait, passive=passive,
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/channel.py", line 604, in
exchange_declare
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
self._send_method((40, 10), args)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 62,
in _send_method
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
self.channel_id, method_sig, args, content,
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/method_framing.py", line 227,
in write_method
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
write_frame(1, channel, payload)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/transport.py", line 183, in
write_frame
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
frame_type, channel, size, payload, 0xce,
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 307, in
sendall
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
tail = self.send(data, flags)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 293, in
send
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
total_sent += fd.send(data[total_sent:], flags)
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
error: [Errno 104] Connection reset by peer
2014-09-17 04:46:49.451 1863 TRACE neutron.openstack.common.rpc.common
2014-09-17 04:46:49.452 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:46:52.219 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:46:52.235 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:46:54.456 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: timed out. Trying again in 1 seconds.
2014-09-17 04:46:55.457 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:46:57.235 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: timed out. Trying again in 7 seconds.
2014-09-17 04:46:57.244 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: timed out. Trying again in 7 seconds.
2014-09-17 04:46:58.238 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 3
seconds.
2014-09-17 04:47:01.239 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:04.236 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:04.244 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:04.253 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 5
seconds.
2014-09-17 04:47:04.253 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 9
seconds.
2014-09-17 04:47:07.246 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 9
seconds.
2014-09-17 04:47:09.253 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:10.246 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 7
seconds.
2014-09-17 04:47:13.254 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:16.247 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:16.262 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in
11 seconds.
2014-09-17 04:47:16.262 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in
11 seconds.
2014-09-17 04:47:17.247 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:19.261 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 9
seconds.
2014-09-17 04:47:27.262 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:27.282 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:27.289 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
13 seconds.
2014-09-17 04:47:27.290 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
13 seconds.
2014-09-17 04:47:28.262 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:28.281 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
11 seconds.
2014-09-17 04:47:39.282 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:39.286 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
13 seconds.
2014-09-17 04:47:40.290 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:40.293 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:40.297 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
15 seconds.
2014-09-17 04:47:40.297 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
15 seconds.
2014-09-17 04:47:52.286 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:52.291 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
15 seconds.
2014-09-17 04:47:55.297 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:55.313 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:47:55.317 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
17 seconds.
2014-09-17 04:47:55.317 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
17 seconds.
2014-09-17 04:48:07.291 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:48:07.298 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
17 seconds.
2014-09-17 04:48:12.317 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:48:12.322 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:48:12.349 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
19 seconds.
2014-09-17 04:48:12.349 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
19 seconds.
2014-09-17 04:48:24.299 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:48:24.312 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
19 seconds.
2014-09-17 04:48:31.349 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:48:31.359 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:48:31.371 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
21 seconds.
2014-09-17 04:48:31.372 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
21 seconds.
2014-09-17 04:48:43.313 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:48:43.326 1863 ERROR neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] AMQP server on
controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in
21 seconds.
2014-09-17 04:48:52.372 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:48:52.376 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:48:52.382 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Connected to AMQP server on
controller:5672
2014-09-17 04:48:52.385 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Connected to AMQP server on
controller:5672
2014-09-17 04:49:04.327 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Reconnecting to AMQP server
on controller:5672
2014-09-17 04:49:04.334 1863 INFO neutron.openstack.common.rpc.common
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] Connected to AMQP server on
controller:5672
2014-09-17 04:49:04.338 1863 WARNING neutron.openstack.common.loopingcall
[req-2bfc2d95-c53b-446f-8d7b-6db4dd414d1b None] task run outlasted interval
by 104.887212 sec
2014-09-17 05:02:24.924 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 05:02:24.924 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 05:02:24.924 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 830, in
_rpc_loop
2014-09-17 05:02:24.924 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers)
2014-09-17 05:02:24.924 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 05:02:24.924 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 05:02:24.924 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 05:02:24.924 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 05:02:24.924 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 05:02:24.924 1863 TRACE neutron.agent.l3_agent
2014-09-17 05:02:42.584 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 05:02:42.584 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 05:02:42.584 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 05:02:42.584 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 05:02:42.584 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 05:02:42.584 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 05:02:42.584 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 05:02:42.584 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 05:02:42.584 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 05:02:42.584 1863 TRACE neutron.agent.l3_agent
2014-09-17 05:02:46.926 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 05:02:46.926 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 05:02:46.926 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 830, in
_rpc_loop
2014-09-17 05:02:46.926 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers)
2014-09-17 05:02:46.926 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 05:02:46.926 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 05:02:46.926 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 05:02:46.926 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 05:02:46.926 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 05:02:46.926 1863 TRACE neutron.agent.l3_agent
2014-09-17 05:03:22.587 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 05:03:22.587 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 05:03:22.587 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 05:03:22.587 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 05:03:22.587 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 05:03:22.587 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 05:03:22.587 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 05:03:22.587 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 05:03:22.587 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 05:03:22.587 1863 TRACE neutron.agent.l3_agent
2014-09-17 05:04:02.574 1863 ERROR neutron.agent.l3_agent [-] Failed
synchronizing routers
2014-09-17 05:04:02.574 1863 TRACE neutron.agent.l3_agent Traceback (most
recent call last):
2014-09-17 05:04:02.574 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 864, in
_sync_routers_task
2014-09-17 05:04:02.574 1863 TRACE neutron.agent.l3_agent
self._process_routers(routers, all_routers=True)
2014-09-17 05:04:02.574 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 793, in
_process_routers
2014-09-17 05:04:02.574 1863 TRACE neutron.agent.l3_agent     if (ex_net_id
!= self._fetch_external_net_id(force=True)):
2014-09-17 05:04:02.574 1863 TRACE neutron.agent.l3_agent   File
"/usr/lib/python2.7/dist-packages/neutron/agent/l3_agent.py", line 337, in
_fetch_external_net_id
2014-09-17 05:04:02.574 1863 TRACE neutron.agent.l3_agent     raise
Exception(msg)
2014-09-17 05:04:02.574 1863 TRACE neutron.agent.l3_agent Exception: The
'gateway_external_network_id' option must be configured for this agent as
Neutron has more than one external network.
2014-09-17 05:04:02.574 1863 TRACE neutron.agent.l3_agent




 ===================================================================


 openvswitch-agent.log.1

===================================================================


 2014-09-17 04:44:20.454 2598 TRACE neutron
2014-09-17 04:45:19.273 1860 INFO neutron.common.config [-] Logging enabled!
2014-09-17 04:45:19.534 1860 INFO neutron.openstack.common.rpc.common
[req-f8b300a4-b73d-4e15-bd0d-0fc7475b143a None] Connected to AMQP server on
controller:5672
2014-09-17 04:45:19.549 1860 INFO neutron.openstack.common.rpc.common
[req-f8b300a4-b73d-4e15-bd0d-0fc7475b143a None] Connected to AMQP server on
controller:5672
2014-09-17 04:45:19.990 1860 WARNING neutron.agent.securitygroups_rpc
[req-8520e19e-c8f8-423a-9d07-501c1fe69c72 None] Security group agent
binding currently not set. This should be set by the end of the init
process.
2014-09-17 04:45:20.335 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent initialized
successfully, now running...
2014-09-17 04:45:20.338 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync
with plugin!
2014-09-17 04:45:20.341 1860 ERROR neutron.agent.linux.ovsdb_monitor [-]
Error received from ovsdb monitor: sudo: unable to resolve host
user-ThinkCentre-M73
2014-09-17 04:45:20.477 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent tunnel out of
sync with plugin!
2014-09-17 04:45:20.483 1860 INFO neutron.openstack.common.rpc.common [-]
Connected to AMQP server on controller:5672
2014-09-17 04:45:20.696 1860 INFO neutron.agent.securitygroups_rpc [-]
Preparing filters for devices set([u'ca97287a-ea49-4f8e-907e-e1b1e579c07f',
u'f2369cf5-a41f-4dca-ab86-fd9be2f65aff'])
2014-09-17 04:45:22.747 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port
ca97287a-ea49-4f8e-907e-e1b1e579c07f updated. Details: {u'admin_state_up':
True, u'network_id': u'8bf0432f-494e-4320-8bbf-86b47a2754af',
u'segmentation_id': 1, u'physical_network': None, u'device':
u'ca97287a-ea49-4f8e-907e-e1b1e579c07f', u'port_id':
u'ca97287a-ea49-4f8e-907e-e1b1e579c07f', u'network_type': u'gre'}
2014-09-17 04:45:22.748 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 1 as
local vlan for net-id=8bf0432f-494e-4320-8bbf-86b47a2754af
2014-09-17 04:45:23.010 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for
device ca97287a-ea49-4f8e-907e-e1b1e579c07f completed.
2014-09-17 04:45:23.071 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port
f2369cf5-a41f-4dca-ab86-fd9be2f65aff updated. Details: {u'admin_state_up':
True, u'network_id': u'8873c70c-7723-4078-b972-1086af0367da',
u'segmentation_id': 2, u'physical_network': None, u'device':
u'f2369cf5-a41f-4dca-ab86-fd9be2f65aff', u'port_id':
u'f2369cf5-a41f-4dca-ab86-fd9be2f65aff', u'network_type': u'gre'}
2014-09-17 04:45:23.071 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Assigning 2 as
local vlan for net-id=8873c70c-7723-4078-b972-1086af0367da
2014-09-17 04:45:23.338 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for
device f2369cf5-a41f-4dca-ab86-fd9be2f65aff completed.
2014-09-17 04:45:25.493 1860 INFO neutron.agent.securitygroups_rpc [-]
Preparing filters for devices set([u'72d38d5b-5c5d-4e93-a5bd-76b4f2520fef'])
2014-09-17 04:45:25.936 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Port
72d38d5b-5c5d-4e93-a5bd-76b4f2520fef updated. Details: {u'admin_state_up':
True, u'network_id': u'8873c70c-7723-4078-b972-1086af0367da',
u'segmentation_id': 2, u'physical_network': None, u'device':
u'72d38d5b-5c5d-4e93-a5bd-76b4f2520fef', u'port_id':
u'72d38d5b-5c5d-4e93-a5bd-76b4f2520fef', u'network_type': u'gre'}
2014-09-17 04:45:26.148 1860 INFO
neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Configuration for
device 72d38d5b-5c5d-4e93-a5bd-76b4f2520fef completed.
2014-09-17 04:45:50.574 1860 ERROR neutron.agent.linux.ovsdb_monitor [-]
Error received from ovsdb monitor: sudo: unable to resolve host
user-ThinkCentre-M73
2014-09-17 04:46:20.631 1860 ERROR neutron.agent.linux.ovsdb_monitor [-]
Error received from ovsdb monitor: sudo: unable to resolve host
user-ThinkCentre-M73
2014-09-17 04:46:43.114 1860 ERROR neutron.openstack.common.rpc.common [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
Traceback (most recent call last):
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/impl_kombu.py",
line 579, in ensure
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
return method(*args, **kwargs)
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/impl_kombu.py",
line 659, in _consume
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
return self.connection.drain_events(timeout=timeout)
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 279, in
drain_events
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
return self.transport.drain_events(self.connection, **kwargs)
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqp.py", line 90,
in drain_events
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
return connection.drain_events(**kwargs)
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 303, in
drain_events
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
return amqp_method(channel, args)
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 506, in
_close
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
self._x_close_ok()
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 534, in
_x_close_ok
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
self._send_method((10, 51))
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 62,
in _send_method
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
self.channel_id, method_sig, args, content,
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/method_framing.py", line 227,
in write_method
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
write_frame(1, channel, payload)
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/transport.py", line 183, in
write_frame
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
frame_type, channel, size, payload, 0xce,
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 307, in
sendall
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
tail = self.send(data, flags)
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/eventlet/greenio.py", line 293, in
send
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
total_sent += fd.send(data[total_sent:], flags)
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
error: [Errno 104] Connection reset by peer
2014-09-17 04:46:43.114 1860 TRACE neutron.openstack.common.rpc.common
2014-09-17 04:46:43.189 1860 INFO neutron.openstack.common.rpc.common [-]
Reconnecting to AMQP server on controller:5672
2014-09-17 04:46:43.193 1860 ERROR neutron.openstack.common.rpc.common [-]
Failed to consume message from queue: [Errno 104] Connection reset by peer
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
Traceback (most recent call last):
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/impl_kombu.py",
line 579, in ensure
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
return method(*args, **kwargs)
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
File
"/usr/lib/python2.7/dist-packages/neutron/openstack/common/rpc/impl_kombu.py",
line 659, in _consume
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
return self.connection.drain_events(timeout=timeout)
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/kombu/connection.py", line 279, in
drain_events
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
return self.transport.drain_events(self.connection, **kwargs)
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/kombu/transport/pyamqp.py", line 90,
in drain_events
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
return connection.drain_events(**kwargs)
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 303, in
drain_events
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
return amqp_method(channel, args)
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 506, in
_close
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
self._x_close_ok()
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/connection.py", line 534, in
_x_close_ok
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
self._send_method((10, 51))
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.common.rpc.common
File "/usr/lib/python2.7/dist-packages/amqp/abstract_channel.py", line 62,
in _send_method
2014-09-17 04:46:43.193 1860 TRACE neutron.openstack.com



thanks,
srinivas.






On Tue, Sep 16, 2014 at 10:56 PM, Raghu Vadapalli <rvatspacket at gmail.com>
wrote:

> Hi Srinivas,
>
> Any error messages from the /var/log neutron logs ?
>
> Regards,
> Raghu
>
> On Tue, Sep 16, 2014 at 12:59 PM, Srinivasreddy R <
> srinivasreddy4390 at gmail.com> wrote:
>
>> hi,
>> Able to launch  instances in 3 node setup with icehouse installation
>> guide for ubuntu .
>>
>> instances are getting ip and the are able to communicate with each other
>> .
>>
>> but the state of the external gateway of the router is down state .
>> i am not able to communicate from instance to the external network and
>> vice-versa .
>> i have pasted my instance overview in the below link.
>>
>> http://paste.openstack.org/show/112237/
>> i have attached network topology and router configuration .
>>
>> pls help me . how can i proceed further .
>>
>> :
>>
>> thanks,
>> srinivas.
>>
>>
>>
>> _______________________________________________
>> Mailing list:
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>> Post to     : openstack at lists.openstack.org
>> Unsubscribe :
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>
>>
>

On Tue, Sep 16, 2014 at 10:56 PM, Raghu Vadapalli <rvatspacket at gmail.com>
wrote:

> Hi Srinivas,
>
> Any error messages from the /var/log neutron logs ?
>
> Regards,
> Raghu
>
> On Tue, Sep 16, 2014 at 12:59 PM, Srinivasreddy R <
> srinivasreddy4390 at gmail.com> wrote:
>
>> hi,
>> Able to launch  instances in 3 node setup with icehouse installation
>> guide for ubuntu .
>>
>> instances are getting ip and the are able to communicate with each other
>> .
>>
>> but the state of the external gateway of the router is down state .
>> i am not able to communicate from instance to the external network and
>> vice-versa .
>> i have pasted my instance overview in the below link.
>>
>> http://paste.openstack.org/show/112237/
>> i have attached network topology and router configuration .
>>
>> pls help me . how can i proceed further .
>>
>> :
>>
>> thanks,
>> srinivas.
>>
>>
>>
>> _______________________________________________
>> Mailing list:
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>> Post to     : openstack at lists.openstack.org
>> Unsubscribe :
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20140916/726463f1/attachment.html>


More information about the Openstack mailing list