Hi, Error which You pasted looks that is related to moment when router is deleted. Do You have any errors in neutron-server and/or neutron-l3-agent logs during creation of the router? Can You check with command “neutron l3-agent-list-hosting-router <router_id>” by which l3 agent router should be hosted? What kind of router Your are creating? Is it HA, DVR, DVR-HA router? Or maybe Legacy?
On 21 May 2019, at 16:51, Md. Farhad Hasan Khan <rony.khan@novotel-bd.com> wrote:
Hi, I can create router from horizon. But network namespaces not created. I check with # ip netns list command. Not found router ID, but showing in horizon.
Here is some log I get from neutron:
#cat /var/log/neutron/l3-agent.log
2019-05-21 17:35:44.646 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:35:44.646 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:35:44.646 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent ri.delete() 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent self.disable_keepalived() 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent shutil.rmtree(conf_dir) 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent onerror(os.listdir, path, sys.exc_info()) 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent names = os.listdir(path) 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent self._process_router_if_compatible(router) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent self._process_added_router(router) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent self._router_added(router['id'], router) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent router_id) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent self.force_reraise() 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent six.reraise(self.type_, self.value, self.tb) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent ri.initialize(self.process_monitor) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent self.ha_network_added() 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent mtu=self.ha_port.get('mtu')) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent bridge, namespace, prefix, mtu) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent self.check_bridge_exists(bridge) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:35:44.711 52248 WARNING neutron.agent.l3.agent [-] Hit retry limit with router update for cad85ce0-6624-42ff-b42b-09480aea2613, action None: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:35:44.711 52248 WARNING neutron.agent.l3.agent [-] Info for router cad85ce0-6624-42ff-b42b-09480aea2613 was not found. Performing router cleanup: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent [-] Error while initializing router cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent ri.initialize(self.process_monitor) 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent self.ha_network_added() 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent mtu=self.ha_port.get('mtu')) 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent bridge, namespace, prefix, mtu) 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent self.check_bridge_exists(bridge) 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent ri.delete() 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent self.disable_keepalived() 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent shutil.rmtree(conf_dir) 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent onerror(os.listdir, path, sys.exc_info()) 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent names = os.listdir(path) 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent self._process_router_if_compatible(router) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent self._process_added_router(router) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent self._router_added(router['id'], router) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent router_id) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent self.force_reraise() 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent six.reraise(self.type_, self.value, self.tb) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent ri.initialize(self.process_monitor) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent self.ha_network_added() 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent mtu=self.ha_port.get('mtu')) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent bridge, namespace, prefix, mtu) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent self.check_bridge_exists(bridge) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent [-] Error while initializing router cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent ri.initialize(self.process_monitor) 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent self.ha_network_added() 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent mtu=self.ha_port.get('mtu')) 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent bridge, namespace, prefix, mtu) 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent self.check_bridge_exists(bridge) 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent ri.delete() 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent self.disable_keepalived() 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent shutil.rmtree(conf_dir) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent onerror(os.listdir, path, sys.exc_info()) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent names = os.listdir(path) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent self._process_router_if_compatible(router) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent self._process_added_router(router) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent self._router_added(router['id'], router) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent router_id) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent self.force_reraise() 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent six.reraise(self.type_, self.value, self.tb) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent ri.initialize(self.process_monitor) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent self.ha_network_added() 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent mtu=self.ha_port.get('mtu')) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent bridge, namespace, prefix, mtu) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent self.check_bridge_exists(bridge) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent [-] Error while initializing router cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent ri.initialize(self.process_monitor) 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent self.ha_network_added() 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent mtu=self.ha_port.get('mtu')) 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent bridge, namespace, prefix, mtu) 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent self.check_bridge_exists(bridge) 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent ri.delete() 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent self.disable_keepalived() 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent shutil.rmtree(conf_dir) 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent onerror(os.listdir, path, sys.exc_info()) 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent names = os.listdir(path) 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent self._process_router_if_compatible(router) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent self._process_added_router(router) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent self._router_added(router['id'], router) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent router_id) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent self.force_reraise() 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent six.reraise(self.type_, self.value, self.tb) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent ri.initialize(self.process_monitor) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent self.ha_network_added() 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent mtu=self.ha_port.get('mtu')) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent bridge, namespace, prefix, mtu) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent self.check_bridge_exists(bridge) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent [-] Error while initializing router cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent ri.initialize(self.process_monitor) 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent self.ha_network_added() 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent mtu=self.ha_port.get('mtu')) 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent bridge, namespace, prefix, mtu) 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent self.check_bridge_exists(bridge) 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent ri.delete() 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent self.disable_keepalived() 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent shutil.rmtree(conf_dir) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent onerror(os.listdir, path, sys.exc_info()) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent names = os.listdir(path) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613' 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last): 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent self._process_router_if_compatible(router) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent self._process_added_router(router) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent self._router_added(router['id'], router) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent router_id) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent self.force_reraise() 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent six.reraise(self.type_, self.value, self.tb) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent ri.initialize(self.process_monitor) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent self.ha_network_added() 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent mtu=self.ha_port.get('mtu')) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent bridge, namespace, prefix, mtu) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent self.check_bridge_exists(bridge) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent raise exceptions.BridgeDoesNotExist(bridge=bridge) 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist. 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent 2019-05-21 17:37:13.024 52248 WARNING neutron.agent.l3.agent [-] Info for router cad85ce0-6624-42ff-b42b-09480aea2613 was not found. Performing router cleanup 2019-05-21 17:37:14.358 52248 WARNING neutron.agent.l3.agent [-] Info for router cad85ce0-6624-42ff-b42b-09480aea2613 was not found. Performing router cleanup
Thanks & B’Rgds, Rony
— Slawek Kaplonski Senior software engineer Red Hat