Open Stack

Hi,

Error which You pasted looks that is related to moment when router is deleted.
Do You have any errors in neutron-server and/or neutron-l3-agent logs during creation of the router?
Can You check with command “neutron l3-agent-list-hosting-router <router_id>” by which l3 agent router should be hosted?
What kind of router Your are creating? Is it HA, DVR, DVR-HA router? Or maybe Legacy?

> On 21 May 2019, at 16:51, Md. Farhad Hasan Khan <rony.khan at novotel-bd.com> wrote:
> 
> Hi,
> I can create router from horizon. But network namespaces not created. I check with # ip netns list command. Not found router ID, but showing in horizon.
>  
> Here is some log I get from neutron:
>  
>  
> #cat /var/log/neutron/l3-agent.log
>  
>  
> 2019-05-21 17:35:44.646 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:35:44.646 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:35:44.646 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent     ri.delete()
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent     self.disable_keepalived()
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent     shutil.rmtree(conf_dir)
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent     onerror(os.listdir, path, sys.exc_info())
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent     names = os.listdir(path)
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:35:44.709 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     self._process_router_if_compatible(router)
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     self._process_added_router(router)
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     self._router_added(router['id'], router)
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     router_id)
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     self.force_reraise()
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     six.reraise(self.type_, self.value, self.tb)
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     ri.initialize(self.process_monitor)
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     self.ha_network_added()
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     mtu=self.ha_port.get('mtu'))
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     bridge, namespace, prefix, mtu)
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     self.check_bridge_exists(bridge)
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:35:44.710 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:35:44.711 52248 WARNING neutron.agent.l3.agent [-] Hit retry limit with router update for cad85ce0-6624-42ff-b42b-09480aea2613, action None: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:35:44.711 52248 WARNING neutron.agent.l3.agent [-] Info for router cad85ce0-6624-42ff-b42b-09480aea2613 was not found. Performing router cleanup: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent [-] Error while initializing router cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent     ri.initialize(self.process_monitor)
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent     self.ha_network_added()
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent     mtu=self.ha_port.get('mtu'))
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent     bridge, namespace, prefix, mtu)
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent     self.check_bridge_exists(bridge)
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:05.705 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent     ri.delete()
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent     self.disable_keepalived()
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent     shutil.rmtree(conf_dir)
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent     onerror(os.listdir, path, sys.exc_info())
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent     names = os.listdir(path)
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:37:05.761 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     self._process_router_if_compatible(router)
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     self._process_added_router(router)
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     self._router_added(router['id'], router)
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     router_id)
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     self.force_reraise()
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     six.reraise(self.type_, self.value, self.tb)
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     ri.initialize(self.process_monitor)
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     self.ha_network_added()
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     mtu=self.ha_port.get('mtu'))
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     bridge, namespace, prefix, mtu)
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     self.check_bridge_exists(bridge)
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:05.762 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent [-] Error while initializing router cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent     ri.initialize(self.process_monitor)
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent     self.ha_network_added()
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent     mtu=self.ha_port.get('mtu'))
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent     bridge, namespace, prefix, mtu)
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent     self.check_bridge_exists(bridge)
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:07.975 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     ri.delete()
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     self.disable_keepalived()
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     shutil.rmtree(conf_dir)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     onerror(os.listdir, path, sys.exc_info())
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     names = os.listdir(path)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     self._process_router_if_compatible(router)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     self._process_added_router(router)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     self._router_added(router['id'], router)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     router_id)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     self.force_reraise()
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     six.reraise(self.type_, self.value, self.tb)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     ri.initialize(self.process_monitor)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     self.ha_network_added()
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     mtu=self.ha_port.get('mtu'))
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     bridge, namespace, prefix, mtu)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     self.check_bridge_exists(bridge)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:08.029 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent [-] Error while initializing router cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent     ri.initialize(self.process_monitor)
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent     self.ha_network_added()
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent     mtu=self.ha_port.get('mtu'))
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent     bridge, namespace, prefix, mtu)
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent     self.check_bridge_exists(bridge)
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:10.277 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent     ri.delete()
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent     self.disable_keepalived()
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent     shutil.rmtree(conf_dir)
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent     onerror(os.listdir, path, sys.exc_info())
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent     names = os.listdir(path)
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:37:10.351 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     self._process_router_if_compatible(router)
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     self._process_added_router(router)
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     self._router_added(router['id'], router)
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     router_id)
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     self.force_reraise()
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     six.reraise(self.type_, self.value, self.tb)
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     ri.initialize(self.process_monitor)
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     self.ha_network_added()
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     mtu=self.ha_port.get('mtu'))
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     bridge, namespace, prefix, mtu)
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     self.check_bridge_exists(bridge)
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:10.352 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent [-] Error while initializing router cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent     ri.initialize(self.process_monitor)
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent     self.ha_network_added()
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent     mtu=self.ha_port.get('mtu'))
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent     bridge, namespace, prefix, mtu)
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent     self.check_bridge_exists(bridge)
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:12.575 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent [-] Error while deleting router cad85ce0-6624-42ff-b42b-09480aea2613: OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 372, in _router_added
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     ri.delete()
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 452, in delete
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     self.disable_keepalived()
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 178, in disable_keepalived
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     shutil.rmtree(conf_dir)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 239, in rmtree
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     onerror(os.listdir, path, sys.exc_info())
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib64/python2.7/shutil.py", line 237, in rmtree
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     names = os.listdir(path)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent OSError: [Errno 2] No such file or directory: '/var/lib/neutron/ha_confs/cad85ce0-6624-42ff-b42b-09480aea2613'
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent [-] Failed to process compatible router: cad85ce0-6624-42ff-b42b-09480aea2613: BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent Traceback (most recent call last):
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 562, in _process_router_update
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     self._process_router_if_compatible(router)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 481, in _process_router_if_compatible
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     self._process_added_router(router)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 486, in _process_added_router
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     self._router_added(router['id'], router)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 375, in _router_added
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     router_id)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     self.force_reraise()
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     six.reraise(self.type_, self.value, self.tb)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/agent.py", line 364, in _router_added
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     ri.initialize(self.process_monitor)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 128, in initialize
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     self.ha_network_added()
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/l3/ha_router.py", line 198, in ha_network_added
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     mtu=self.ha_port.get('mtu'))
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 263, in plug
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     bridge, namespace, prefix, mtu)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 346, in plug_new
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     self.check_bridge_exists(bridge)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent   File "/usr/lib/python2.7/site-packages/neutron/agent/linux/interface.py", line 221, in check_bridge_exists
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent     raise exceptions.BridgeDoesNotExist(bridge=bridge)
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent BridgeDoesNotExist: Bridge br-int does not exist.
> 2019-05-21 17:37:12.640 52248 ERROR neutron.agent.l3.agent
> 2019-05-21 17:37:13.024 52248 WARNING neutron.agent.l3.agent [-] Info for router cad85ce0-6624-42ff-b42b-09480aea2613 was not found. Performing router cleanup
> 2019-05-21 17:37:14.358 52248 WARNING neutron.agent.l3.agent [-] Info for router cad85ce0-6624-42ff-b42b-09480aea2613 was not found. Performing router cleanup
>  
>  
> Thanks & B’Rgds,
> Rony

— 
Slawek Kaplonski
Senior software engineer
Red Hat