Hi,

I have upgraded neutron server from victoria to wallaby. Everytime I restart neutron server, I see below errors in neutron-server.log. Can you guys please advise on it.

2021-04-28 06:34:12.144 1767 INFO ovsdbapp.backend.ovs_idl.vlog [req-cc4f309f-1851-47cd-bab1-de0445964d56 - - - - -] tcp:172.16.30.51:6641: connecting...
2021-04-28 06:34:12.145 1767 INFO ovsdbapp.backend.ovs_idl.vlog [req-cc4f309f-1851-47cd-bab1-de0445964d56 - - - - -] tcp:172.16.30.51:6641: connected
2021-04-28 06:34:12.214 1770 INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for MaintenanceWorker with retry
2021-04-28 06:34:12.238 1770 INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:172.16.30.51:6641: connecting...
2021-04-28 06:34:12.238 1770 INFO ovsdbapp.backend.ovs_idl.vlog [-] tcp:172.16.30.51:6641: connected
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: AttributeError: 'NoneType' object has no attribute 'db_find_rows'
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event Traceback (most recent call last):
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/ovsdbapp/event.py", line 159, in notify_loop
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event     match.run(event, row, updates)
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py", line 443, in run
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event     self.driver.delete_mac_binding_entries(row.external_ip)
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py", line 1058, in delete_mac_binding_entries
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event     mac_binds = self._sb_ovn.db_find_rows(
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event AttributeError: 'NoneType' object has no attribute 'db_find_rows'
2021-04-28 06:34:12.248 1767 ERROR ovsdbapp.event
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: AttributeError: 'NoneType' object has no attribute 'db_find_rows'
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event Traceback (most recent call last):
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/ovsdbapp/event.py", line 159, in notify_loop
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event     match.run(event, row, updates)
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py", line 443, in run
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event     self.driver.delete_mac_binding_entries(row.external_ip)
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py", line 1058, in delete_mac_binding_entries
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event     mac_binds = self._sb_ovn.db_find_rows(
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event AttributeError: 'NoneType' object has no attribute 'db_find_rows'
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: AttributeError: 'NoneType' object has no attribute 'db_find_rows'
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event Traceback (most recent call last):
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/ovsdbapp/event.py", line 159, in notify_loop
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event     match.run(event, row, updates)
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py", line 443, in run
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event     self.driver.delete_mac_binding_entries(row.external_ip)
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py", line 1058, in delete_mac_binding_entries
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event     mac_binds = self._sb_ovn.db_find_rows(
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event AttributeError: 'NoneType' object has no attribute 'db_find_rows'
2021-04-28 06:34:12.250 1767 ERROR ovsdbapp.event
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: AttributeError: 'NoneType' object has no attribute 'db_find_rows'
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event Traceback (most recent call last):
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/ovsdbapp/event.py", line 159, in notify_loop
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event     match.run(event, row, updates)
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovsdb_monitor.py", line 443, in run
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event     self.driver.delete_mac_binding_entries(row.external_ip)
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py", line 1058, in delete_mac_binding_entries
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event     mac_binds = self._sb_ovn.db_find_rows(
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event AttributeError: 'NoneType' object has no attribute 'db_find_rows'
2021-04-28 06:34:12.251 1767 ERROR ovsdbapp.event
2021-04-28 06:34:12.251 1767 INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] OVN reports status down for port: 3d040d1d-c3d5-49da-9103-8ab4f9a8ab01
2021-04-28 06:34:12.252 1767 INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [req-cc4f309f-1851-47cd-bab1-de0445964d56 - - - - -] Getting OvsdbSbOvnIdl for WorkerService with retry

Secondly after upgrade, I can only see upgraded network agents in openstack network agent list. The other agents that are on victoria release are not showing up. Need your help.

--
Regards,


Syed Ammad Ali