As mentioned several times on this list, https://review.openstack.org/#/c/58848/ is in the process of merging. Once it does, builds will start failing if there are log ERRORs that are not filtered out by https://github.com/openstack/tempest/blob/master/etc/whitelist.yaml. There are too many issues with neutron so, for the moment, neutron will not fail in this case. If a build fails due to log errors, which will be shown in the console right after the tempest output, and you really think the log error is not a bug, you can propose a change to the whitelist. It will be great to also see the whitelist reduced as bugs are fixed. -David