On 9/29/2018 10:01 PM, Tao Li wrote: > I found this test is added about ten days ago in this patch > https://review.openstack.org/#/c/599276/, > > I checked it and don’t know why it failed. I think my commit shouldn’t > cause this issue. So do you any suggestion to me? > Yes it must be an intermittent race bug introduced by that change for the 2.66 microversion. Since it deals with filtering based on time, we might not have a time window that is big enough (we expect to get a result of changes < $before but are getting <= $before). http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22%7C%20%20%20%20%20testtools.matchers._impl.MismatchError%3A%20%5B'create'%5D%20!%3D%20%5B'create'%2C%20'stop'%5D%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d Please report a bug against python-novaclient. The 2.66 test is based on a similar changes_since test, so we should see why they are behaving differently. -- Thanks, Matt