<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hi all, <div class=""><br class=""></div><div class="">I’ve recently upgraded Openstack from Mitaka to Ocata and now I’m facing an increased latency in instance creation.</div><div class="">Before the upgrade I was able to launch sequentially 400 VMs in 5 minutes and now I need at least 15 minutes. Attached the script I use to measure timings.</div><div class=""><br class=""></div><div class=""><div class="">Here you can find the comparison between Mitaka and Ocata. I also noticed that in Ocata DHCP agent is slower and sometimes when I launch more than 30 VMs sequentially some of them doesn’t took an address.</div><div class="">Time of instance creation increase with the number of ports in the network. </div></div><div class=""><br class=""></div><div class=""><a href="https://docs.google.com/spreadsheets/d/1eHjRxkw_5BmJ2p0rBJg9suGKmu_1YrSY05f50gKJxbE/edit?usp=sharing" class="">https://docs.google.com/spreadsheets/d/1eHjRxkw_5BmJ2p0rBJg9suGKmu_1YrSY05f50gKJxbE/edit?usp=sharing</a></div><div class=""><br class=""></div><div class="">I’ve enabled the osprofiler inside nova and neutron api and attached you can see that the most of the time is spent on wsgi component of neutron.</div><div class="">The time is spent on getting port list. I’ve also verified with cli listing only ports and I can confirm is a port list related issue.</div><div class=""><br class=""></div><div class="">I’m trying to profile the neutron-server with cProfile but I’ve some problems with multi-threading tracing.</div><div class=""><br class=""></div><div class="">Does anyone have faced this issue? </div><div class=""><br class=""></div><div class="">Thank you!</div><div class=""><br class=""></div><div class="">Regards</div><div class="">Matteo</div><div class=""><br class=""></div><div class=""></div></body></html>