
<html>

<head>

<meta http-equiv="Content-Type" content="text/html; charset=ks_c_5601-1987">

<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>

</head>

<body dir="ltr">

<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">

<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; color: black; background-color: rgb(255, 255, 255)">

Btw I still think your suders is slightly incorrect. I feel like that is significant, but not a hundred.</div>

<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; color: black; background-color: rgb(255, 255, 255)">

<br>

</div>

<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; color: black; background-color: rgb(255, 255, 255)">

Drop the star at the end of the last line.</div>

<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; color: black; background-color: rgb(255, 255, 255)">

<br>

</div>

<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; color: black; background-color: rgb(255, 255, 255)">

<p style="color: rgb(32, 31, 30); font-family: "MS PGothic", sans-serif; background-color: white; margin: 0px">

<span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif, serif, EmojiFont">root@us01odc-qa-ctrl3:/var/log/neutron# cat /etc/sudoers.d/neutron_sudoers</span></p>

<p style="color: rgb(32, 31, 30); font-family: "MS PGothic", sans-serif; background-color: white; margin: 0px">

<span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif, serif, EmojiFont">Defaults:neutron !requiretty</span></p>

<p style="color: rgb(32, 31, 30); font-family: "MS PGothic", sans-serif; background-color: white; margin: 0px">

<span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif, serif, EmojiFont"> </span></p>

<p style="color: rgb(32, 31, 30); font-family: "MS PGothic", sans-serif; background-color: white; margin: 0px">

<span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif, serif, EmojiFont">neutron ALL = (root) NOPASSWD: /usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf *</span></p>

<p style="color: rgb(32, 31, 30); font-family: "MS PGothic", sans-serif; background-color: white; margin: 0px">

<span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif, serif, EmojiFont">neutron ALL = (root) NOPASSWD: /usr/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf</span></p>

</div>

</div>

<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">

<br>

</div>

<hr tabindex="-1" style="display:inline-block; width:98%">

<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Erik Olof Gunnar Andersson <eandersson@blizzard.com><br>

<b>Sent:</b> Thursday, October 10, 2019 6:18 PM<br>

<b>To:</b> Albert Braden <Albert.Braden@synopsys.com>; Chris Apsey <bitskrieg@bitskrieg.net><br>

<b>Cc:</b> openstack-discuss@lists.openstack.org <openstack-discuss@lists.openstack.org><br>

<b>Subject:</b> Re: Port creation times out for some VMs in large group</font>

<div> </div>

</div>

<div dir="ltr">

<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">

Maybe double check that your rootwrap config is up to date?</div>

<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">

<br>

</div>

<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">

/etc/neutron/<span style="font-family:Calibri,Arial,Helvetica,sans-serif; background-color:rgb(255,255,255); display:inline!important">rootwrap<span> .conf and /etc/neutron/<span style="font-family:Calibri,Arial,Helvetica,sans-serif; background-color:rgb(255,255,255); display:inline!important">rootwrap.d</span></span></span></div>

<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">

<br>

</div>

<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">

(Make sure to pick the appropriate branch in github)</div>

<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">

<a href="https://github.com/openstack/neutron/blob/master/etc/rootwrap.conf" id="LPNoLP923608">https://github.com/openstack/neutron/blob/master/etc/rootwrap.conf</a><br>

</div>

<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">

<a href="https://github.com/openstack/neutron/tree/master/etc/neutron/rootwrap.d" id="LPNoLP513599">https://github.com/openstack/neutron/tree/master/etc/neutron/rootwrap.d</a><br>

</div>

<br>

<br>

<div id="x_appendonsend"></div>

<hr tabindex="-1" style="display:inline-block; width:98%">

<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Albert Braden <Albert.Braden@synopsys.com><br>

<b>Sent:</b> Thursday, October 10, 2019 1:45 PM<br>

<b>To:</b> Erik Olof Gunnar Andersson <eandersson@blizzard.com>; Chris Apsey <bitskrieg@bitskrieg.net><br>

<b>Cc:</b> openstack-discuss@lists.openstack.org <openstack-discuss@lists.openstack.org><br>

<b>Subject:</b> RE: Port creation times out for some VMs in large group</font>

<div> </div>

</div>

<div lang="EN-US">

<div class="x_x_WordSection1">

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">The errors appear to start with this line:</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">2019-10-10 13:42:48.261 1211336 ERROR neutron.agent.linux.utils [req-42c530f6-6e08-47c1-8ed4-dcb31c9cd972 - - - - -] Rootwrap error running command: ['iptables-save', '-t', 'raw']: Exception:

 Failed to spawn rootwrap process.</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">We’re not running iptables. Do we need it, to use the rootwrap daemon?</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<div>

<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in">

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> Albert Braden <Albert.Braden@synopsys.com>

<br>

<b>Sent:</b> Thursday, October 10, 2019 12:13 PM<br>

<b>To:</b> Erik Olof Gunnar Andersson <eandersson@blizzard.com>; Chris Apsey <bitskrieg@bitskrieg.net><br>

<b>Cc:</b> openstack-discuss@lists.openstack.org<br>

<b>Subject:</b> RE: Port creation times out for some VMs in large group</span></p>

</div>

</div>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

 </p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">It looks like something is still missing. I added the line to /etc/sudoers.d/neutron_sudoers:</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">root@us01odc-qa-ctrl3:/var/log/neutron# cat /etc/sudoers.d/neutron_sudoers</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Defaults:neutron !requiretty</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">neutron ALL = (root) NOPASSWD: /usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf *</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">neutron ALL = (root) NOPASSWD: /usr/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf *</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Then I restarted neutron services and the error was goneˇ for a few minutes, and then it came back on ctrl3. Ctrl1/2 aren’t erroring at this time. I changed neutron’s shell and tested the daemon

 command and it seems to work:</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">root@us01odc-qa-ctrl3:~# su - neutron</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">neutron@us01odc-qa-ctrl3:~$ /usr/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">/tmp/rootwrap-5b1QoP/rootwrap.sock</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Z%</span><span style="font-size:11.0pt; font-family:"Arial",sans-serif">⑵</span><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">"</span><span style="font-size:11.0pt; font-family:"Arial",sans-serif">⑵⑵⑵</span><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Vs</span><span style="font-size:11.0pt; font-family:"Arial",sans-serif">⑵⑵</span><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">5-</span><span style="font-size:11.0pt; font-family:"Arial",sans-serif">⑵</span><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">,a</span><span style="font-size:11.0pt; font-family:"Arial",sans-serif">⑵⑵⑵⑵</span><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">G</span><span style="font-size:11.0pt; font-family:"Arial",sans-serif">⑵⑵⑵⑵</span><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">v</span><span style="font-size:11.0pt; font-family:"Arial",sans-serif">⑵⑵</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">But neutron-linuxbridge-agent.log still scrolls errors:</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"><a href="https://urldefense.com/v3/__http://paste.openstack.org/show/782740/__;!2E0gRdhhnqPNNL0!z5cwPxQ1y_zz0MvtFzMZSCIh7-3d80kxciHbPtkj4LbHCzSkzNpf36RwLi8kWGm1Ew$">http://paste.openstack.org/show/782740/</a></span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">It appears that there is another factor besides the config, because even when the sudoers line was missing, it would work for hours or days before the error started. It has been working in our

 prod cluster for about a week now, without the sudoers line. It seems like it should not work that way. What am I missing?</span></p>

<p class="x_x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: "MS PGothic", sans-serif;">

<br>

</p>

<div>

<div>

<div>

<p class="x_x_xmsonormal" style="margin-top: 0px; margin-bottom: 0px;margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">

 </p>

</div>

</div>

</div>

</div>

</div>

</div>

</body>

</html>