<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-family: Calibri, sans-serif;">
<div>
<div style="font-size: 14px;">Sha,</div>
<div style="font-size: 14px;"><br>
</div>
<div style="font-size: 14px;">As you noticed the vif_plug<span style="font-style: italic;">_</span>notification does not work with cells under the stock confiuguration. In icehouse/juno we simply ran with vif_plugging_is_fatal is false and set the timeout
value to 5 or 10 seconds iirc.</div>
<div style="font-size: 14px;"><br>
</div>
<div>Sam Morrison and made a patch and M<span style="widows: 1; background-color: rgb(255, 255, 255);">athieu Gagné</span> help updated it, to fix this. You can find it here: <a href="https://review.openstack.org/#/c/215459/">https://review.openstack.org/#/c/215459/</a></div>
<div><br>
</div>
<div>We are running this patch under kilo without any issues in production.</div>
<div><br>
</div>
<div>From experience there are a number of other things that are broken in a cells setup:</div>
<div>1.) Flavor creation</div>
<div>2.) Availability zones</div>
<div>3.) Host aggregates creation for the API Cell</div>
<div>4.) Instance-name (doesn't match between api-cell/child-cell/HV)</div>
<div>5.) vif_plug_notification</div>
<div>6.) metadata with x509-keys (x509 key is updated in api cell and not pushed to child cell, but metadata tries to reference it from the child cell)</div>
<div><br>
</div>
<div>We (LDT) are in the process of documenting the patches that we use with Cells and trying to get those upstreamed, we are hoping to have a complete list by Tokyo:</div>
<div><a href="https://etherpad.openstack.org/p/PAO-LDT-cells-patches">https://etherpad.openstack.org/p/PAO-LDT-cells-patches</a></div>
<div><br>
</div>
<div style="font-size: 14px;">
<div id="">
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri">NeCTAR maintains a large number of patches that fix the above broken ness in cells. You can find most of their patches by looking at the commit history on their
kilo branch:</font></font></div>
<div><a href="https://github.com/NeCTAR-RC/nova/commits/nectar/kilo?page=2">https://github.com/NeCTAR-RC/nova/commits/nectar/kilo?page=2</a> (mainly August 12/13/17/24) - We are running ~10 of those patches in production without any issues.</div>
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri">___________________________________________________________________</font></font></div>
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri">Kris Lindgren</font></font></div>
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri">Senior Linux Systems Engineer</font></font></div>
<div><font class="Apple-style-span" color="#000000"><font class="Apple-style-span" face="Calibri">GoDaddy</font></font></div>
</div>
</div>
</div>
<div style="font-size: 14px;"><br>
</div>
<span id="OLK_SRC_BODY_SECTION" style="font-size: 14px;">
<div style="font-family:Calibri; font-size:12pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Sha Li<br>
<span style="font-weight:bold">Date: </span>Thursday, September 17, 2015 at 1:38 AM<br>
<span style="font-weight:bold">To: </span>"<a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a>"<br>
<span style="font-weight:bold">Cc: </span>"<a href="mailto:sam.morrison@unimelb.edu.au">sam.morrison@unimelb.edu.au</a>", "<a href="mailto:belmiro.moreira@cern.ch">belmiro.moreira@cern.ch</a>"<br>
<span style="font-weight:bold">Subject: </span>[Openstack-operators] deploy nova cells with neutron network<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr"><br>
<div>Hi,</div>
<div><br>
</div>
<div>I am try to test the nova cells function.</div>
<div>My test deployment consits of one api-cell node, one child-cell node and one compute node.</div>
<div><br>
</div>
<div>api-cell node: nova-api, nova-cells, nova-cert, nova-condoleauth, nova-novncproxy</div>
<div>child-cell node: nova-cells, nova-conductor, nova-scheduler</div>
<div>compute node: nova-compute</div>
<div><br>
</div>
<div>I found most deployment example is using nova-network with nova-cells. I want to use neutron. So I had keystone , glance, and neutron-server, neutron-dhcp, neutron-l3 shared between all cells and deployed all on the api-cell node.</div>
<div><br>
</div>
<div>I encounterd similar problem as described in this bug report</div>
<div><a href="https://bugs.launchpad.net/nova/+bug/1348103">https://bugs.launchpad.net/nova/+bug/1348103</a><br>
</div>
<div><br>
</div>
<div>When boot a new instance, nova-compute fails to get the network-vif-plugged notification and get time out waiting for the call back.</div>
<div>But on the neutron server side, it looks like the notification had been successfully sent and get the 200 response code from nova-api server</div>
<div><br>
</div>
<div>I had to set </div>
<div><span style="color:rgb(51,51,51);font-family:monospace;font-size:12px;line-height:18px">vif_plugging_</span><span style="color:rgb(51,51,51);font-family:monospace;font-size:12px;line-height:18px">is_fatal = False</span></div>
<div>Then the instnace can be spawned normally</div>
<div><br>
</div>
<div>I am wondering how people use neutron with nova-cells, is this going to cause any trouble in large scale production deployment.</div>
<div><br>
</div>
<div><br>
</div>
<div>Cheers,</div>
<div>Sha</div>
<div><span style="color:rgb(51,51,51);font-family:monospace;font-size:12px;line-height:18px"><br>
</span></div>
<div><span style="color:rgb(51,51,51);font-family:monospace;font-size:12px;line-height:18px"><br>
</span></div>
<div><span style="color:rgb(51,51,51);font-family:monospace;font-size:12px;line-height:18px"><br>
</span></div>
<div>--- neutron server log file</div>
<div>
<p class="" style="word-wrap:break-word;margin:0px 0px 5px;color:rgb(0,0,0);font-family:微软雅黑,'Microsoft Yahei','Helvetica Neue','Hiragino Sans GB',宋体,simsun,黑体,Arial,sans-serif;line-height:24px">
<span class=""><font size="1">2015-08-22<span style="color:blue"> 00:20:35.464</span> 16812 DEBUG neutron.notifiers.nova [-] <span style="color:blue">Sending events:</span> [{'status': 'completed', 'tag</font></span><span class="" style="font-size:x-small">':
u'2839ca4d-b632-4d64-a174-ecfe34a7a746', 'name': 'network-vif-plugged', 'server_uuid': u'</span><span class="" style="font-size:x-small">092c8bc4</span><span class="" style="font-size:x-small">-3643-44</span><span style="font-size:x-small">c0-b79e-ad5caac18b3d'}]
send_events /usr/lib/python2.7/site-packages/neutron/notifiers/nova.py:232</span></p>
<p class="" style="word-wrap:break-word;margin:0px 0px 5px;color:rgb(0,0,0);font-family:微软雅黑,'Microsoft Yahei','Helvetica Neue','Hiragino Sans GB',宋体,simsun,黑体,Arial,sans-serif;line-height:24px">
<span class=""><font size="1">2015-08-22 00:2</font></span><span class=""><font size="1">0:35.468 16812 INFO urllib3.connectionpool [-] S<span style="color:blue">tarting new HTTP connection </span>(1): 192.168.81.2</font></span><span style="font-size:x-small">21</span></p>
<p class="" style="word-wrap:break-word;margin:0px 0px 5px;color:rgb(0,0,0);font-family:微软雅黑,'Microsoft Yahei','Helvetica Neue','Hiragino Sans GB',宋体,simsun,黑体,Arial,sans-serif;line-height:24px">
<span class=""><font size="1">2015-08-22 00:20:35.548 16812 DEBUG urllib3.connectionpool [-] "<span style="color:blue">POST /v2/338aad513c604880a6a0dcc58b88b905/<strong><span style="color:red">os</span></strong></span></font></span><span style="font-size:x-small;color:red"><strong>-server-external-events </strong></span><span style="font-size:x-small">HTTP/1.1"
200 183 _make_request /usr/lib/python2.7/site-packages/urllib3/connectionp</span><span style="font-size:x-small">ool.py:357</span></p>
<p class="" style="word-wrap:break-word;margin:0px 0px 5px;color:rgb(0,0,0);font-family:微软雅黑,'Microsoft Yahei','Helvetica Neue','Hiragino Sans GB',宋体,simsun,黑体,Arial,sans-serif;line-height:24px">
<span class=""><font size="1">2015-08-22 00:20:35.550 16812 INFO neutron.notifiers.nova [-] <span style="color:blue">Nova event <strong>response</strong>: {u'status': u'completed',</span></font></span><span class="" style="font-size:x-small"> u'tag': u'2839ca4d-b632-4d64-a174-ecfe34a7a746',
u'name': u'network-vif-plugged', u'server_uuid': u'</span><span class="" style="font-size:x-small">092c8bc</span><span class="" style="font-size:x-small">4</span><span class="" style="font-size:x-small">-3643-44c0-b79e-ad5caac18b3d', <span style="color:blue">u'code':
200}</span></span></p>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
</div>
</div>
</span>
</body>
</html>