Hello Philip,<div><br></div><div>Which nova services are you running on your compute nodes? If you are not getting network information for your instances, one of the causes might be that VM can't access the metadata service.</div>
<div><br></div><div>And I think your network config is missing something. Is the config snippet you copied from controller or compute node?</div><div><br></div><div>--janis<br><br><div class="gmail_quote">On Wed, Aug 15, 2012 at 3:21 PM, Schwartz, Philip Marc (RIS-BCT) <span dir="ltr"><<a href="mailto:Philip.Schwartz@lexisnexis.com" target="_blank">Philip.Schwartz@lexisnexis.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div>
<p class="MsoNormal">Hi All, <u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I am having an issue with a new cluster. (First of its config type, not first OS cluster.) The cluster is made up of the following:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">12 Physical nodes (192 CPU Cores, 288 GB of ram, 96 TB of storage)<u></u><u></u></p>
<p class="MsoNormal">2 nic’s per node (1 nic cabled due to current switch space, not being changed for a while due to budget).<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I am using .1 as the cloud controller and also a compute node, .2-.12 will be compute nodes only. All nodes are running CentOS 6.2 with EPEL installed openstack packages.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">The following is my network config in /etc/nova/nova.conf.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"># NETWORK Config<u></u><u></u></p>
<p class="MsoNormal">network_manager=nova.network.manager.FlatDHCPManager<u></u><u></u></p>
<p class="MsoNormal">public_interface=eth0<u></u><u></u></p>
<p class="MsoNormal">flat_network_bridge=br16<u></u><u></u></p>
<p class="MsoNormal">fixed_range=<a href="http://192.168.16.0/24" target="_blank">192.168.16.0/24</a><u></u><u></u></p>
<p class="MsoNormal">network_size=256<u></u><u></u></p>
<p class="MsoNormal">force_dhcp_release=True<u></u><u></u></p>
<p class="MsoNormal">root_helper=sudo nova-rootwrap<u></u><u></u></p>
<p class="MsoNormal">flat_injected=False<u></u><u></u></p>
<p class="MsoNormal">dhcpbridge_flagfile=/etc/nova/nova.conf<u></u><u></u></p>
<p class="MsoNormal">dhcpbridge=/usr/bin/nova-dhcpbridge<u></u><u></u></p>
<p class="MsoNormal">multi_host=True<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">This is the line I am using to create the private network.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">nova-manage network create private <a href="http://192.168.16.0/24" target="_blank">192.168.16.0/24</a> 1 256<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I have not added a public network yet, but it will be on the <a href="http://10.173.16.0/24" target="_blank">10.173.16.0/24</a> network block where each of these nodes exist taking up the first 12 addresses in the block.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I can currently start up instances without issue. The problem comes after startup when the instances don’t appear to get network information. I am running ubuntu cloud images currently and cloud-init goes into a blocking 120 sec loop stating
“cloud-init-nonet waiting 120 seconds for a network device.”.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">The compute and network logs do not show any issues or errors.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">ip a:<u></u><u></u></p>
<p class="MsoNormal">1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
<u></u><u></u></p>
<p class="MsoNormal"> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00<u></u><u></u></p>
<p class="MsoNormal"> inet <a href="http://127.0.0.1/8" target="_blank">127.0.0.1/8</a> scope host lo<u></u><u></u></p>
<p class="MsoNormal"> inet <a href="http://169.254.169.254/32" target="_blank">169.254.169.254/32</a> scope link lo<u></u><u></u></p>
<p class="MsoNormal"> inet6 ::1/128 scope host <u></u><u></u></p>
<p class="MsoNormal"> valid_lft forever preferred_lft forever<u></u><u></u></p>
<p class="MsoNormal">2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000<u></u><u></u></p>
<p class="MsoNormal"> link/ether 00:25:90:48:f3:7a brd ff:ff:ff:ff:ff:ff<u></u><u></u></p>
<p class="MsoNormal"> inet <a href="http://10.173.16.1/24" target="_blank">10.173.16.1/24</a> brd 10.173.16.255 scope global eth0<u></u><u></u></p>
<p class="MsoNormal"> inet6 fe80::225:90ff:fe48:f37a/64 scope link <u></u><u></u></p>
<p class="MsoNormal"> valid_lft forever preferred_lft forever<u></u><u></u></p>
<p class="MsoNormal">3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000<u></u><u></u></p>
<p class="MsoNormal"> link/ether 00:25:90:48:f3:7b brd ff:ff:ff:ff:ff:ff<u></u><u></u></p>
<p class="MsoNormal">4: virbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN
<u></u><u></u></p>
<p class="MsoNormal"> link/ether 52:54:00:3a:15:e7 brd ff:ff:ff:ff:ff:ff<u></u><u></u></p>
<p class="MsoNormal"> inet <a href="http://192.168.122.1/24" target="_blank">192.168.122.1/24</a> brd 192.168.122.255 scope global virbr0<u></u><u></u></p>
<p class="MsoNormal">5: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 500<u></u><u></u></p>
<p class="MsoNormal"> link/ether 52:54:00:3a:15:e7 brd ff:ff:ff:ff:ff:ff<u></u><u></u></p>
<p class="MsoNormal">7: br16: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN
<u></u><u></u></p>
<p class="MsoNormal"> link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff<u></u><u></u></p>
<p class="MsoNormal"> inet <a href="http://192.168.16.3/24" target="_blank">192.168.16.3/24</a> brd 192.168.16.255 scope global br16<u></u><u></u></p>
<p class="MsoNormal"> inet6 fe80::94e9:76ff:fe91:70d8/64 scope link <u></u><u></u></p>
<p class="MsoNormal"> valid_lft forever preferred_lft forever<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">ip r:<u></u><u></u></p>
<p class="MsoNormal"><a href="http://10.173.16.0/24" target="_blank">10.173.16.0/24</a> dev eth0 proto kernel scope link src 10.173.16.1
<u></u><u></u></p>
<p class="MsoNormal"><a href="http://192.168.16.0/24" target="_blank">192.168.16.0/24</a> dev br16 proto kernel scope link src 192.168.16.3
<u></u><u></u></p>
<p class="MsoNormal"><a href="http://192.168.122.0/24" target="_blank">192.168.122.0/24</a> dev virbr0 proto kernel scope link src 192.168.122.1
<u></u><u></u></p>
<p class="MsoNormal"><a href="http://169.254.0.0/16" target="_blank">169.254.0.0/16</a> dev eth0 scope link metric 1002 <u></u><u></u></p>
<p class="MsoNormal">default via 10.173.16.254 dev eth0<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">brctl show:<u></u><u></u></p>
<p class="MsoNormal">[root@cloud016001 osscripts]# brctl show<u></u><u></u></p>
<p class="MsoNormal">bridge name bridge id STP enabled interfaces<u></u><u></u></p>
<p class="MsoNormal">br16 8000.fe163e1111d6 no vnet0<u></u><u></u></p>
<p class="MsoNormal">virbr0 8000.5254003a15e7 yes virbr0-nic<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas">Thank You,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas">Philip Schwartz<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas">Senior Software Engineer<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas">LexisNexis RS<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas">O - <a href="tel:561%20999%204472" value="+15619994472" target="_blank">561 999 4472</a><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas">C - <a href="tel:954%20290%204024" value="+19542904024" target="_blank">954 290 4024</a><u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<br>_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br><br></blockquote></div>
</div>