<div dir="ltr">Hi Samuel:<div><br></div><div style>It sounds like your VMs are configured to plug into a Linux bridge that doesn't exist on compute-01 anymore. You could create it manually, although I would expect that it would have been created automatically by the relevant nova service when they came back up.</div>
<div style><br></div><div style>You can check if the bridge is there by doing "ip a" and looking for the "br14" network device.</div><div style><br></div><div style>Are you running networking in multihost mode? If so, I think restarting the nova-network service on compute-01 should do it. If you aren't running in multihost mode, then it should come back by restarting the nova-compute service on compute-01.</div>
<div style><br></div><div style>Otherwise, you'll need to create the bridge manually, and how you do that will depend on whether you're running flat or vlan. If it was called br14, I'm assuming you're running in vlan mode with vlan tag 14 associated with this project?</div>
<div style><br></div><div style>Lorin</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Sun, Jul 7, 2013 at 9:21 PM, Samuel Winchenbach <span dir="ltr"><<a href="mailto:swinchen@gmail.com" target="_blank">swinchen@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:'courier new',monospace">Hi All,</div><div class="gmail_default" style="font-family:'courier new',monospace">
<br></div><div class="gmail_default" style="font-family:'courier new',monospace">
I have an old Essex cluster that we are getting ready to phase out for grizzly. Unfortunately over the weekend one of the compute nodes powered off (power supply failure it looks like). When I tried a "nova reboot <UUID>"</div>
<div class="gmail_default" style="font-family:'courier new',monospace"><br></div><div class="gmail_default" style="font-family:'courier new',monospace">I got:</div><div class="gmail_default" style="font-family:'courier new',monospace">
<br></div><div class="gmail_default"><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 ERROR nova.rpc.amqp [req-d2ea5f46-9dc2-4788-9951-07d985a1f8dc 6986639ba3c84ab5b05fdd2e122101f0 3806a811d2d34542bdfc5d7f31ce7b89] Exception during message handling</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp Traceback (most recent call last):</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 253, in _process_data</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp rval = node_func(context=ctxt, **node_args)</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp return f(*args, **kw)</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 159, in decorated_function</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp function(self, context, instance_uuid, *args, **kwargs)</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 183, in decorated_function</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp sys.exc_info())</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp self.gen.next()</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 177, in decorated_function</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp return function(self, context, instance_uuid, *args, **kwargs)</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 904, in reboot_instance</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp reboot_type)</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp return f(*args, **kw)</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 721, in reboot</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp if self._soft_reboot(instance):</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 757, in _soft_reboot</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp dom.create()</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/libvirt.py", line 551, in create</font></div>
<div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp if ret == -1: raise libvirtError ('virDomainCreate() failed', dom=self)</font></div><div class="gmail_default">
<font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp libvirtError: Cannot get interface MTU on 'br14': No such device</font></div><div class="gmail_default"><font face="courier new, monospace">2013-07-07 21:17:34 TRACE nova.rpc.amqp</font></div>
<div class="gmail_default"><font face="courier new, monospace"><br></font></div><div class="gmail_default"><font face="courier new, monospace"><br></font></div><div class="gmail_default"><font face="courier new, monospace">So I tried starting it manually:</font></div>
<div class="gmail_default"><font face="courier new, monospace"><br></font></div><div class="gmail_default"><font face="courier new, monospace"><div class="gmail_default">root@compute-01:/etc/libvirt/qemu# virsh create instance-00000035.xml </div>
<div class="gmail_default">error: Failed to create domain from instance-00000035.xml</div><div class="gmail_default">error: Cannot get interface MTU on 'br14': No such device</div><div class="gmail_default"><br></div>
<div class="gmail_default"><br></div><div class="gmail_default">Any idea what I might be doing wrong? All the services show :-) with nova-manage</div><div class="gmail_default"><br></div><div class="gmail_default">
<br></div><div class="gmail_default">Thanks for your help...</div><div class="gmail_default"><br></div><div class="gmail_default">Sam</div></font></div></div></div>
<br>_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr">Lorin Hochstein<br><div>Lead Architect - Cloud Services</div><div>Nimbis Services, Inc.</div><div><a href="http://www.nimbisservices.com" target="_blank">www.nimbisservices.com</a></div>
</div>
</div>