Is GlusterFS be more viable for a production environment?<br><br><div class="gmail_quote">On Tue, Jul 10, 2012 at 11:17 AM, Sébastien Han <span dir="ltr"><<a href="mailto:han.sebastien@gmail.com" target="_blank">han.sebastien@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Great!<br clear="all"><div><br></div><div>The last time I ran the live-migration, it was with GlusterFS and CephFS and I didn't changed any permissions in libvirt. I did the live-migration with NFS once but it was in Diablo (horrible), I don't really remember my setup. Maybe you should consider to try GlusterFS.</div>
<div class="HOEnZb"><div class="h5">
<br><br><div class="gmail_quote">On Tue, Jul 10, 2012 at 12:07 PM, Leander Bessa Beernaert <span dir="ltr"><<a href="mailto:leanderbb@gmail.com" target="_blank">leanderbb@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
That did! Thanks :)<div><br></div><div>Do you by change have any pointer on getting the live-migration to work without running libvirt under root?<div><div><br><br><div class="gmail_quote">On Tue, Jul 10, 2012 at 10:55 AM, Sébastien Han <span dir="ltr"><<a href="mailto:han.sebastien@gmail.com" target="_blank">han.sebastien@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Change the vncserver_listen to 0.0.0.0 and re-try the live-migration, you should get better results :)<div>
<div><br>
<br><br><div class="gmail_quote">On Tue, Jul 10, 2012 at 11:52 AM, Leander Bessa Beernaert <span dir="ltr"><<a href="mailto:leanderbb@gmail.com" target="_blank">leanderbb@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
If i don't run libvirt with root, it can't write to the shared folder. It's the only way i've been able to get this to work. :S<div><br></div><div>Below follows the configuration of one of the compute nodes. 10.0.1.1 is the controller and 10.0.1.2 is the compute node.</div>
<div><br></div><div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">novncproxy_base_url=<a href="http://10.0.1.1:6080/vnc_auto.html" target="_blank">http://10.0.1.1:6080/vnc_auto.html</a><br>
xvpvncproxy_base_url=<a href="http://10.0.1.1:6081/console" target="_blank">http://10.0.1.1:6081/console</a><br>vncserver_proxyclient_address=10.0.1.2<br>vncserver_listen=10.0.1.2</blockquote><div><div><br><div class="gmail_quote">
On Tue, Jul 10, 2012 at 10:49 AM, Sébastien Han <span dir="ltr"><<a href="mailto:han.sebastien@gmail.com" target="_blank">han.sebastien@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I forgot to ask, did you enable the vnc console?<div><br></div><div>If so, with which parameters?</div><div>
<div><div><br></div><div><br><div class="gmail_quote">On Tue, Jul 10, 2012 at 11:48 AM, Sébastien Han <span dir="ltr"><<a href="mailto:han.sebastien@gmail.com" target="_blank">han.sebastien@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi!<br clear="all"><br>Usually you get:<div><br></div><div><div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
2012-07-09 13:58:27.179+0000: 10227: warning : qemuDomainObjTaint:1134 : Domain id=2 name='instance-00000002' uuid=57aca8a6-d062-4a08-8d87-e4d11d259ac7 is tainted: high-privileges</blockquote>
<div><br></div></div>when you change permission in libvirt (root I presumed) which is not necessary.</div><div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
2012-07-10 09:26:02.244+0000: 10229: error : virExecWithHook:328 : Cannot find 'pm-is-supported' in path: No such file or directory</blockquote><div><br></div></div><div>This error is harmless and can be easily solved by installing the following package:</div>
<div><br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">sudo apt-get install pm-utils -y</blockquote><div>
<br></div><div>Do you have something in the nova-scheduler logs?</div><div><br></div><div>Cheers!</div><div><div><br><div class="gmail_quote">On Tue, Jul 10, 2012 at 11:29 AM, Leander Bessa Beernaert <span dir="ltr"><<a href="mailto:leanderbb@gmail.com" target="_blank">leanderbb@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Well i've checked the libvirt logs on both nodes and i found these two lines:<div><br></div><div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
2012-07-09 13:58:27.179+0000: 10227: warning : qemuDomainObjTaint:1134 : Domain id=2 name='instance-00000002' uuid=57aca8a6-d062-4a08-8d87-e4d11d259ac7 is tainted: high-privileges<br>2012-07-09 13:58:27.736+0000: 10226: error : qemuMonitorIORead:513 : Unable to read from monitor: Connection reset by peer</blockquote>
<div><br></div><div>The log is alos filled with the message below, it gets repeated over and over and over.</div><div><br></div><div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
2012-07-10 09:26:02.244+0000: 10229: error : virExecWithHook:328 : Cannot find 'pm-is-supported' in path: No such file or directory<br>2012-07-10 09:26:02.244+0000: 10229: warning : qemuCapsInit:856 : Failed to get host power management capabilities</blockquote>
</div><div><div><br><div class="gmail_quote">On Tue, Jul 10, 2012 at 8:16 AM, Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">Hi Leander,<div>try to check libvirtd.log files, </div><div>is the instance still running on the first node while you are lauching the migration process ?</div><div><br></div><div>Razique<br>
<div>
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:'Lucida Grande';word-spacing:0px"><span style="font-family:Helvetica"><span style="font-family:Helvetica"><b style="color:rgb(19,112,138)">Nuage & Co - Razique Mahroua</b></span><span style="color:rgb(19,112,138);font-family:Helvetica"><b> </b></span><span style="border-collapse:separate;font-family:Helvetica;font-style:normal;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-size:medium"><span style="border-collapse:separate;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><span style="border-collapse:separate;font-variant:normal;letter-spacing:normal;line-height:normal;text-align:-webkit-auto;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px"><div style="font-style:normal;font-size:medium;font-family:Helvetica;font-weight:normal">
<font color="#13708a"><a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a></font></div></span><br><span></span><span style="font-style:normal;font-size:medium;font-family:Helvetica;font-weight:normal"></span><span style="font-weight:normal"></span></span><span><img height="125" width="125"></span>
</span></span></span></div>
<br><div><div>Le 9 juil. 2012 à 16:09, Leander Bessa Beernaert a écrit :</div><div><div><br><blockquote type="cite">Ok, so i've updated to the test packages from <div><br></div><div>The migration still fails, but i see no errors in the logs. I'm trying to migrate a VM with the m1.tiny flavor from one machine to another. Their hardware are identical and they have more than enough resources to support the m1.tiny flavor:</div>
<div><br></div><div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><font face="courier new, monospace">cloud35 (total) 4 3867 186<br>
cloud35 (used_now) 0 312 5<br>cloud35 (used_max) 0 0 0</font></blockquote></div><div><br></div><div>These are the logs from the origin compute node: <a href="http://paste.openstack.org/show/19319/" target="_blank">http://paste.openstack.org/show/19319/</a> and the destination compute node: <a href="http://paste.openstack.org/show/19318/" target="_blank">http://paste.openstack.org/show/19318/</a> . The scheduler's log has no visible errors or stack traces.</div>
<div><br></div><div>I'm still using nfsv4. </div><div><br></div><div>Any ideas?</div><div><br></div><div><br></div><div><div class="gmail_quote">On Fri, Jul 6, 2012 at 7:57 PM, Leander Bessa Beernaert <span dir="ltr"><<a href="mailto:leanderbb@gmail.com" target="_blank">leanderbb@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Thanks for the tip, it's a better than nothing :)<br><br>Regards,<div>Leander<div><div><br><div class="gmail_quote">
On Fri, Jul 6, 2012 at 6:32 PM, Mandar Vaze / मंदार वझे <span dir="ltr"><<a href="mailto:mandarvaze@gmail.com" target="_blank">mandarvaze@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Not sure if you are able to debug this, but a while ago there was a bug where <a href="http://instance.id/" target="_blank">instance.id</a> was passed where instance.uuid was expected. This used to cause some problem.<div>
It looks like you are using distribution package rather than devstack installation, so it is likely that the issue is now fixed. Can you try latest packages (and/or try devstack if you can)</div>
<div><br></div><div>I wish I could help more.</div><div><br></div><div>-Mandar<br><br><br><div class="gmail_quote"><div><div>On Fri, Jul 6, 2012 at 3:26 PM, Leander Bessa Beernaert <span dir="ltr"><<a href="mailto:leanderbb@gmail.com" target="_blank">leanderbb@gmail.com</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div>Hello,<div><br></div><div>I've recently setup a system to test out the live migration feature. So far i've been able to launch the instances with the shared nfs folder. However, when i run the live-migration command i encounter this error in the destination compute node:</div>
<div><div style="color:rgb(34,34,34);font-size:13px;font-family:arial,sans-serif"><br></div><div style="color:rgb(34,34,34);font-size:13px;font-family:arial,sans-serif">
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">2012-07-05 09:33:48 ERROR nova.manager [-] Error during ComputeManager.update_available_resource: Domain not found: no domain with matching id 2<br>
2012-07-05 09:33:48 TRACE nova.manager Traceback (most recent call last):<br>2012-07-05 09:33:48 TRACE nova.manager File "/usr/lib/python2.7/dist-packages/nova/manager.py", line 155, in periodic_tasks<br>2012-07-05 09:33:48 TRACE nova.manager task(self, context)<br>
2012-07-05 09:33:48 TRACE nova.manager File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2409, in update_available_resource<br>2012-07-05 09:33:48 TRACE nova.manager self.driver.update_available_resource(context, self.host)<br>
2012-07-05 09:33:48 TRACE nova.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 1936, in update_available_resource<br>2012-07-05 09:33:48 TRACE nova.manager 'vcpus_used': self.get_vcpu_used(),<br>
2012-07-05 09:33:48 TRACE nova.manager File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 1743, in get_vcpu_used<br>2012-07-05 09:33:48 TRACE nova.manager dom = self._conn.lookupByID(dom_id)<br>
2012-07-05 09:33:48 TRACE nova.manager File "/usr/lib/python2.7/dist-packages/libvirt.py", line 2363, in lookupByID<br>2012-07-05 09:33:48 TRACE nova.manager if ret is None:raise libvirtError('virDomainLookupByID() failed', conn=self)<br>
2012-07-05 09:33:48 TRACE nova.manager libvirtError: Domain not found: no domain with matching id 2</blockquote></div><div style="color:rgb(34,34,34);font-size:13px;font-family:arial,sans-serif">
<br></div><div style="color:rgb(34,34,34);font-size:13px;font-family:arial,sans-serif">Any ideas on how to solve this?</div></div><div style="color:rgb(34,34,34);font-size:13px;font-family:arial,sans-serif">
<br></div><div style="color:rgb(34,34,34);font-size:13px;font-family:arial,sans-serif">Regards,</div><div style="color:rgb(34,34,34);font-size:13px;font-family:arial,sans-serif">
Leander</div>
<br></div></div>_______________________________________________<br>
Mailing list: <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
Post to : <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
Unsubscribe : <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><br>
<br></blockquote></div><br></div>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div>
_______________________________________________<br>Mailing list: <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>Post to : <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
Unsubscribe : <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><br>
</blockquote></div></div></div><br></div></div></blockquote></div><br></div></div></div>
<br>_______________________________________________<br>
Mailing list: <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
Post to : <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
Unsubscribe : <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><br>
<br></blockquote></div><br></div></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br>
</div></div></blockquote></div><br></div></div></div>
</blockquote></div><br>
</div></div></blockquote></div><br>