<div dir="ltr"><span style="font-size:12.8000001907349px">HI Daniel,</span><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Yep found that all out.</div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Now I'm struggling through the NUMA mismatch. NUMA as there are two cpus. The old <span class="">CPU</span> was a 10 core 20 thread thus 40 "cpus", {0-9,20-29} and then {10-19,30-39} on the other cell. The new <span class="">CPU</span> is a 12 core 24 thread. Apparently even in kilo, this results in a mismatch if I'm running a 2 VCPU guest and trying to migrate from new to old. I suspect I <span class="">have</span> to disable NUMA somehow (filter, etc) but it is entirely non-obvious. And of course I'm doing this again in OpenStack nova (not direct libvirt) so I'm going to do a bit more research and then file a new bug. This also may be fixed in Kilo but I"m not finding it (and it may be fixed in Liberty already and just need a backport.)</div><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">My apologies for not following up to the list once I found the Kilo solution to the original problem.</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jul 17, 2015 at 6:10 AM, Daniel P. Berrange <span dir="ltr"><<a href="mailto:berrange@redhat.com" target="_blank">berrange@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">On Fri, Jul 17, 2015 at 01:07:56PM +0100, Daniel P. Berrange wrote:<br>
> On Thu, Jul 09, 2015 at 12:00:15PM -0600, David Medberry wrote:<br>
> > Hi,<br>
> ><br>
> > When trying to live-migrate between two distinct CPUs, I kind of expect<br>
> > there to be issues. Which is why openstack supports the "cpu_mode=custom",<br>
> > "cpu_model=MODELNAME" flags for libvirt.<br>
> ><br>
> > When I set those to some Lowest Common Denominator (and restart<br>
> > everything), I still git the issue. I've set both systems to SandyBridge<br>
> > and tested as well as Conroe. The actual CPUs are Ivy Bridge and Haswell<br>
> > (newer than SandyBridge and supersets thereof.)<br>
> ><br>
> > The Older->Newer migration works fine (even without setting a cpu_model)<br>
> > but the newer to older never works.<br>
> ><br>
> > Specfics:<br>
> > OpenStack Juno.2<br>
> > LibVirt: 1.2.2<br>
> ><br>
> > Older: model name : Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz (Ivy Bridge)<br>
> > Newer: model name : Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz (Haswell)<br>
> ><br>
> > Daniel, Operators: Any ideas?<br>
><br>
> In versions of Nova prior to Liberty, nova did an incorrect CPU model<br>
> comparison. It checks the source *host* CPU model against the dest<br>
> host CPU model, instead of checking the *guest* CPU model against the<br>
> dest host CPU model.<br>
><br>
> This is fixed in Liberty, provided you have the cpu_mode=custom and<br>
> cpu_modelk=MODELNAME parameters set. Unfortunately the fix will only<br>
> work for guests that are launched under Liberty codebase as it needed<br>
> a database addition. So if you have existing running guests from Juno<br>
> those need restarting after upgrade.<br>
<br>
</div></div>Sigh, s/Liberty/Kilo/ in everything I wrote here<br>
<div class="HOEnZb"><div class="h5"><br>
Regards,<br>
Daniel<br>
--<br>
|: <a href="http://berrange.com" rel="noreferrer" target="_blank">http://berrange.com</a> -o- <a href="http://www.flickr.com/photos/dberrange/" rel="noreferrer" target="_blank">http://www.flickr.com/photos/dberrange/</a> :|<br>
|: <a href="http://libvirt.org" rel="noreferrer" target="_blank">http://libvirt.org</a> -o- <a href="http://virt-manager.org" rel="noreferrer" target="_blank">http://virt-manager.org</a> :|<br>
|: <a href="http://autobuild.org" rel="noreferrer" target="_blank">http://autobuild.org</a> -o- <a href="http://search.cpan.org/~danberr/" rel="noreferrer" target="_blank">http://search.cpan.org/~danberr/</a> :|<br>
|: <a href="http://entangle-photo.org" rel="noreferrer" target="_blank">http://entangle-photo.org</a> -o- <a href="http://live.gnome.org/gtk-vnc" rel="noreferrer" target="_blank">http://live.gnome.org/gtk-vnc</a> :|<br>
</div></div></blockquote></div><br></div>