<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">No other tools. Running a stock Ubuntu 14.04 server, installed devstack, created local.conf, stacked, and tried to create a VM. Ive since seen this on another VM I have running with Kilo code, so it is not specifically a Juno issue.<div><br></div><div>I dont see what the difference is between a working and non-working setup. :(</div><div><br></div><div>On all instances, virsh -v shows 1.2.2.</div><div><br></div><div>Baffled.</div><div><br></div><div><br><div apple-content-edited="true">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div><div>PCM (Paul Michali)</div><div><br></div><div>MAIL
..
. <a href="mailto:pcm@cisco.com">pcm@cisco.com</a></div><div>IRC
..
pc_m (<a href="http://irc.freenode.com">irc.freenode.com</a>)</div><div>TW
... @pmichali</div><div>GPG Key
4525ECC253E31A83</div><div>Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83</div></div><div><br></div></div><br class="Apple-interchange-newline"><br class="Apple-interchange-newline">
</div>
<br><div><div>On Jan 2, 2015, at 4:48 AM, Kevin Benton <<a href="mailto:blak111@gmail.com">blak111@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">Ah, doesn't seem to be a Neutron issue then since the<br>'network-vif-plugged' event is showing up and it's attempting to<br>resume.<br><br>The red flag looks like that "Instance is paused unexpectedly.<br>Ignore.". If you grep the nova code base for that, it brings up a note<br>linking to bug 1097806.[1] The VM is paused when Nova didn't expect it<br>to be. Do you have any other tools running that might be affecting<br>kvm?<br><br>1. <a href="https://bugs.launchpad.net/nova/+bug/1097806">https://bugs.launchpad.net/nova/+bug/1097806</a><br><br>On Thu, Jan 1, 2015 at 8:09 AM, Paul Michali (pcm) <<a href="mailto:pcm@cisco.com">pcm@cisco.com</a>> wrote:<br><blockquote type="cite">Hi Kevin,<br><br>No exceptions/tracebacks/errors in Neutron at all. In the Nova logs, it<br>seems to create the instance, pause, and then resume, but it looks like<br>maybe it is not resuming?<br><br>2015-01-01 14:44:30.716 3516 DEBUG nova.openstack.common.processutils [-]<br>Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf<br>ovs-vsctl --timeout=120 -- --if-exists del-port qvoded0d35f-20 -- add-port<br>br-int qvoded0d35\<br>f-20 -- set Interface qvoded0d35f-20<br>external-ids:iface-id=ded0d35f-204f-4ca8-a85b-85decb53d9fe<br>external-ids:iface-status=active external-ids:attached-mac=fa:16:3e:81:ab:12<br>external-ids:vm-uuid=c32ac737-1788-4420-b200-2a107d5ad335 exec\<br>ute /opt/stack/nova/nova/openstack/common/processutils.py:161<br>2015-01-01 14:44:30.786 3516 DEBUG nova.openstack.common.processutils [-]<br>Result was 0 execute<br>/opt/stack/nova/nova/openstack/common/processutils.py:195<br>2015-01-01 14:44:31.542 3516 DEBUG nova.virt.driver [-] Emitting event<br><LifecycleEvent: 1420123471.54, c32ac737-1788-4420-b200-2a107d5ad335 =><br>Started> emit_event /opt/stack/nova/nova/virt/driver.py:1298<br>2015-01-01 14:44:31.543 3516 INFO nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] VM Started (Lifecycle Event)<br>2015-01-01 14:44:31.584 DEBUG nova.compute.manager<br>[req-77c13ae6-ccf9-48ee-881a-8bb7f04ee4bc None None] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state<br>after lifecycle event "Started"; current vm_sta\<br>te: building, current task_state: spawning, current DB power_state: 0, VM<br>power_state: 1 handle_lifecycle_event<br>/opt/stack/nova/nova/compute/manager.py:1105<br>2015-01-01 14:44:31.629 INFO nova.compute.manager<br>[req-77c13ae6-ccf9-48ee-881a-8bb7f04ee4bc None None] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] During sync_power_state the instance<br>has a pending task (spawning). Skip.<br>2015-01-01 14:44:31.630 3516 DEBUG nova.virt.driver [-] Emitting event<br><LifecycleEvent: 1420123471.54, c32ac737-1788-4420-b200-2a107d5ad335 =><br>Paused> emit_event /opt/stack/nova/nova/virt/driver.py:1298<br>2015-01-01 14:44:31.630 3516 INFO nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] VM Paused (Lifecycle Event)<br>2015-01-01 14:44:31.670 3516 DEBUG nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state<br>after lifecycle event "Paused"; current vm_state: building, current<br>task_state: spawning, c\<br>urrent DB power_state: 0, VM power_state: 3 handle_lifecycle_event<br>/opt/stack/nova/nova/compute/manager.py:1105<br>2015-01-01 14:44:31.714 3516 INFO nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] During sync_power_state the instance<br>has a pending task (spawning). Skip.<br>2015-01-01 14:44:38.293 DEBUG nova.compute.manager<br>[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Received event<br>network-vif-plugged-ded0d35f-204f-4ca8-a85b-85decb53d9fe externa\<br>l_instance_event /opt/stack/nova/nova/compute/manager.py:6180<br>2015-01-01 14:44:38.293 DEBUG nova.openstack.common.lockutils<br>[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Created new<br>semaphore "c32ac737-1788-4420-b200-2a107d5ad335-events" internal_lock<br>/opt/stack/nova/nova/openstack/comm\<br>on/lockutils.py:206<br>2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils<br>[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Acquired semaphore<br>"c32ac737-1788-4420-b200-2a107d5ad335-events" lock<br>/opt/stack/nova/nova/openstack/common/lockutils\<br>.py:229<br>2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils<br>[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Got semaphore / lock<br>"_pop_event" inner /opt/stack/nova/nova/openstack/common/lockutils.py:271<br>2015-01-01 14:44:38.294 DEBUG nova.openstack.common.lockutils<br>[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Releasing semaphore<br>"c32ac737-1788-4420-b200-2a107d5ad335-events" lock<br>/opt/stack/nova/nova/openstack/common/lockutil\<br>s.py:238<br>2015-01-01 14:44:38.295 DEBUG nova.openstack.common.lockutils<br>[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] Semaphore / lock<br>released "_pop_event" inner<br>/opt/stack/nova/nova/openstack/common/lockutils.py:275<br>2015-01-01 14:44:38.295 DEBUG nova.compute.manager<br>[req-0dc50994-e997-41b5-99f2-0a0333f1ea11 nova service] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Processing event<br>network-vif-plugged-ded0d35f-204f-4ca8-a85b-85decb53d9fe _proc\<br>ess_instance_event /opt/stack/nova/nova/compute/manager.py:6166<br>2015-01-01 14:44:38.309 3516 DEBUG nova.virt.libvirt.driver [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Instance is running spawn<br>/opt/stack/nova/nova/virt/libvirt/driver.py:2622<br>2015-01-01 14:44:38.310 3516 DEBUG nova.virt.driver [-] Emitting event<br><LifecycleEvent: 1420123478.31, c32ac737-1788-4420-b200-2a107d5ad335 =><br>Resumed> emit_event /opt/stack/nova/nova/virt/driver.py:1298<br>2015-01-01 14:44:38.311 3516 INFO nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] VM Resumed (Lifecycle Event)<br>2015-01-01 14:44:38.315 3516 INFO nova.virt.libvirt.driver [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Instance spawned successfully.<br>2015-01-01 14:44:38.315 3516 DEBUG nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Checking state _get_power_state<br>/opt/stack/nova/nova/compute/manager.py:1156<br>2015-01-01 14:44:38.348 3516 DEBUG nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state<br>after lifecycle event "Resumed"; current vm_state: building, current<br>task_state: spawning, \<br>current DB power_state: 0, VM power_state: 1 handle_lifecycle_event<br>/opt/stack/nova/nova/compute/manager.py:1105<br>2015-01-01 14:44:38.391 3516 DEBUG nova.openstack.common.lockutils [-]<br>Releasing semaphore "c32ac737-1788-4420-b200-2a107d5ad335" lock<br>/opt/stack/nova/nova/openstack/common/lockutils.py:238<br>2015-01-01 14:44:38.394 3516 DEBUG nova.virt.driver [-] Emitting event<br><LifecycleEvent: 1420123478.31, c32ac737-1788-4420-b200-2a107d5ad335 =><br>Resumed> emit_event /opt/stack/nova/nova/virt/driver.py:1298<br>2015-01-01 14:44:38.394 3516 DEBUG nova.openstack.common.lockutils [-]<br>Semaphore / lock released "_locked_do_build_and_run_instance" inner<br>/opt/stack/nova/nova/openstack/common/lockutils.py:275<br>2015-01-01 14:44:38.396 3516 INFO nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] VM Resumed (Lifecycle Event)<br>2015-01-01 14:44:38.441 3516 DEBUG nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state<br>after lifecycle event "Resumed"; current vm_state: active, current<br>task_state: None, curren\<br>t DB power_state: 1, VM power_state: 1 handle_lifecycle_event<br>/opt/stack/nova/nova/compute/manager.py:1105<br>2015-01-01 14:44:38.489 3516 DEBUG nova.virt.driver [-] Emitting event<br><LifecycleEvent: 1420123478.33, c32ac737-1788-4420-b200-2a107d5ad335 =><br>Paused> emit_event /opt/stack/nova/nova/virt/driver.py:1298<br>2015-01-01 14:44:38.490 3516 INFO nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] VM Paused (Lifecycle Event)<br>2015-01-01 14:44:38.535 3516 DEBUG nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Synchronizing instance power state<br>after lifecycle event "Paused"; current vm_state: active, current<br>task_state: None, current\<br> DB power_state: 1, VM power_state: 3 handle_lifecycle_event<br>/opt/stack/nova/nova/compute/manager.py:1105<br>2015-01-01 14:44:38.643 3516 WARNING nova.compute.manager [-] [instance:<br>c32ac737-1788-4420-b200-2a107d5ad335] Instance is paused unexpectedly.<br>Ignore.<br><br>I think I saw this in one of my Kilo based VMs too.<br><br><br>Regards,<br><br>PCM (Paul Michali)<br><br>MAIL
..
. <a href="mailto:pcm@cisco.com">pcm@cisco.com</a><br>IRC
..
pc_m (<a href="http://irc.freenode.com">irc.freenode.com</a>)<br>TW
... @pmichali<br>GPG Key
4525ECC253E31A83<br>Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83<br><br><br><br><br>On Dec 31, 2014, at 7:57 PM, Kevin Benton <<a href="mailto:blak111@gmail.com">blak111@gmail.com</a>> wrote:<br><br>Any exceptions on the Neutron side? It might not be notifying nova<br>that the network is ready.<br><br>On Wed, Dec 31, 2014 at 8:41 AM, Paul Michali (pcm) <<a href="mailto:pcm@cisco.com">pcm@cisco.com</a>> wrote:<br><br>Not sure if Im going crazy or what. Im using DevStack and, after stacking<br>I tried booting a Cirros 3.2, 3.3, and Ubuntu cloud 14.04 image. Each time,<br>the image ends up in PAUSED power state:<br><br>ubuntu@juno:/opt/stack/neutron$ nova show peter<br>+--------------------------------------+----------------------------------------------------------------+<br>| Property | Value<br>|<br>+--------------------------------------+----------------------------------------------------------------+<br>| OS-DCF:diskConfig | MANUAL<br>|<br>| OS-EXT-AZ:availability_zone | nova<br>|<br>| OS-EXT-SRV-ATTR:host | juno<br>|<br>| OS-EXT-SRV-ATTR:hypervisor_hostname | juno<br>|<br>| OS-EXT-SRV-ATTR:instance_name | instance-00000001<br>|<br>| OS-EXT-STS:power_state | 3<br>|<br>| OS-EXT-STS:task_state | -<br>|<br>| OS-EXT-STS:vm_state | active<br>|<br>| OS-SRV-USG:launched_at | 2014-12-31T15:15:33.000000<br>|<br>| OS-SRV-USG:terminated_at | -<br>|<br>| accessIPv4 |<br>|<br>| accessIPv6 |<br>|<br>| config_drive |<br>|<br>| created | 2014-12-31T15:15:24Z<br>|<br>| flavor | m1.tiny (1)<br>|<br>| hostId |<br>5b0c48250ccc0ac3fca8a821e29e4b154ec0b101f9cc0a0b27071a3f |<br>| id |<br>ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 |<br>| image | cirros-0.3.3-x86_64-uec<br>(797e4dee-8c03-497f-8dac-a44b9351dfa3) |<br>| key_name | -<br>|<br>| metadata | {}<br>|<br>| name | peter<br>|<br>| os-extended-volumes:volumes_attached | []<br>|<br>| private network | 10.0.0.4<br>|<br>| progress | 0<br>|<br>| security_groups | default<br>|<br>| status | ACTIVE<br>|<br>| tenant_id | 7afb5bc1d88d462c8d57178437d3c277<br>|<br>| updated | 2014-12-31T15:15:34Z<br>|<br>| user_id | 4ff18bdbeb4d436ea4ff1bcd29e269a9<br>|<br>+--------------------------------------+----------------------------------------------------------------+<br>ubuntu@juno:/opt/stack/neutron$ nova list<br>+--------------------------------------+-------+--------+------------+-------------+------------------+<br>| ID | Name | Status | Task State | Power<br>State | Networks |<br>+--------------------------------------+-------+--------+------------+-------------+------------------+<br>| ec5c8d70-ae80-4cc3-a5bb-b68019170dd6 | peter | ACTIVE | - |<br>Paused | private=10.0.0.4 |<br><br><br>I dont see this with Kilo latest images. Any idea what I may be doing<br>wrong, or if there is an issue (I didnt see anything on Google search)?<br><br>IMAGE_ID=`nova image-list | grep 'cloudimg-amd64 ' | cut -d' ' -f 2`<br>PRIVATE_NET=`neutron net-list | grep 'private ' | cut -f 2 -d' `<br><br>nova boot peter --flavor 3 --image $IMAGE_ID --user-data<br>~/devstack/user_data.txt --nic net-id=$PRIVATE_NET<br>nova boot --flavor 1 --image cirros-0.3.3-x86_64-uec --nic<br>net-id=$PRIVATE_NET paul<br><br>Thanks.<br><br><br>PCM (Paul Michali)<br><br>MAIL
..
. <a href="mailto:pcm@cisco.com">pcm@cisco.com</a><br>IRC
..
pc_m (<a href="http://irc.freenode.com">irc.freenode.com</a>)<br>TW
... @pmichali<br>GPG Key
4525ECC253E31A83<br>Fingerprint .. 307A 96BB 1A4C D2C7 931D 8D2D 4525 ECC2 53E3 1A83<br><br><br><br><br><br>_______________________________________________<br>OpenStack-dev mailing list<br><a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a><br>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev<br><br><br><br><br>--<br>Kevin Benton<br><br>_______________________________________________<br>OpenStack-dev mailing list<br>OpenStack-dev@lists.openstack.org<br>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev<br><br><br><br>_______________________________________________<br>OpenStack-dev mailing list<br>OpenStack-dev@lists.openstack.org<br>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev<br><br></blockquote><br><br><br>-- <br>Kevin Benton<br><br>_______________________________________________<br>OpenStack-dev mailing list<br><a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a><br>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev<br></blockquote></div><br></div></body></html>