<div dir="ltr">George,<div><br></div><div>What is your storage backend using (Gluster/ceph/local disk/etc)?  Some of the distributed backend drivers have bugs in them or mask the real issue (such as watchers on objects).</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Sep 24, 2015 at 8:11 AM, Kris G. Lindgren <span dir="ltr"><<a href="mailto:klindgren@godaddy.com" target="_blank">klindgren@godaddy.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I believe I was talking to Josh Harlow (he's harlowja in #openstack-operators on freenode) from Yahoo, about something like this the other day.  He was saying that recently on a few hypervisors they would randomly run into HV disks that were completely full due to snapshots.  I have not personally ran into this, so I can't be of more help.<br>
<br>
___________________________________________________________________<br>
Kris Lindgren<br>
Senior Linux Systems Engineer<br>
GoDaddy<br>
<div class="HOEnZb"><div class="h5"><br>
<br>
<br>
<br>
<br>
On 9/24/15, 7:02 AM, "George Shuklin" <<a href="mailto:george.shuklin@gmail.com">george.shuklin@gmail.com</a>> wrote:<br>
<br>
>Hello everyone.<br>
><br>
>Is someone ever saw 'endless snapshot' problem? Some instances (with raw<br>
>disks and live snapshoting enabled) are stuck at image_uploading forever.<br>
><br>
>It looks like this:<br>
><br>
>+--------------------------------------+----------------------------------------------------------+<br>
>| Property                             | Value                                                    |<br>
>+--------------------------------------+----------------------------------------------------------+<br>
>| status                               | ACTIVE                                                   |<br>
>| updated                              | 2015-07-16T08:07:00Z                                     |<br>
>| OS-EXT-STS:task_state                | image_uploading                                          |<br>
>| OS-EXT-SRV-ATTR:host                 | compute                                                  |<br>
>| key_name                             | ses                                                      |<br>
>| image                                | Ubuntu 14.04 (3736af94-b25e-4b8d-96fd-fd5949bbd81e)      |<br>
>| OS-EXT-STS:vm_state                  | active                                                   |<br>
>| OS-EXT-SRV-ATTR:instance_name        | instance-0000000d                                        |<br>
>| OS-SRV-USG:launched_at               | 2015-05-09T17:28:09.000000                               |<br>
>| OS-EXT-SRV-ATTR:hypervisor_hostname  | compute.lab.internal                                     |<br>
>| flavor                               | flavor2 (2)                                              |<br>
>| id                                   | f2365fe4-9b30-4c24-b7b9-f7fcb4165160                     |<br>
>| security_groups                      | [{u'name': u'default'}]                                  |<br>
>| OS-SRV-USG:terminated_at             | None                                                     |<br>
>| user_id                              | 61096c639d674e4cb8bf487cec01432a                         |<br>
>| name                                 | non-test                                                 |<br>
>| created                              | 2015-05-09T17:27:48Z                                     |<br>
>...etc<br>
><br>
>Any ideas why this happens? All logs are clear, no errors or anything.<br>
>And it happens at random so no 'debug' log available...<br>
><br>
>_______________________________________________<br>
>OpenStack-operators mailing list<br>
><a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a><br>
><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div>David W.</div>Unix, because every barista in Seattle has an MCSE.</div></div>
</div>