<div dir="ltr">Mohammed,<div><br></div><div>It looks like you may be right. Just found the permissions issue in the nova log on the compute node.</div><div><br></div><div><div>4-e8f52e4fbcfb 691caf1c10354efab3e3c8ed61b7d89a 49bc5e5bf2684bd0948d9f94c7875027 - - -] Performing standard snapshot because direct snapshot failed: no write permission on storage pool images</div></div><div><br></div><div>I'm going to test the change and will send an update you all with the results.</div><div><br></div><div>Thank You,</div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="margin-top:8px;margin-bottom:8px;font-family:Helvetica,Verdana,Arial,sans-serif;font-size:0.85em;color:rgb(51,51,51);line-height:1.4"><span style="font-size:0.85em;line-height:1.4">___</span><br></p><p style="margin-top:8px;margin-bottom:8px;font-family:Helvetica,Verdana,Arial,sans-serif;font-size:1.1em;color:rgb(51,51,51);line-height:1.4">John Petrini</p><p style="margin-top:8px;margin-bottom:8px;font-family:Helvetica,Verdana,Arial,sans-serif;font-size:1.1em;color:rgb(51,51,51);line-height:1.4"><br></p></div></div></div></div></div></div></div></div></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><br>
</blockquote>
<br></span>
Yes, we are also running Mitaka and I also read Sebastien Han's blogs ;-)<span class=""><br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
our snapshots are not happening at the RBD level,<br>
they are being copied and uploaded to glance which takes up a lot of space<br>
and is very slow.<br>
</blockquote>
<br></span>
Unfortunately, that's what we are experiencing, too. I don't know if there's something I missed in the nova configs or somewhere else, but I'm relieved that I'm not the only one :-)<br>
<br>
While writing this email I searched again and found something:<br>
<br>
<a href="https://specs.openstack.org/openstack/nova-specs/specs/mitaka/implemented/rbd-instance-snapshots.html" rel="noreferrer" target="_blank">https://specs.openstack.org/op<wbr>enstack/nova-specs/specs/mitak<wbr>a/implemented/rbd-instance-<wbr>snapshots.html</a><br>
<br>
<a href="https://review.openstack.org/#/c/205282/" rel="noreferrer" target="_blank">https://review.openstack.org/#<wbr>/c/205282/</a><br>
<br>
It seems to be implemented already, I'm looking for the config options to set. If you manage to get nova to make rbd snapshots, please let me know ;-)<br>
<br>
Regards,<br>
Eugen<div class="HOEnZb"><div class="h5"><br>
<br>
<br>
Zitat von John Petrini <<a href="mailto:jpetrini@coredial.com" target="_blank">jpetrini@coredial.com</a>>:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi Eugen,<br>
<br>
Thanks for the response! That makes a lost of sense and is what I figured<br>
was going on but I missed it in the documentation. We use Ceph as well and<br>
I had considered doing the snapshots at the RBD level but I was hoping<br>
there was someway to accomplish this via nova. I came across this Sebastien<br>
Han write-up that claims this functionality was added to Mitaka:<br>
<a href="http://www.sebastien-han.fr/blog/2015/10/05/openstack-nova-snapshots-on-ceph-rbd/" rel="noreferrer" target="_blank">http://www.sebastien-han.fr/bl<wbr>og/2015/10/05/openstack-nova-<wbr>snapshots-on-ceph-rbd/</a><br>
<br>
We are running Mitaka but our snapshots are not happening at the RBD level,<br>
they are being copied and uploaded to glance which takes up a lot of space<br>
and is very slow.<br>
<br>
Have you or anyone else implemented this in Mitaka? Other than Sebastian's<br>
blog I haven't found any documentation on this.<br>
<br>
Thank You,<br>
<br>
___<br>
<br>
John Petrini<br>
<br>
On Wed, Jan 11, 2017 at 3:32 AM, Eugen Block <<a href="mailto:eblock@nde.ag" target="_blank">eblock@nde.ag</a>> wrote:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi,<br>
<br>
this seems to be exptected, the docs say:<br>
<br>
"Shut down the source VM before you take the snapshot to ensure that all<br>
data is flushed to disk."<br>
<br>
So if the VM is not shut down, it's freezed to prevent data loss (I<br>
guess). Depending on your storage backend, there are other ways to perform<br>
backups of your VMs.<br>
We use Ceph as backend for nova, glance and cinder. Ceph stores the disks,<br>
images and volumes as Rados block device objects. We have a backup script<br>
that creates snapshots of these RBDs, which are exported to our backup<br>
drive. This way the running VM is not stopped or freezed, the user doesn't<br>
notice any issues. Unlike a nova snapshot, the rbd snapshot is created<br>
immediately within a few seconds. After a successful backup the snapshots<br>
are removed.<br>
<br>
Hope this helps! If you are interested in Ceph, visit [1].<br>
<br>
Regards,<br>
Eugen<br>
<br>
[1] <a href="http://docs.ceph.com/docs/giant/start/intro/" rel="noreferrer" target="_blank">http://docs.ceph.com/docs/gian<wbr>t/start/intro/</a><br>
<br>
<br>
Zitat von John Petrini <<a href="mailto:jpetrini@coredial.com" target="_blank">jpetrini@coredial.com</a>>:<br>
<br>
<br>
Hello,<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
I've just started experimenting with nova backup and discovered that there<br>
is a period of time during the snapshot where the instance becomes<br>
unreachable. Is this behavior expected during a live snapshot? Is there<br>
any<br>
way to prevent this?<br>
<br>
___<br>
<br>
John Petrini<br>
<br>
</blockquote>
<br>
<br>
<br>
--<br>
Eugen Block voice : <a href="tel:%2B49-40-559%2051%2075" value="+49405595175" target="_blank">+49-40-559 51 75</a><br>
NDE Netzdesign und -entwicklung AG fax : <a href="tel:%2B49-40-559%2051%2077" value="+49405595177" target="_blank">+49-40-559 51 77</a><br>
Postfach 61 03 15<br>
D-22423 Hamburg e-mail : <a href="mailto:eblock@nde.ag" target="_blank">eblock@nde.ag</a><br>
<br>
Vorsitzende des Aufsichtsrates: Angelika Mozdzen<br>
Sitz und Registergericht: Hamburg, HRB 90934<br>
Vorstand: Jens-U. Mozdzen<br>
USt-IdNr. DE 814 013 983<br>
<br>
<br>
______________________________<wbr>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstac" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac</a><br>
k<br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstac" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac</a><br>
k<br>
<br>
</blockquote></blockquote>
<br>
<br>
<br>
-- <br>
Eugen Block voice : <a href="tel:%2B49-40-559%2051%2075" value="+49405595175" target="_blank">+49-40-559 51 75</a><br>
NDE Netzdesign und -entwicklung AG fax : <a href="tel:%2B49-40-559%2051%2077" value="+49405595177" target="_blank">+49-40-559 51 77</a><br>
Postfach 61 03 15<br>
D-22423 Hamburg e-mail : <a href="mailto:eblock@nde.ag" target="_blank">eblock@nde.ag</a><br>
<br>
Vorsitzende des Aufsichtsrates: Angelika Mozdzen<br>
Sitz und Registergericht: Hamburg, HRB 90934<br>
Vorstand: Jens-U. Mozdzen<br>
USt-IdNr. DE 814 013 983<br>
<br>
</div></div></blockquote></div><br></div></div>