<div dir="ltr">Hi Ceph devs,<div><br></div><div>I raise this bug again because as Ceph becomes more popular, our customer suffers from it and I have no solution for it.</div><div><br></div><div><b>Is there anyway to get the usage of a disk which is a Ceph volume? (Not sure if the term is right or not)</b></div><div><br></div><div>Ceilometer use libvirt.domain.blockInfo(device) to get the usage (allocation/physical/capacity) of a disk, [1]. This works fine when the VM is boot from local file system, and according to the note from [2], it seems blockInfo uses stat instead of querying qemu, so **maybe** this is why it doesn't work for the network type disk: internal error: missing storage backend for network files using rbd protocol.</div><div><br></div><div>libvirt.domain.blockStats() doesn't return usage but r/w bytes/requests, neither domainListGetStats</div><div><br></div><div>I haven't try virStorageVolInfo yet, because don't know the args, but it doesn't return all the 3 usage dimension of a disk, only capacity and allocation[3]</div><div><br></div><div>So I'm asking if anyone can help me to resolve this issue.</div><div>Thank you very much!</div><div><br></div><div>PS: change subject to get ceph devs noticed.</div><div><br></div><div>[1] <a href="https://review.openstack.org/#/c/145819/">https://review.openstack.org/#/c/145819/</a></div><div>[2]
<a href="https://www.redhat.com/archives/libvir-list/2014-December/msg00762.html">https://www.redhat.com/archives/libvir-list/2014-December/msg00762.html</a> </div><div>[3] <a href="https://libvirt.org/html/libvirt-libvirt-storage.html#virStorageVolInfo">https://libvirt.org/html/libvirt-libvirt-storage.html#virStorageVolInfo</a></div><div>[4] <a href="https://bugs.launchpad.net/ceilometer/+bug/1457440">https://bugs.launchpad.net/ceilometer/+bug/1457440</a><br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Nov 18, 2015 at 11:46 PM, Ilya Tyaptin <span dir="ltr"><<a href="mailto:ityaptin@mirantis.com" target="_blank">ityaptin@mirantis.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div style="font-family:arial,helvetica,sans-serif"><div style="font-size:12.8px">Hi, folks! </div><div style="font-size:12.8px"><br></div><div style="font-family:arial,sans-serif;font-size:12.8px"><font face="arial, helvetica, sans-serif">In our deployed envs we met with a libvirt error <b>"missing storage backend for network files using rbd protocol"</b> in </font><span style="font-family:arial,helvetica,sans-serif"><b>virDomainGetBlockInfo</b></span><span style="font-family:arial,helvetica,sans-serif"> call </span><span style="font-family:arial,helvetica,sans-serif"><a href="http://paste.openstack.org/show/479237/" target="_blank">[1]</a><div style="display:inline-block;width:16px;min-height:16px"></div></span><span style="font-family:arial,helvetica,sans-serif">. </span></div><div style="font-family:arial,sans-serif;font-size:12.8px"><font face="arial, helvetica, sans-serif">This exception is raised when Ceilometer are trying to get info about VM disk usage and allocation. </font></div><div style="font-family:arial,sans-serif;font-size:12.8px"><font face="arial, helvetica, sans-serif">It only affects getting measures for a some disk pollsters which added in this CR <a href="https://review.openstack.org/#/c/145819/23/ceilometer/compute/virt/libvirt/inspector.py,cm" target="_blank">[2]</a><div style="display:inline-block;width:16px;min-height:16px"></div> with </font><span style="font-family:arial,helvetica,sans-serif">specified libvirt call <a href="https://github.com/openstack/ceilometer/blob/stable/liberty/ceilometer/compute/virt/libvirt/inspector.py#L215" target="_blank">[3]</a><div style="display:inline-block;width:16px;min-height:16px"></div></span><span style="font-family:arial,helvetica,sans-serif"> . </span></div><div style="font-family:arial,sans-serif;font-size:12.8px"><font face="arial, helvetica, sans-serif">These pollsters have been added in the Kilo cycle and successful work in Kilo deployments, but it doesn't work now.</font></div><div style="font-family:arial,sans-serif;font-size:12.8px"><font face="arial, helvetica, sans-serif"><br></font></div><div style="font-family:arial,sans-serif;font-size:12.8px"><font face="arial, helvetica, sans-serif">Also, we have a bug in the upstream launchpad <a href="https://bugs.launchpad.net/ceilometer/+bug/1457440" target="_blank">[4]</a><div style="display:inline-block;width:16px;min-height:16px"></div> but it have not been fixed yet.</font></div><div style="font-family:arial,sans-serif;font-size:12.8px"><br></div><div style="font-family:arial,sans-serif;font-size:12.8px">I would glad to see any ideas about root cause of this issue or ways to fixing it. </div><div style="font-family:arial,sans-serif;font-size:12.8px"><br></div><div style="font-family:arial,sans-serif;font-size:12.8px"><span style="font-size:12.8px">Thank you in advance!</span><br></div><div style="font-family:arial,sans-serif;font-size:12.8px"><br></div><div style="font-family:arial,sans-serif;font-size:12.8px">References:</div><div style="font-family:arial,sans-serif;font-size:12.8px"><span style="font-family:arial,helvetica,sans-serif">[1] </span><a href="http://paste.openstack.org/show/479237/" target="_blank">Traceback</a><div style="display:inline-block;width:16px;min-height:16px"></div><div style="display:inline-block;width:16px;min-height:16px"> </div><br></div><div style="font-family:arial,sans-serif;font-size:12.8px"><div style="font-family:arial,helvetica,sans-serif"><div>./ceilometer-polling.log.0:4192:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk Traceback (most recent call last):</div><div>./ceilometer-polling.log.0:4193:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk File "/usr/lib/python2.7/dist-packages/ceilometer/compute/pollsters/disk.py", line 703, in get_samples</div><div>./ceilometer-polling.log.0:4194:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk instance,</div><div>./ceilometer-polling.log.0:4195:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk File "/usr/lib/python2.7/dist-packages/ceilometer/compute/pollsters/disk.py", line 672, in _populate_cache</div><div>./ceilometer-polling.log.0:4196:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk for disk, info in disk_info:</div><div>./ceilometer-polling.log.0:4197:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk File "/usr/lib/python2.7/dist-packages/ceilometer/compute/virt/libvirt/inspector.py", line 215, in inspect_disk_info</div><div>./ceilometer-polling.log.0:4198:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk block_info = domain.blockInfo(device)</div><div>./ceilometer-polling.log.0:4199:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk File "/usr/lib/python2.7/dist-packages/libvirt.py", line 658, in blockInfo</div><div>./ceilometer-polling.log.0:4200:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk if ret is None: raise libvirtError ('virDomainGetBlockInfo() failed', dom=self)</div><div>./ceilometer-polling.log.0:4201:2015-11-17 16:20:54.807 14107 ERROR ceilometer.compute.pollsters.disk libvirtError: internal error: missing storage backend for network files using rbd protocol</div></div><div style="font-family:arial,helvetica,sans-serif"><br></div><div><font face="arial, helvetica, sans-serif">[2] CR with this commit: <a href="https://review.openstack.org/#/c/145819/23/ceilometer/compute/virt/libvirt/inspector.py,cm" target="_blank">https://review.openstack.org/#/c/145819/23/ceilometer/compute/virt/libvirt/inspector.py,cm</a><div style="display:inline-block;width:16px;min-height:16px"></div></font><br></div><div><font face="arial, helvetica, sans-serif">[3] Code entry: <a href="https://github.com/openstack/ceilometer/blob/stable/liberty/ceilometer/compute/virt/libvirt/inspector.py#L215" target="_blank">https://github.com/openstack/ceilometer/blob/stable/liberty/ceilometer/compute/virt/libvirt/inspector.py#L215</a><div style="display:inline-block;width:16px;min-height:16px"></div></font></div><div><span style="font-family:arial,helvetica,sans-serif">[4] Upstream bug: <a href="https://bugs.launchpad.net/ceilometer/+bug/1457440" target="_blank">https://bugs.launchpad.net/ceilometer/+bug/1457440</a><div style="display:inline-block;width:16px;min-height:16px"></div></span><br></div></div><div style="font-size:12.8px"><br></div><div style="font-family:arial,sans-serif;font-size:12.8px"><div dir="ltr"><div dir="ltr"><p style="font-size:13px;margin:0in 0in 0.0001pt">Best regards,<u></u></p><p style="font-size:13px;margin:0in 0in 0.0001pt">Tyaptin Il<span style="font-family:arial,helvetica,sans-serif;font-size:12.8px">y</span><span style="font-size:12.8px">a,</span></p><p style="font-size:13px;margin:0in 0in 0.0001pt">Ceilometer developer,</p><p style="font-size:13px;margin:0in 0in 0.0001pt">Mirantis Inc.</p></div></div></div></div><div><div><div dir="ltr"><div><div dir="ltr"><p style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:13px;margin:0in 0in 0.0001pt;background-color:rgb(255,255,255)"><br></p></div></div></div></div></div>
</div>
<br>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div></div></div>