<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Thanks Kris,</p>
<p>I have run the commands as suggested and there is no rbd
installed. However when we try to manually install rbd with pip we
get the following error:</p>
<p>pip install rbd<br>
DEPRECATION: --allow-all-external has been deprecated and will be
removed in the future. Due to changes in the repository protocol,
it no longer has any effect.<br>
Ignoring indexes: <a class="moz-txt-link-freetext" href="https://pypi.python.org/simple">https://pypi.python.org/simple</a><br>
Collecting rbd<br>
Could not find a version that satisfies the requirement rbd
(from versions: )<br>
No matching distribution found for rbd</p>
<p>I assume the playbooks are coming across the same issue which is
why we are having this problem. I will also ask in the
#openstack-ansible channel for some help. <br>
</p>
<p>Pip is using the local repo servers that are created by
openstack-ansible (I assume) so looking at this, it appears they
don't have the correct packages.</p>
<p>Regards,<br>
</p>
<p><br>
</p>
<br>
<div class="moz-cite-prefix">On 21/10/16 16:42, Kris G. Lindgren
wrote:<br>
</div>
<blockquote
cite="mid:70B7B181-7A96-449F-8249-332159D64D43@godaddy.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Title" content="">
<meta name="Keywords" content="">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]-->
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Lucida Grande";
panose-1:2 11 6 0 4 5 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:Calibri;
color:windowtext;}
span.msoIns
{mso-style-type:export-only;
mso-style-name:"";
text-decoration:underline;
color:teal;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
<div class="WordSection1">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri">From the
traceback it looks like nova-compute is running out of a
venv.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri">You need to
activate the venv, most likely via: source
/openstack/venvs/nova-12.0.16/.venv/bin/activate then run:
pip freeze. If you don’t see the RBD stuff – then that is
your issue. You might be able to fix via: pip install rbd.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri">Venv’s are
self-contained python installs, so they do not use the
system level python packages at all.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri">I would also
ask for some help in the #openstack-ansible channel on irc
as well.<o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Calibri;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Calibri;color:black">___________________________________________________________________<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Calibri;color:black">Kris
Lindgren<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Calibri;color:black">Senior
Linux Systems Engineer<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span
style="font-size:10.5pt;font-family:Calibri;color:black">GoDaddy</span><span
style="font-size:11.0pt;font-family:Calibri"><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-family:Calibri;color:black">From: </span>
</b><span style="font-family:Calibri;color:black">Grant
Morley <a class="moz-txt-link-rfc2396E" href="mailto:grant@absolutedevops.io"><grant@absolutedevops.io></a><br>
<b>Date: </b>Friday, October 21, 2016 at 6:14 AM<br>
<b>To: </b>OpenStack Operators
<a class="moz-txt-link-rfc2396E" href="mailto:openstack-operators@lists.openstack.org"><openstack-operators@lists.openstack.org></a><br>
<b>Cc: </b><a class="moz-txt-link-rfc2396E" href="mailto:ian.banks@serverchoice.com">"ian.banks@serverchoice.com"</a>
<a class="moz-txt-link-rfc2396E" href="mailto:ian.banks@serverchoice.com"><ian.banks@serverchoice.com></a><br>
<b>Subject: </b>[Openstack-operators] Instances failing
to launch when rbd backed (ansible Liberty setup)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p>Hi all,<o:p></o:p></p>
<p>We have a openstack-ansible setup and have ceph installed for
the backend. However whenever we try and launch a new instance
it fails to launch and we get the following error:<o:p></o:p></p>
<p style="margin-bottom:12.0pt">2016-10-21 12:08:06.241 70661
INFO nova.virt.libvirt.driver
[req-79811c40-8394-4e33-b16d-ff5fa7341b6a
41c60f65ae914681b6a6ca27a42ff780
324844c815084205995aff10b03a85e1 - - -] [instance:
5633d98e-5f79-4c13-8d45-7544069f0e6f] Creating image<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[req-79811c40-8394-4e33-b16d-ff5fa7341b6a
41c60f65ae914681b6a6ca27a42ff780
324844c815084205995aff10b03a85e1 - - -] [instance:
5633d98e-5f79-4c13-8d45-7544069f0e6f] Instance failed to spawn<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] Traceback
(most recent call last):<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/compute/manager.py",
line 2156, in _build_resources<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] yield
resources<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/compute/manager.py",
line 2009, in _build_and_run_instance<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]
block_device_info=block_device_info)<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/driver.py",
line 2527, in spawn<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]
admin_pass=admin_password)<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/driver.py",
line 2939, in _create_image<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] backend =
image('disk')<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/driver.py",
line 2884, in image<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] fname +
suffix, image_type)<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py",
line 967, in image<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] return
backend(instance=instance, disk_name=disk_name)<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py",
line 748, in __init__<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]
rbd_user=self.rbd_user)<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py",
line 117, in __init__<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] raise
RuntimeError(_('rbd python libraries not found'))<br>
2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
[instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] RuntimeError:
rbd python libraries not found<o:p></o:p></p>
<p>It moans about the rbd python libraries not being found,
however all of the rbd libraries appear to be installed fine
via apt. ( We are running Ubuntu)<o:p></o:p></p>
<p>Compute host packages:<o:p></o:p></p>
<p>dpkg -l | grep ceph<br>
ii ceph-common
10.2.3-1trusty amd64 common
utilities to mount and interact with a ceph storage cluster<br>
ii libcephfs1
10.2.3-1trusty amd64 Ceph
distributed file system client library<br>
ii python-ceph
10.2.3-1trusty amd64
Meta-package for python libraries for the Ceph libraries<br>
ii python-cephfs
10.2.3-1trusty amd64 Python
libraries for the Ceph libcephfs library<o:p></o:p></p>
<p> dpkg -l | grep rbd<br>
ii librbd1
10.2.3-1trusty amd64 RADOS block
device client library<br>
ii python-rbd
10.2.3-1trusty amd64 Python
libraries for the Ceph librbd library<o:p></o:p></p>
<p>Has anyone come across this before? Ceph is working fine for
Glance, it just seems to be with the nova compute hosts.<o:p></o:p></p>
<p>Many thanks,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">-- <br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal"><span
style="font-size:8.5pt;font-family:"Lucida
Grande";color:#A8D8FF"><img id="_x0000_i1025"
src="cid:part1.BB14BFA9.96B6614F@absolutedevops.io"
height="28" width="60"></span><o:p></o:p></p>
<div style="margin-left:60.0pt;margin-bottom:3.75pt">
<p class="MsoNormal" style="mso-line-height-alt:11.25pt"><span
style="font-size:13.5pt;font-family:"Lucida
Grande";color:#239DFF">Grant Morley</span><span
style="color:#6DBEFF">
<o:p></o:p></span></p>
</div>
<div style="margin-left:60.0pt;margin-bottom:7.5pt">
<p class="MsoNormal" style="mso-line-height-alt:11.25pt"><span
style="font-size:11.5pt;font-family:"Lucida
Grande";color:#6DBEFF">Cloud Lead</span><span
style="font-family:"Lucida
Grande";color:#6DBEFF">
</span><span style="color:#6DBEFF"><o:p></o:p></span></p>
</div>
<div style="margin-left:60.0pt">
<p class="MsoNormal" style="line-height:11.25pt"><span
style="font-size:10.0pt;font-family:"Lucida
Grande";color:#616161">Absolute</span><span
style="font-size:10.0pt;font-family:"Lucida
Grande";color:#999999">
</span><span
style="font-size:10.0pt;font-family:"Lucida
Grande";color:#98A5B0">DevOps Ltd</span><span
style="font-size:10.0pt;font-family:"Lucida
Grande";color:#999999">
<br>
Units H, J & K, Gateway 1000, Whittle Way,
Stevenage, Herts, SG1 2FP <o:p></o:p></span></p>
</div>
<div style="margin-left:60.0pt">
<p class="MsoNormal"><span
style="font-size:10.0pt;font-family:Helvetica"><a
moz-do-not-send="true"
href="http://www.absolutedevops.io/"><span
style="font-family:"Lucida
Grande";color:#239DFF;text-decoration:none">www.absolutedevops.io</span></a>
<a moz-do-not-send="true"
href="mailto:grant@absolutedevops.i"><span
style="font-family:"Lucida
Grande";color:#239DFF;text-decoration:none">grant@absolutedevops.io</span></a>
0845 874 0580
<o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<!--?xml version="1.0" encoding="UTF-8" standalone="no"?-->
<title></title>
<div style="height:13px"> </div>
<div> <font face="Lucida Grande, Verdana, Arial, sans-serif"
color="#A8D8FF"> <span style="font-size: 11px; line-height:
15px; float: left; margin-right: 10px;"> <img
src="cid:part4.8B88ADFE.FCAB5B88@absolutedevops.io"
style="color: #a8d8ff; font-family: 'Lucida Grande',
Verdana, Arial, sans-serif; font-size: 11px; line-height:
15px; float: left; margin-top: 0px; margin-right: 10px"> </span>
</font>
<div style="margin-left: 80px; line-height: 15px; color:
rgb(109, 190, 255); margin-bottom: 5px;"> <span
style="font-family: Hind, 'Lucida Grande', Verdana, Arial,
sans-serif; font-size: 18px; font-weight: 200; color:
rgb(35, 157, 255);">Grant Morley</span> <span style="color:
rgb(35, 157, 255); font-size: 15px;"> </span> <font
face="Hind, Lucida Grande, Verdana, Arial, sans-serif"> <span
style="font-size: 15px;"> </span> </font> </div>
<div style="margin-left: 80px; line-height: 15px; color:
rgb(109, 190, 255); margin-bottom: 10px;"> <font face="Hind,
Lucida Grande, Verdana, Arial, sans-serif"> <span
style="font-size: 15px;">Cloud Lead</span> </font> </div>
<div style="font-family: Hind, 'Lucida Grande', Verdana, Arial,
sans-serif; font-size: 13px; margin-left: 80px; line-height:
15px; color: rgb(153, 153, 153);"> <span style="color:
#616161">Absolute</span> <span style="color: #98a5b0">DevOps
Ltd</span> <br>
Units H, J & K, Gateway 1000, Whittle Way, Stevenage,
Herts, SG1 2FP
</div>
<div style="font-family: Hind, helvetica, arial; font-size:
13px; margin-left: 80px;"> <a
href="http://www.absolutedevops.io/" style="color: #239dff;
font-family: Hind, 'Lucida Grande', Verdana, Arial,
sans-serif;line-height: 15px; margin-right: 6px;
text-decoration: none;">www.absolutedevops.io</a> <a
href="mailto:grant@absolutedevops.i" style="color: #239dff;
font-family: Hind, 'Lucida Grande', Verdana, Arial,
sans-serif;line-height: 15px; margin-right: 6px;
text-decoration: none;">grant@absolutedevops.io</a> <a
style="color: #239dff; font-family: Hind, 'Lucida Grande',
Verdana, Arial, sans-serif;line-height: 15px; margin-right:
6px;">0845 874 0580</a> </div>
</div>
</div>
</body>
</html>