<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <p>Thanks Kris,</p>
    <p>I have run the commands as suggested and there is no rbd
      installed. However when we try to manually install rbd with pip we
      get the following error:</p>
    <p>pip install rbd<br>
      DEPRECATION: --allow-all-external has been deprecated and will be
      removed in the future. Due to changes in the repository protocol,
      it no longer has any effect.<br>
      Ignoring indexes: <a class="moz-txt-link-freetext" href="https://pypi.python.org/simple">https://pypi.python.org/simple</a><br>
      Collecting rbd<br>
        Could not find a version that satisfies the requirement rbd
      (from versions: )<br>
      No matching distribution found for rbd</p>
    <p>I assume the playbooks are coming across the same issue which is
      why we are having this problem. I will also ask in the
      #openstack-ansible channel for some help. <br>
    </p>
    <p>Pip is using the local repo servers that are created by
      openstack-ansible (I assume) so looking at this, it appears they
      don't have the correct packages.</p>
    <p>Regards,<br>
    </p>
    <p><br>
    </p>
    <br>
    <div class="moz-cite-prefix">On 21/10/16 16:42, Kris G. Lindgren
      wrote:<br>
    </div>
    <blockquote
      cite="mid:70B7B181-7A96-449F-8249-332159D64D43@godaddy.com"
      type="cite">
      <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
      <meta name="Title" content="">
      <meta name="Keywords" content="">
      <meta name="Generator" content="Microsoft Word 15 (filtered
        medium)">
      <!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]-->
      <style><!--
/* Font Definitions */
@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
        {font-family:"Lucida Grande";
        panose-1:2 11 6 0 4 5 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:purple;
        text-decoration:underline;}
p
        {mso-style-priority:99;
        mso-margin-top-alt:auto;
        margin-right:0in;
        mso-margin-bottom-alt:auto;
        margin-left:0in;
        font-size:12.0pt;
        font-family:"Times New Roman";}
span.EmailStyle18
        {mso-style-type:personal-reply;
        font-family:Calibri;
        color:windowtext;}
span.msoIns
        {mso-style-type:export-only;
        mso-style-name:"";
        text-decoration:underline;
        color:teal;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-size:10.0pt;}
@page WordSection1
        {size:8.5in 11.0in;
        margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
        {page:WordSection1;}
--></style>
      <div class="WordSection1">
        <p class="MsoNormal"><span
            style="font-size:11.0pt;font-family:Calibri">From the
            traceback it looks like nova-compute is running out of a
            venv.<o:p></o:p></span></p>
        <p class="MsoNormal"><span
            style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
            style="font-size:11.0pt;font-family:Calibri">You need to
            activate the venv, most likely via: source
            /openstack/venvs/nova-12.0.16/.venv/bin/activate then run:
            pip freeze.  If you don’t see the RBD stuff – then that is
            your issue.  You might be able to fix via: pip install rbd.<o:p></o:p></span></p>
        <p class="MsoNormal"><span
            style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
            style="font-size:11.0pt;font-family:Calibri">Venv’s are
            self-contained python installs, so they do not use the
            system level python packages at all.<o:p></o:p></span></p>
        <p class="MsoNormal"><span
            style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
            style="font-size:11.0pt;font-family:Calibri">I would also
            ask for some help in the #openstack-ansible channel on irc
            as well.<o:p></o:p></span></p>
        <div>
          <div>
            <p class="MsoNormal"><span
                style="font-size:10.5pt;font-family:Calibri;color:black"><o:p> </o:p></span></p>
          </div>
          <div>
            <p class="MsoNormal"><span
                style="font-size:10.5pt;font-family:Calibri;color:black">___________________________________________________________________<o:p></o:p></span></p>
          </div>
          <div>
            <p class="MsoNormal"><span
                style="font-size:10.5pt;font-family:Calibri;color:black">Kris
                Lindgren<o:p></o:p></span></p>
          </div>
          <div>
            <p class="MsoNormal"><span
                style="font-size:10.5pt;font-family:Calibri;color:black">Senior
                Linux Systems Engineer<o:p></o:p></span></p>
          </div>
        </div>
        <p class="MsoNormal"><span
            style="font-size:10.5pt;font-family:Calibri;color:black">GoDaddy</span><span
            style="font-size:11.0pt;font-family:Calibri"><o:p></o:p></span></p>
        <p class="MsoNormal"><span
            style="font-size:11.0pt;font-family:Calibri"><o:p> </o:p></span></p>
        <div style="border:none;border-top:solid #B5C4DF
          1.0pt;padding:3.0pt 0in 0in 0in">
          <p class="MsoNormal"><b><span
                style="font-family:Calibri;color:black">From: </span>
            </b><span style="font-family:Calibri;color:black">Grant
              Morley <a class="moz-txt-link-rfc2396E" href="mailto:grant@absolutedevops.io"><grant@absolutedevops.io></a><br>
              <b>Date: </b>Friday, October 21, 2016 at 6:14 AM<br>
              <b>To: </b>OpenStack Operators
              <a class="moz-txt-link-rfc2396E" href="mailto:openstack-operators@lists.openstack.org"><openstack-operators@lists.openstack.org></a><br>
              <b>Cc: </b><a class="moz-txt-link-rfc2396E" href="mailto:ian.banks@serverchoice.com">"ian.banks@serverchoice.com"</a>
              <a class="moz-txt-link-rfc2396E" href="mailto:ian.banks@serverchoice.com"><ian.banks@serverchoice.com></a><br>
              <b>Subject: </b>[Openstack-operators] Instances failing
              to launch when rbd backed (ansible Liberty setup)<o:p></o:p></span></p>
        </div>
        <div>
          <p class="MsoNormal"><o:p> </o:p></p>
        </div>
        <p>Hi all,<o:p></o:p></p>
        <p>We have a openstack-ansible setup and have ceph installed for
          the backend. However whenever we try and launch a new instance
          it fails to launch and we get the following error:<o:p></o:p></p>
        <p style="margin-bottom:12.0pt">2016-10-21 12:08:06.241 70661
          INFO nova.virt.libvirt.driver
          [req-79811c40-8394-4e33-b16d-ff5fa7341b6a
          41c60f65ae914681b6a6ca27a42ff780
          324844c815084205995aff10b03a85e1 - - -] [instance:
          5633d98e-5f79-4c13-8d45-7544069f0e6f] Creating image<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [req-79811c40-8394-4e33-b16d-ff5fa7341b6a
          41c60f65ae914681b6a6ca27a42ff780
          324844c815084205995aff10b03a85e1 - - -] [instance:
          5633d98e-5f79-4c13-8d45-7544069f0e6f] Instance failed to spawn<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] Traceback
          (most recent call last):<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]   File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/compute/manager.py",
          line 2156, in _build_resources<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]     yield
          resources<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]   File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/compute/manager.py",
          line 2009, in _build_and_run_instance<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]    
          block_device_info=block_device_info)<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]   File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/driver.py",
          line 2527, in spawn<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]    
          admin_pass=admin_password)<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]   File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/driver.py",
          line 2939, in _create_image<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]     backend =
          image('disk')<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]   File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/driver.py",
          line 2884, in image<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]     fname +
          suffix, image_type)<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]   File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py",
          line 967, in image<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]     return
          backend(instance=instance, disk_name=disk_name)<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]   File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py",
          line 748, in __init__<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]    
          rbd_user=self.rbd_user)<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]   File
"/openstack/venvs/nova-12.0.16/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py",
          line 117, in __init__<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f]     raise
          RuntimeError(_('rbd python libraries not found'))<br>
          2016-10-21 12:08:06.242 70661 ERROR nova.compute.manager
          [instance: 5633d98e-5f79-4c13-8d45-7544069f0e6f] RuntimeError:
          rbd python libraries not found<o:p></o:p></p>
        <p>It moans about the rbd python libraries not being found,
          however all of the rbd libraries appear to be installed fine
          via apt. ( We are running Ubuntu)<o:p></o:p></p>
        <p>Compute host packages:<o:p></o:p></p>
        <p>dpkg -l | grep ceph<br>
          ii  ceph-common                         
          10.2.3-1trusty                        amd64        common
          utilities to mount and interact with a ceph storage cluster<br>
          ii  libcephfs1                          
          10.2.3-1trusty                        amd64        Ceph
          distributed file system client library<br>
          ii  python-ceph                         
          10.2.3-1trusty                        amd64       
          Meta-package for python libraries for the Ceph libraries<br>
          ii  python-cephfs                       
          10.2.3-1trusty                        amd64        Python
          libraries for the Ceph libcephfs library<o:p></o:p></p>
        <p> dpkg -l | grep rbd<br>
          ii  librbd1                             
          10.2.3-1trusty                        amd64        RADOS block
          device client library<br>
          ii  python-rbd                          
          10.2.3-1trusty                        amd64        Python
          libraries for the Ceph librbd library<o:p></o:p></p>
        <p>Has anyone come across this before? Ceph is working fine for
          Glance, it just seems to be with the nova compute hosts.<o:p></o:p></p>
        <p>Many thanks,<o:p></o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <div>
          <p class="MsoNormal">-- <br>
            <br>
            <o:p></o:p></p>
          <div>
            <p class="MsoNormal"><span
                style="font-size:8.5pt;font-family:"Lucida
                Grande";color:#A8D8FF"><img id="_x0000_i1025"
                  src="cid:part1.BB14BFA9.96B6614F@absolutedevops.io"
                  height="28" width="60"></span><o:p></o:p></p>
            <div style="margin-left:60.0pt;margin-bottom:3.75pt">
              <p class="MsoNormal" style="mso-line-height-alt:11.25pt"><span
                  style="font-size:13.5pt;font-family:"Lucida
                  Grande";color:#239DFF">Grant Morley</span><span
                  style="color:#6DBEFF">
                  <o:p></o:p></span></p>
            </div>
            <div style="margin-left:60.0pt;margin-bottom:7.5pt">
              <p class="MsoNormal" style="mso-line-height-alt:11.25pt"><span
                  style="font-size:11.5pt;font-family:"Lucida
                  Grande";color:#6DBEFF">Cloud Lead</span><span
                  style="font-family:"Lucida
                  Grande";color:#6DBEFF">
                </span><span style="color:#6DBEFF"><o:p></o:p></span></p>
            </div>
            <div style="margin-left:60.0pt">
              <p class="MsoNormal" style="line-height:11.25pt"><span
                  style="font-size:10.0pt;font-family:"Lucida
                  Grande";color:#616161">Absolute</span><span
                  style="font-size:10.0pt;font-family:"Lucida
                  Grande";color:#999999">
                </span><span
                  style="font-size:10.0pt;font-family:"Lucida
                  Grande";color:#98A5B0">DevOps Ltd</span><span
                  style="font-size:10.0pt;font-family:"Lucida
                  Grande";color:#999999">
                  <br>
                  Units H, J & K, Gateway 1000, Whittle Way,
                  Stevenage, Herts, SG1 2FP <o:p></o:p></span></p>
            </div>
            <div style="margin-left:60.0pt">
              <p class="MsoNormal"><span
                  style="font-size:10.0pt;font-family:Helvetica"><a
                    moz-do-not-send="true"
                    href="http://www.absolutedevops.io/"><span
                      style="font-family:"Lucida
                      Grande";color:#239DFF;text-decoration:none">www.absolutedevops.io</span></a>
                  <a moz-do-not-send="true"
                    href="mailto:grant@absolutedevops.i"><span
                      style="font-family:"Lucida
                      Grande";color:#239DFF;text-decoration:none">grant@absolutedevops.io</span></a>
                  0845 874 0580
                  <o:p></o:p></span></p>
            </div>
          </div>
        </div>
      </div>
    </blockquote>
    <br>
    <div class="moz-signature">-- <br>
      <!--?xml version="1.0" encoding="UTF-8" standalone="no"?-->
      <title></title>
      <div style="height:13px"> </div>
      <div> <font face="Lucida Grande, Verdana, Arial, sans-serif"
          color="#A8D8FF"> <span style="font-size: 11px; line-height:
            15px; float: left; margin-right: 10px;"> <img
              src="cid:part4.8B88ADFE.FCAB5B88@absolutedevops.io"
              style="color: #a8d8ff; font-family: 'Lucida Grande',
              Verdana, Arial, sans-serif; font-size: 11px; line-height:
              15px; float: left; margin-top: 0px; margin-right: 10px"> </span>
        </font>
        <div style="margin-left: 80px; line-height: 15px; color:
          rgb(109, 190, 255); margin-bottom: 5px;"> <span
            style="font-family: Hind, 'Lucida Grande', Verdana, Arial,
            sans-serif; font-size: 18px; font-weight: 200; color:
            rgb(35, 157, 255);">Grant Morley</span> <span style="color:
            rgb(35, 157, 255); font-size: 15px;"> </span> <font
            face="Hind, Lucida Grande, Verdana, Arial, sans-serif"> <span
              style="font-size: 15px;"> </span> </font> </div>
        <div style="margin-left: 80px; line-height: 15px; color:
          rgb(109, 190, 255); margin-bottom: 10px;"> <font face="Hind,
            Lucida Grande, Verdana, Arial, sans-serif"> <span
              style="font-size: 15px;">Cloud Lead</span> </font> </div>
        <div style="font-family: Hind, 'Lucida Grande', Verdana, Arial,
          sans-serif; font-size: 13px; margin-left: 80px; line-height:
          15px; color: rgb(153, 153, 153);"> <span style="color:
            #616161">Absolute</span> <span style="color: #98a5b0">DevOps
            Ltd</span> <br>
          Units H, J & K, Gateway 1000, Whittle Way, Stevenage,
          Herts, SG1 2FP
        </div>
        <div style="font-family: Hind, helvetica, arial; font-size:
          13px; margin-left: 80px;"> <a
            href="http://www.absolutedevops.io/" style="color: #239dff;
            font-family: Hind, 'Lucida Grande', Verdana, Arial,
            sans-serif;line-height: 15px; margin-right: 6px;
            text-decoration: none;">www.absolutedevops.io</a> <a
            href="mailto:grant@absolutedevops.i" style="color: #239dff;
            font-family: Hind, 'Lucida Grande', Verdana, Arial,
            sans-serif;line-height: 15px; margin-right: 6px;
            text-decoration: none;">grant@absolutedevops.io</a> <a
            style="color: #239dff; font-family: Hind, 'Lucida Grande',
            Verdana, Arial, sans-serif;line-height: 15px; margin-right:
            6px;">0845 874 0580</a> </div>
      </div>
    </div>
  </body>
</html>