<div dir="ltr"><div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif">Hi, </div><div class="gmail_default" style=""><font face="verdana, sans-serif">This is my ceph node ( using single node ceph) for test only </font><br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><font face="monospace, monospace">[cephdeploy@ceph2 ~]$ cat /etc/ceph/ceph.client.nova.keyring <br>[client.nova]<br><span style="white-space:pre"> </span>key = AQBLxr5bbhnGFxAAXAliVJwMU5w5YgFY6jGJIA==<br>[cephdeploy@ceph2 ~]$ ceph auth get client.nova<br>exported keyring for client.nova<br>[client.nova]<br><span style="white-space:pre"> </span>key = AQBLxr5bbhnGFxAAXAliVJwMU5w5YgFY6jGJIA==<br><span style="white-space:pre"> </span>caps mon = "allow r"<br><span style="white-space:pre"> </span>caps osd = "allow class-read object_prefix rbd_children, allow rwx pool=vms, allow rx pool=images"<br>[cephdeploy@ceph2 ~]$ </font></blockquote><div class="gmail_default" style="font-family:verdana,sans-serif"><br></div><font face="verdana, sans-serif">and this at my compute-node</font></div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><font face="monospace, monospace">[root@cp2 ~]# cat /etc/ceph/ceph.client.nova.keyring <br>[client.nova]<br><span style="white-space:pre"> </span>key = AQBLxr5bbhnGFxAAXAliVJwMU5w5YgFY6jGJIA==<br>[root@cp2 ~]# </font></blockquote><div class="gmail_default" style="font-family:verdana,sans-serif">yes both nodes, ceph & nova-compute node was on same network 192.168.26.xx/24 , does any special port need to allow at firewalld ?</div></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Thu, Oct 11, 2018 at 2:24 PM Eugen Block <<a href="mailto:eblock@nde.ag">eblock@nde.ag</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi,<br>
<br>
your nova.conf [libvirt] section seems fine.<br>
<br>
Can you paste the output of<br>
<br>
ceph auth get client.nova<br>
<br>
and does the keyring file exist in /etc/ceph/ (ceph.client.nova.keyring)?<br>
<br>
Is the ceph network reachable by your openstack nodes?<br>
<br>
Regards,<br>
Eugen<br>
<br>
<br>
Zitat von Adhi Priharmanto <<a href="mailto:adhi.pri@gmail.com" target="_blank">adhi.pri@gmail.com</a>>:<br>
<br>
> Hi, Im running my openstack environment with rocky release, and I want to<br>
> integrate ceph as nova-compute backend, so I followed instruction here :<br>
> <a href="http://superuser.openstack.org/articl." rel="noreferrer" target="_blank">http://superuser.openstack.org/articl.</a>..<br>
> <<a href="http://superuser.openstack.org/articles/ceph-as-storage-for-openstack/" rel="noreferrer" target="_blank">http://superuser.openstack.org/articles/ceph-as-storage-for-openstack/</a>><br>
><br>
> and this is my nova.conf at my compute node<br>
><br>
> [DEFAULT]<br>
> ...<br>
> compute_driver=libvirt.LibvirtDriver<br>
><br>
> [libvirt]<br>
> images_type = rbd<br>
> images_rbd_pool = vms<br>
> images_rbd_ceph_conf = /etc/ceph/ceph.conf<br>
> rbd_user = nova<br>
> rbd_secret_uuid = a93824e0-2d45-4196-8918-c8f7d7f35c5d<br>
> ....<br>
><br>
> and this is log when I restarted the nova compute service :<br>
><br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host<br>
> [req-f4e2715a-c925-4c12-b8e6-aa550fc588b1 - - - - -] Exception<br>
> handling connection event: AttributeError: 'NoneType' object has no<br>
> attribute 'rfind'<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host Traceback<br>
> (most recent call last):<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/host.py", line<br>
> 148, in _dispatch_conn_event<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host handler()<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/host.py", line<br>
> 414, in handler<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host return<br>
> self._conn_event_handler(*args, **kwargs)<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line<br>
> 470, in _handle_conn_event<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host<br>
> self._set_host_enabled(enabled, reason)<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line<br>
> 3780, in _set_host_enabled<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host<br>
> mount.get_manager().host_up(self._host)<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume/mount.py",<br>
> line 134, in host_up<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host<br>
> self.state = _HostMountState(host, self.generation)<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume/mount.py",<br>
> line 229, in __init__<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host<br>
> mountpoint = os.path.dirname(disk.source_path)<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host File<br>
> "/usr/lib64/python2.7/posixpath.py", line 129, in dirname<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host i =<br>
> p.rfind('/') + 1<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host<br>
> AttributeError: 'NoneType' object has no attribute 'rfind'<br>
> 2018-10-11 01:59:57.123 5275 ERROR nova.virt.libvirt.host<br>
> 2018-10-11 01:59:57.231 5275 WARNING nova.compute.monitors<br>
> [req-df2559f3-5a01-499a-9ac0-3dd9dc255f77 - - - - -] Excluding<br>
> nova.compute.monitors.cpu monitor virt_driver. Not in the list of<br>
> enabled monitors (CONF.compute_monitors).<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager<br>
> [req-df2559f3-5a01-499a-9ac0-3dd9dc255f77 - - - - -] Error updating<br>
> resources for node cp2.os-srg.adhi.: TimedOut: [errno 110] error<br>
> connecting to the cluster<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager Traceback<br>
> (most recent call last):<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager File<br>
> "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 7722,<br>
> in _update_available_resource_for_node<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager<br>
> rt.update_available_resource(context, nodename)<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager File<br>
> "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py",<br>
> line 687, in update_available_resource<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager resources<br>
> = self.driver.get_available_resource(nodename)<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line<br>
> 6505, in get_available_resource<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager<br>
> disk_info_dict = self._get_local_gb_info()<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line<br>
> 5704, in _get_local_gb_info<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager info =<br>
> LibvirtDriver._get_rbd_driver().get_pool_info()<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py",<br>
> line 368, in get_pool_info<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager with<br>
> RADOSClient(self) as client:<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py",<br>
> line 102, in __init__<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager<br>
> self.cluster, self.ioctx = driver._connect_to_rados(pool)<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager File<br>
> "/usr/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py",<br>
> line 133, in _connect_to_rados<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager client.connect()<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager File<br>
> "rados.pyx", line 875, in rados.Rados.connect<br>
> (/builddir/build/BUILD/ceph-12.2.5/build/src/pybind/rados/pyrex/rados.c:9764)<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager TimedOut:<br>
> [errno 110] error connecting to the cluster<br>
> 2018-10-11 02:04:57.279 5275 ERROR nova.compute.manager<br>
> 2018-10-11 02:04:57.316 5275 ERROR oslo.messaging._drivers.impl_rabbit<br>
> [-] [bc957cdf-01b6-4d9a-8cb2-87f880f67cf9] AMQP server on<br>
> ct.os-srg.adhi:5672 is unreachable: [Errno 104] Connection reset by<br>
> peer. Trying again in 1 seconds.: error: [Errno 104] Connection reset<br>
> by peer<br>
> 2018-10-11 02:04:58.353 5275 INFO oslo.messaging._drivers.impl_rabbit<br>
> [-] [bc957cdf-01b6-4d9a-8cb2-87f880f67cf9] Reconnected to AMQP server<br>
> on ct.os-srg.adhi:5672 via [amqp] client with port 60704.<br>
> 2018-10-11 02:05:02.347 5275 ERROR oslo.messaging._drivers.impl_rabbit<br>
> [-] [2dda91e7-c913-4203-a198-ca53f231dfdc] AMQP server on<br>
> ct.os-srg.adhi:5672 is unreachable: [Errno 104] Connection reset by<br>
> peer. Trying again in 1 seconds.: error: [Errno 104] Connection reset<br>
> by peer<br>
> 2018-10-11 02:05:03.376 5275 INFO oslo.messaging._drivers.impl_rabbit<br>
> [-] [2dda91e7-c913-4203-a198-ca53f231dfdc] Reconnected to AMQP server<br>
> on ct.os-srg.adhi:5672 via [amqp] client with port 60706.<br>
><br>
> does anyone can help me with this problem ?<br>
><br>
> --<br>
> Cheers,<br>
><br>
><br>
><br>
> [image: --]<br>
> Adhi Priharmanto<br>
> [image: http://]<a href="http://about.me/a_dhi" rel="noreferrer" target="_blank">about.me/a_dhi</a><br>
> <<a href="http://about.me/a_dhi?promo=email_sig" rel="noreferrer" target="_blank">http://about.me/a_dhi?promo=email_sig</a>><br>
> +62-812-82121584<br>
<br>
<br>
<br>
<br>
_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><font size="2"><span style="font-family:trebuchet ms,sans-serif">Cheers,</span><br style="font-family:trebuchet ms,sans-serif"><br></font><table border="0" cellpadding="0" cellspacing="0" style="margin:0px;padding:0px;border:0px;outline:0px;font-size:14px;font-family:proxima-nova-1,proxima-nova-2,Tahoma,Helvetica,Verdana,sans-serif;vertical-align:baseline;border-spacing:0px;color:rgb(51,51,51);line-height:18.2000007629395px"><tbody style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline"><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline"><td style="padding:0px;border:0px;outline:0px;font-style:inherit;font-size:0px;font-family:inherit;vertical-align:baseline;width:auto;height:30px"> </td></tr><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline"><td style="padding:0px;border:0px;outline:0px;font-style:inherit;font-family:inherit;vertical-align:baseline;width:auto"><div style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline;line-height:0"><a href="http://about.me/a_dhi?promo=email_sig" style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline;color:rgb(58,169,233);text-decoration:none;display:inline-block" target="_blank"><table border="0" cellpadding="0" cellspacing="0" style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline;border-spacing:0px"><tbody style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline"><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline"><td align="left" valign="top" style="padding:0px;border:0px;outline:0px;font-style:inherit;font-family:inherit;vertical-align:top;width:auto;line-height:1"><img alt="--" width="0" height="0" style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline;display:block;width:0px;height:0px;overflow:hidden"><div style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:bold;font-style:inherit;font-size:18px;font-family:proxima-nova-1,Proxima-Nova,Helvetica,Arial,sans-serif;vertical-align:baseline;line-height:1;color:rgb(51,51,51)">Adhi Priharmanto</div><div style="margin:3px 0px 0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-size:12px;font-family:proxima-nova-1,Proxima-Nova,Helvetica,Arial,sans-serif;vertical-align:baseline;color:rgb(43,130,173)"><img alt="http://" width="0" height="0" style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline;display:block;width:0px;height:0px;overflow:hidden">about.me/a_dhi</div></td></tr><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline"><td align="left" valign="top" style="padding:8px 0px 0px;border:0px;outline:0px;font-style:inherit;font-family:inherit;vertical-align:top;width:auto;line-height:1"><div style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline;text-align:right;height:4px;background-color:rgb(197,208,224)"><img src="http://d13pix9kaak6wt.cloudfront.net/signature/colorbar.png" alt="" width="88" height="4" style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline;float:right;display:block"></div></td></tr></tbody></table></a> </div></td></tr><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-family:inherit;vertical-align:baseline"><td style="padding:0px;border:0px;outline:0px;font-style:inherit;font-size:0px;font-family:inherit;vertical-align:baseline;width:auto;height:20px"></td></tr></tbody></table><font size="2"><span style="font-family:trebuchet ms,sans-serif">+62-812-82121584<br></span></font></div><div><font size="2"><span style="font-family:trebuchet ms,sans-serif"><br></span></font></div></div></div></div></div>