<html xmlns="http://www.w3.org/1999/xhtml" xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office"><head><!--[if gte mso 9]><xml><o:OfficeDocumentSettings><o:AllowPNG/><o:PixelsPerInch>96</o:PixelsPerInch></o:OfficeDocumentSettings></xml><![endif]--></head><body><div style="color:#000; background-color:#fff; font-family:times new roman, new york, times, serif;font-size:14px"><div id="yui_3_16_0_ym19_1_1489064092397_12182" dir="ltr"><span id="yui_3_16_0_ym19_1_1489064092397_15762"><font id="yui_3_16_0_ym19_1_1489064092397_15945" size="3">Hi Evan, all<br id="yui_3_16_0_ym19_1_1489064092397_15793"><br id="yui_3_16_0_ym19_1_1489064092397_15794">I can confirm that integrating Ceph (Jewel) as Storage Backend for Glance, Cinder and Nova OpenStack (Newton) services can be done by following the steps described on, <a class="edited-link-editor" href="http://docs.ceph.com/docs/jewel/rbd/rbd-openstack/" id="yui_3_16_0_ym19_1_1489064092397_16267">http://docs.ceph.com/docs/jewel/rbd/rbd-openstack/ </a><br id="yui_3_16_0_ym19_1_1489064092397_15795"><br id="yui_3_16_0_ym19_1_1489064092397_15796">Just a warning about it, the right Ceph configuration to apply on Glance, Cinder and Nova services is the one referring to Juno OpenStack release. I guess this should be updated and refer to Newton release or otherwise, it can be a bit confusing or at least, it was for me.<br id="yui_3_16_0_ym19_1_1489064092397_15797"><br id="yui_3_16_0_ym19_1_1489064092397_15798">Also, in the example for the section about create a secret in virsh so KVM can access to Ceph pools, it is mentioned:<br id="yui_3_16_0_ym19_1_1489064092397_15799"><br id="yui_3_16_0_ym19_1_1489064092397_15800"> <name>client.cinder secret</name><br id="yui_3_16_0_ym19_1_1489064092397_15801"><br id="yui_3_16_0_ym19_1_1489064092397_15802">I think "name" should be a single name according to <a class="edited-link-editor enhancr2_1cd504fc-b3dc-7c5e-a905-a002b909aa03" href="https://libvirt.org/formatsecret.html" id="yui_3_16_0_ym19_1_1489064092397_16483">https://libvirt.org/formatsecret.html</a>. I think it works on both ways but in my opinion the best practice is to put a single name in here. <br id="yui_3_16_0_ym19_1_1489064092397_15803"><br id="yui_3_16_0_ym19_1_1489064092397_15804">I think the above is the only relevant to comment :)<br id="yui_3_16_0_ym19_1_1489064092397_15805"><br id="yui_3_16_0_ym19_1_1489064092397_15806">Best regards,<br id="yui_3_16_0_ym19_1_1489064092397_15807">Esteban</font></span></div><div><br></div><div id="enhancr2_1cd504fc-b3dc-7c5e-a905-a002b909aa03" class="yahoo-link-enhancr-card yahoo-link-enhancr-not-allow-cover ymail-preserve-class ymail-preserve-style" style="max-width:400px;font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;" data-url="https://libvirt.org/formatsecret.html" data-type="yenhancr" data-category="article" data-embed-url="" data-size="medium" dir="ltr" contenteditable="false"> <a href="https://libvirt.org/formatsecret.html" style="text-decoration:none !important; color: #000 !important" class="yahoo-enhancr-cardlink" target="_blank" rel="noreferrer" id="yui_3_16_0_ym19_1_1489064092397_16533"> <table class="card-wrapper" style="max-width:400px;" id="yui_3_16_0_ym19_1_1489064092397_16532" border="0" cellspacing="0" cellpadding="0"> <tbody id="yui_3_16_0_ym19_1_1489064092397_16531"><tr id="yui_3_16_0_ym19_1_1489064092397_16530"> <td id="yui_3_16_0_ym19_1_1489064092397_16529" width="400"> <table class="card-info" style="background:#fff;max-width:400px;border:1px solid #e0e4e9;border-bottom:3px solid #000000;" id="yui_3_16_0_ym19_1_1489064092397_16528" border="0" cellspacing="0" cellpadding="0" width="100%"> <tbody id="yui_3_16_0_ym19_1_1489064092397_16527"><tr id="yui_3_16_0_ym19_1_1489064092397_16526"> <td style="vertical-align:top;padding:16px 0 16px 12px;"> </td> <td style="vertical-align:middle;padding:16px 12px;width:99%;" id="yui_3_16_0_ym19_1_1489064092397_16525"> <h2 class="card-title" style="margin:0 0 4px 0;font-size:16px;font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;word-break:break-word;" id="yui_3_16_0_ym19_1_1489064092397_16524">libvirt: Secret XML format</h2> <div class="card-description" style="font-size:11px;line-height:15px;color:#999;word-break:break-word;">libvirt, virtualization, virtualization API</div> </td> <td class="card-share-container"></td> </tr> </tbody></table> </td> </tr> </tbody></table> </a></div><div id="yui_3_16_0_ym19_1_1489064092397_16547"><br></div> <div class="qtdSeparateBR"><br><br></div><div class="yahoo_quoted" style="display: block;"> <div style="font-family: times new roman, new york, times, serif; font-size: 14px;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div dir="ltr"><font size="2" face="Arial"> El Martes 7 de marzo de 2017 8:57, Esteban Freire <caroubans@yahoo.es> escribió:<br></font></div> <br><br> <div class="y_msg_container"><div id="yiv9044072350"><div><div style="color:#000;background-color:#fff;font-family:times new roman, new york, times, serif;font-size:14px;"><font id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_25134" size="3">Hi Evan,<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24921" clear="none"><br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24922" clear="none">Thanks for your answer :) <br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24923" clear="none"><br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24924" clear="none">Yes, I have defined similar permissions and users. <br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24925" clear="none"><br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24926" clear="none">After performing some tests, I realized that Glance was not able to read ceph.conf file because I did not have the right variables defined.<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24927" clear="none"><br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24928" clear="none">Now, I can confirm that the Glance (Newton) integration with Ceph (Jewel) works following the steps defined on http://docs.ceph.com/docs/jewel/rbd/rbd-openstack/ and with the following configuration (at least for my use case and in a fresh installation on CentOS 7):<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24929" clear="none"><br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24930" clear="none"> [glance_store]<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24931" clear="none"> stores = file,http,rbd<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24932" clear="none"> default_store = rbd<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24933" clear="none"> rbd_store_pool = images<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24934" clear="none"> rbd_store_user = glance<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24935" clear="none"> rbd_store_ceph_conf = /etc/ceph/ceph.conf<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24936" clear="none"> rbd_store_chunk_size = 8<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24937" clear="none"><br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24938" clear="none">Currently, I am working on Cinder and Nova integration with Ceph. I will let you know when I manage to get it working. <br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24939" clear="none"><br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24940" clear="none">Cheers,<br id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24941" clear="none">Esteban</font><div id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24942"><span></span></div> <div class="yiv9044072350qtdSeparateBR" id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24961"><br clear="none"><br clear="none"></div><div class="yiv9044072350yqt0335197083" id="yiv9044072350yqt97849"><div class="yiv9044072350yahoo_quoted" id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24992" style="display:block;"> <div id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24991" style="font-family:times new roman, new york, times, serif;font-size:14px;"> <div id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24990" style="font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px;"> <div dir="ltr" id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24989"><font id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24988" size="2" face="Arial"> El Lunes 6 de marzo de 2017 18:08, Evan Bollig PhD <boll0107@umn.edu> escribió:<br clear="none"></font></div> <br clear="none"><br clear="none"> <div class="yiv9044072350y_msg_container" id="yiv9044072350yui_3_16_0_ym19_1_1488870353357_24993">Hey Esteban,<br clear="none">I got that same error at one point. Check your file permissions on the<br clear="none">/etc/ceph directory and contents. In particular, make sure the glance<br clear="none">user can access its keyring and the ceph.conf is readable for the<br clear="none">group as well. Here's an example:<br clear="none"><br clear="none">drwxr-xr-x. 2 root root 4.0K Jan 17 12:25 .<br clear="none">drwxr-xr-x. 93 root root 8.0K Mar 3 14:27 ..<br clear="none">-rw-------. 1 root root 63 Jan 11 14:00 ceph.client.admin.keyring<br clear="none">-rw-------. 1 cinder cinder 71 Jan 11 13:59<br clear="none">ceph.client.cinder-backup.keyring<br clear="none">-r--------+ 1 cinder cinder 64 Jan 11 13:59 ceph.client.cinder.keyring<br clear="none">-rw-------. 1 glance glance 64 Jan 11 13:59 ceph.client.glance.keyring<br clear="none">-r--------+ 1 gnocchi gnocchi 65 Jan 17 12:25 ceph.client.gnocchi.keyring<br clear="none">-rw-r--r--. 1 root root 220 Jan 11 13:59 ceph.conf<br clear="none"><br clear="none">Let me know how things in Newton are working; we're only as far as<br clear="none">Mitaka at the moment.<br clear="none"><br clear="none">Cheers,<br clear="none">-E<br clear="none"><br clear="none"><br clear="none">--<br clear="none">Evan F. Bollig, PhD<br clear="none">Scientific Computing Consultant, Application Developer | Scientific<br clear="none">Computing Solutions (SCS)<br clear="none">Minnesota Supercomputing Institute | msi.umn.edu<br clear="none">University of Minnesota | umn.edu<br clear="none"><a rel="nofollow" shape="rect" ymailto="mailto:boll0107@umn.edu" target="_blank" href="mailto:boll0107@umn.edu">boll0107@umn.edu</a> | 612-624-1447 | Walter Lib Rm 556<br clear="none"><br clear="none"><div class="yiv9044072350yqt8670876639" id="yiv9044072350yqtfd53827"><br clear="none">On Thu, Mar 2, 2017 at 3:13 AM, Esteban Freire <<a rel="nofollow" shape="rect" ymailto="mailto:caroubans@yahoo.es" target="_blank" href="mailto:caroubans@yahoo.es">caroubans@yahoo.es</a>> wrote:<br clear="none">> Hello all,<br clear="none">><br clear="none">> I am testing OpenStack Newton on CentOS 7 and now I already have a OpenStack<br clear="none">> cloud infrastructure working, I would like to integrate Ceph with Cinder,<br clear="none">> Glance and Nova services.<br clear="none">><br clear="none">> I have found some information about how to performance this on previous<br clear="none">> releases for Openstack and Ceph:<br clear="none">><br clear="none">> <a rel="nofollow" shape="rect" target="_blank" href="http://docs.ceph.com/docs/jewel/rbd/rbd-openstack/">http://docs.ceph.com/docs/jewel/rbd/rbd-openstack/</a><br clear="none">><br clear="none">> And I tried to update the variables according to<br clear="none">> <a rel="nofollow" shape="rect" target="_blank" href="https://docs.openstack.org/newton/config-reference/block-storage/drivers/ceph-rbd-volume-driver.html">https://docs.openstack.org/newton/config-reference/block-storage/drivers/ceph-rbd-volume-driver.html</a><br clear="none">><br clear="none">> This is my current glance-api.conf and which is working:<br clear="none">><br clear="none">> [glance_store]<br clear="none">> stores = file,http<br clear="none">> default_store = file<br clear="none">> filesystem_store_datadir = /var/lib/glance/images/<br clear="none">><br clear="none">><br clear="none">> At this is what I tried (at the moment, I have only tried it with the glance<br clear="none">> service but I did not get success):<br clear="none">><br clear="none">> * Install python-rbd and python-rados from centos-ceph-jewel repo on the<br clear="none">> controller node.<br clear="none">> * Create a ceph user and add it to sudoers.<br clear="none">> * On ceph admin node:<br clear="none">><br clear="none">> sudo ceph osd pool create images 150<br clear="none">> sudo ceph auth get-or-create client.glance mon 'allow r' osd 'allow<br clear="none">> class-read object_prefix rbd_children, allow rwx pool=images'<br clear="none">> sudo ceph auth get-or-create client.glance | ssh<br clear="none">> <a rel="nofollow" shape="rect" ymailto="mailto:ceph@controller-node1" target="_blank" href="mailto:ceph@controller-node1">ceph@controller-node1</a> sudo tee /etc/ceph/ceph.client.glance.keyring<br clear="none">> ssh <a rel="nofollow" shape="rect" ymailto="mailto:ceph@controller-node1" target="_blank" href="mailto:ceph@controller-node1">ceph@controller-node1</a> sudo chown glance:glance<br clear="none">> /etc/ceph/ceph.client.glance.keyring<br clear="none">><br clear="none">> * On the controller node, I edited the glance-api.conf file with the<br clear="none">> following variables:<br clear="none">><br clear="none">> [glance_store]<br clear="none">> stores = file,http,rbd<br clear="none">> default_store = rbd<br clear="none">> rbd_pool = images<br clear="none">> rbd_user = glance<br clear="none">> rbd_ceph_conf = /etc/ceph/ceph.conf<br clear="none">> rbd_store_chunk_size = 8<br clear="none">><br clear="none">> (!) I also have tried with stores = rbd but without success.<br clear="none">><br clear="none">> * And restart the service, systemctl restart openstack-glance-api<br clear="none">><br clear="none">> But when I try to create a new image, I get the following issue:<br clear="none">><br clear="none">> [<a rel="nofollow" shape="rect" ymailto="mailto:openstackadmin@controller-node1" target="_blank" href="mailto:openstackadmin@controller-node1">openstackadmin@controller-node1</a> ~]$ openstack image create "cirros<br clear="none">> ceph" --file /home/openstackadmin/cirros-0.3.4-x86_64-disk.raw --disk-format<br clear="none">> raw --container-format bare --public<br clear="none">> 500 Internal Server Error<br clear="none">> The server has either erred or is incapable of performing the requested<br clear="none">> operation.<br clear="none">> (HTTP 500)<br clear="none">><br clear="none">> Is there any documentation about how to integrate Ceph jewel with OpenStack<br clear="none">> newton (Cinder, Glance and Nova services)? If it is so, could you please<br clear="none">> provide me the link?<br clear="none">><br clear="none">> On the other hand, Is there any way to chose the store when creating an<br clear="none">> image? I mean, to choose for example if save the image on<br clear="none">> /var/lib/glance/images/ or on Ceph.<br clear="none">><br clear="none">> I would appreciate if you could help me to set up this integration.<br clear="none">><br clear="none">> This is the most relevant info I can see on the logs and as far as I see<br clear="none">> from it, I have a permissions error but I am not sure what I need to modify.<br clear="none">> It is my first installation with OpenStack by the way and I am trying at<br clear="none">> home to see how it works :)<br clear="none">><br clear="none">> {{{<br clear="none">> /var/log/glance/api.log<br clear="none">><br clear="none">> 2017-03-01 23:43:41.419 4197 INFO eventlet.wsgi.server<br clear="none">> [req-eea55909-c963-4158-b30c-3f2779fd78c6 c41043a1ddc14ffba1b45c0a3287e0bf<br clear="none">> b2d1547f0e734f87a84feea75ccd6453 - default default] 192.168.56.2 - -<br clear="none">> [01/Mar/2017 23:43:41] "GET /v2/schemas/image HTTP/1.1" 200 4352 0.421281<br clear="none">> 2017-03-01 23:43:41.570 4197 INFO eventlet.wsgi.server<br clear="none">> [req-f5ef0b43-0ddf-4698-8459-2f75fb1822a3 c41043a1ddc14ffba1b45c0a3287e0bf<br clear="none">> b2d1547f0e734f87a84feea75ccd6453 - default default] 192.168.56.2 - -<br clear="none">> [01/Mar/2017 23:43:41] "POST /v2/images HTTP/1.1" 201 859 0.110681<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> [req-98c406fb-7bc0-47de-bace-2b0a2097b699 c41043a1ddc14ffba1b45c0a3287e0bf<br clear="none">> b2d1547f0e734f87a84feea75ccd6453 - default default] Failed to upload image<br clear="none">> data due to internal error<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data Traceback (most<br clear="none">> recent call last):<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/api/v2/image_data.py", line 115, in<br clear="none">> upload<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> image.set_data(data, size)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/domain/proxy.py", line 195, in<br clear="none">> set_data<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> self.base.set_data(data, size)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/notifier.py", line 479, in set_data<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> _send_notification(notify_error, 'image.upload', msg)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in<br clear="none">> __exit__<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> self.force_reraise()<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in<br clear="none">> force_reraise<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> six.reraise(self.type_, self.value, self.tb)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/notifier.py", line 426, in set_data<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> self.repo.set_data(data, size)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/api/policy.py", line 185, in<br clear="none">> set_data<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data return<br clear="none">> self.image.set_data(*args, **kwargs)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/quota/__init__.py", line 304, in<br clear="none">> set_data<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> self.image.set_data(data, size=size)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/location.py", line 440, in set_data<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> verifier=verifier)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/backend.py", line 447, in<br clear="none">> add_to_backend<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data verifier)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/backend.py", line 420, in<br clear="none">> store_add_to_backend<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> verifier=verifier)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/capabilities.py", line 225,<br clear="none">> in op_checker<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data return<br clear="none">> store_op_fun(store, *args, **kwargs)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/_drivers/rbd.py", line 447,<br clear="none">> in add<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> rados_id=self.user) as conn:<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data return<br clear="none">> self.gen.next()<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/_drivers/rbd.py", line 270,<br clear="none">> in get_connection<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data client =<br clear="none">> rados.Rados(conffile=conffile, rados_id=rados_id)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "rados.pyx", line 525, in rados.Rados.__init__ (rados.c:5719)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "rados.pyx", line 425, in rados.requires.wrapper.validate_func<br clear="none">> (rados.c:4106)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "rados.pyx", line 568, in rados.Rados.__setup (rados.c:6448)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "rados.pyx", line 425, in rados.requires.wrapper.validate_func<br clear="none">> (rados.c:4106)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data File<br clear="none">> "rados.pyx", line 631, in rados.Rados.conf_read_file (rados.c:7384)<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> PermissionDeniedError: error calling conf_read_file<br clear="none">> 2017-03-01 23:43:41.651 4197 ERROR glance.api.v2.image_data<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> [req-98c406fb-7bc0-47de-bace-2b0a2097b699 c41043a1ddc14ffba1b45c0a3287e0bf<br clear="none">> b2d1547f0e734f87a84feea75ccd6453 - default default] Caught error: error<br clear="none">> calling conf_read_file<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi Traceback (most recent<br clear="none">> call last):<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/common/wsgi.py", line 1113, in<br clear="none">> __call__<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi request,<br clear="none">> **action_args)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/common/wsgi.py", line 1152, in<br clear="none">> dispatch<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi return<br clear="none">> method(*args, **kwargs)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/common/utils.py", line 363, in<br clear="none">> wrapped<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi return func(self,<br clear="none">> req, *args, **kwargs)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/api/v2/image_data.py", line 250, in<br clear="none">> upload<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> self._restore(image_repo, image)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in<br clear="none">> __exit__<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> self.force_reraise()<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in<br clear="none">> force_reraise<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> six.reraise(self.type_, self.value, self.tb)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/api/v2/image_data.py", line 115, in<br clear="none">> upload<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> image.set_data(data, size)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/domain/proxy.py", line 195, in<br clear="none">> set_data<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> self.base.set_data(data, size)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/notifier.py", line 479, in set_data<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> _send_notification(notify_error, 'image.upload', msg)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in<br clear="none">> __exit__<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> self.force_reraise()<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in<br clear="none">> force_reraise<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> six.reraise(self.type_, self.value, self.tb)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/notifier.py", line 426, in set_data<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> self.repo.set_data(data, size)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/api/policy.py", line 185, in<br clear="none">> set_data<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi return<br clear="none">> self.image.set_data(*args, **kwargs)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/quota/__init__.py", line 304, in<br clear="none">> set_data<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> self.image.set_data(data, size=size)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance/location.py", line 440, in set_data<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi verifier=verifier)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/backend.py", line 447, in<br clear="none">> add_to_backend<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi verifier)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/backend.py", line 420, in<br clear="none">> store_add_to_backend<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi verifier=verifier)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/capabilities.py", line 225,<br clear="none">> in op_checker<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi return<br clear="none">> store_op_fun(store, *args, **kwargs)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/_drivers/rbd.py", line 447,<br clear="none">> in add<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> rados_id=self.user) as conn:<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi return<br clear="none">> self.gen.next()<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File<br clear="none">> "/usr/lib/python2.7/site-packages/glance_store/_drivers/rbd.py", line 270,<br clear="none">> in get_connection<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi client =<br clear="none">> rados.Rados(conffile=conffile, rados_id=rados_id)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File "rados.pyx",<br clear="none">> line 525, in rados.Rados.__init__ (rados.c:5719)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File "rados.pyx",<br clear="none">> line 425, in rados.requires.wrapper.validate_func (rados.c:4106)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File "rados.pyx",<br clear="none">> line 568, in rados.Rados.__setup (rados.c:6448)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File "rados.pyx",<br clear="none">> line 425, in rados.requires.wrapper.validate_func (rados.c:4106)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi File "rados.pyx",<br clear="none">> line 631, in rados.Rados.conf_read_file (rados.c:7384)<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi PermissionDeniedError:<br clear="none">> error calling conf_read_file<br clear="none">> 2017-03-01 23:43:41.709 4197 ERROR glance.common.wsgi<br clear="none">> }}}<br clear="none">><br clear="none">> Thanks in advance,<br clear="none">> Esteban</div><br clear="none">><br clear="none">><br clear="none">> _______________________________________________<br clear="none">> Mailing list: <a rel="nofollow" shape="rect" target="_blank" href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br clear="none">> Post to : <a rel="nofollow" shape="rect" ymailto="mailto:openstack@lists.openstack.org" target="_blank" href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br clear="none">> Unsubscribe : <a rel="nofollow" shape="rect" target="_blank" href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><div class="yiv9044072350yqt8670876639" id="yiv9044072350yqtfd29173"><br clear="none">><br clear="none"></div><br clear="none"><br clear="none"></div> </div> </div> </div></div></div></div></div><br><br></div> </div> </div> </div></div></body></html>