<div dir="ltr">Hello team,<div><br></div><div>Now I am able to create containers and upload objects in the openstack CLI side using the following commands: </div><div>(kolla-open1) stack@kolla-open1:~$ swift -V 1.0 -A <a href="http://ceph-mon2:8080/auth/v1">http://ceph-mon2:8080/auth/v1</a> -U operator:swift -K opswift post my-container3</div><div>(kolla-open1) stack@kolla-open1:~$ swift -V 1.0 -A <a href="http://ceph-mon2:8080/auth/v1">http://ceph-mon2:8080/auth/v1</a> -U operator:swift -K opswift upload my-container3 michel.txt</div><div><br></div><div>above commands are successful and containers and their objects are stored in ceph RGW default pool which replace swift .</div><div><br></div><div>The issues I remain with is that once I try to access the object store on horizon and click on containers it immediately disconnect hoizon to the login status.</div><div><img src="cid:ii_ktbbd28g0" alt="image.png" width="220" height="434"><br></div><div><img src="cid:ii_ktbbew4l1" alt="image.png" width="472" height="328"><br></div><div><br></div><div>Kindly help and advise</div><div><br></div><div>Michel</div><div><br><div><br></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Sep 6, 2021 at 4:50 PM Eugen Block <<a href="mailto:eblock@nde.ag">eblock@nde.ag</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">It's hard to tell what is wrong with your setup, I don't really use <br>
mine but this was the last working config I had to be able to create <br>
swift containers directly in RGW:<br>
<br>
---snip---<br>
# ceph.conf:<br>
<br>
[client.rgw.ses6-mon1]<br>
rgw frontends = "beast port=80"<br>
rgw dns name = <a href="http://ses6-mon1.example.com" rel="noreferrer" target="_blank">ses6-mon1.example.com</a><br>
rgw enable usage log = true<br>
<br>
rgw thread pool size = 512<br>
rgw keystone api version = 3<br>
rgw keystone url = <a href="http://control-node.example.com:5000" rel="noreferrer" target="_blank">http://control-node.example.com:5000</a><br>
<br>
rgw keystone admin user = rgw<br>
rgw keystone admin password = ****<br>
rgw keystone admin domain = default<br>
rgw keystone admin project = service<br>
rgw keystone accepted roles = admin,Member,_member_,member<br>
rgw keystone verify ssl = false<br>
rgw s3 auth use keystone = true<br>
rgw keystone revocation interval = 0<br>
<br>
<br>
# User role (I don't think admin is required)<br>
<br>
openstack role add --user rgw --project 9e8a67da237a4b26afb2819d2dea2219 admin<br>
<br>
<br>
# Create keystone endpoints<br>
<br>
openstack endpoint create --region RegionOne swift admin <br>
"<a href="http://ses6-mon1.example.com:80/swift/v1" rel="noreferrer" target="_blank">http://ses6-mon1.example.com:80/swift/v1</a>"<br>
openstack endpoint create --region RegionOne swift internal <br>
"<a href="http://ses6-mon1.example.com:80/swift/v1" rel="noreferrer" target="_blank">http://ses6-mon1.example.com:80/swift/v1</a>"<br>
openstack endpoint create --region RegionOne swift public <br>
"<a href="http://ses6-mon1.example.com:80/swift/v1" rel="noreferrer" target="_blank">http://ses6-mon1.example.com:80/swift/v1</a>"<br>
<br>
<br>
# Create container and files<br>
<br>
openstack container create swift1<br>
+---------+-----------+---------------------------------------------------+<br>
| account | container | x-trans-id |<br>
+---------+-----------+---------------------------------------------------+<br>
| v1 | swift1 | tx000000000000000000001-0060b4ba48-d724dc-default |<br>
+---------+-----------+---------------------------------------------------+<br>
<br>
openstack object create --name file1 swift1 chef-client.log<br>
+--------+-----------+----------------------------------+<br>
| object | container | etag |<br>
+--------+-----------+----------------------------------+<br>
| file1 | swift1 | 56a1ed3b201c1e753bcbe80c640349f7 |<br>
+--------+-----------+----------------------------------+<br>
---snip---<br>
<br>
<br>
You are mixing dns names and IP addresses, I can't tell if that's a <br>
problem but it probably should work, I'm not sure. Compared to my <br>
ceph.conf these are the major differences:<br>
<br>
rgw keystone verify ssl = false<br>
rgw s3 auth use keystone = true<br>
rgw keystone revocation interval = 0<br>
<br>
And I don't use rgw_keystone_token_cache_size. Maybe try again with <br>
the options I use.<br>
<br>
<br>
Zitat von Michel Niyoyita <<a href="mailto:micou12@gmail.com" target="_blank">micou12@gmail.com</a>>:<br>
<br>
> Hello,<br>
><br>
> I am trying to replace swift by RGW as backend storage but I failed once I<br>
> try to post a container in the OpenStack side however, all interfaces are<br>
> configured (admin, public and internal). but Once I post from RGW host it<br>
> is created . Another issue is that object storage does not appear on the<br>
> horizon dashboard . I have deployed openstack all-in-one using<br>
> kolla-ansible and Os is ubuntu<br>
><br>
> (kolla-open1) stack@kolla-open1:~$ swift -v post myswift<br>
> Container POST failed: <a href="http://ceph-osd3:8080/swift/v1/myswift" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1/myswift</a> 401<br>
> Unauthorized b'AccessDenied'<br>
> Failed Transaction ID: tx000000000000000000008-006135dcbd-87d63-default<br>
><br>
> (kolla-open1) stack@kolla-open1:~$ swift list<br>
> Account GET failed: <a href="http://ceph-osd3:8080/swift/v1?format=json" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1?format=json</a> 401<br>
> Unauthorized [first 60 chars of response]<br>
> b'{"Code":"AccessDenied","RequestId":"tx00000000000000000000c-'<br>
> Failed Transaction ID: tx00000000000000000000c-006135de42-87d63-default<br>
><br>
> Kindly help to solve the issue<br>
><br>
> Michel<br>
><br>
> On Thu, Sep 2, 2021 at 4:28 PM Alex Schultz <<a href="mailto:aschultz@redhat.com" target="_blank">aschultz@redhat.com</a>> wrote:<br>
><br>
>> The swift docs are a bit out of date as they still reference python2<br>
>> despite python3 being supported for some time now. Replace python- with<br>
>> python3- and try again.<br>
>><br>
>><br>
>> On Thu, Sep 2, 2021 at 7:35 AM Michel Niyoyita <<a href="mailto:micou12@gmail.com" target="_blank">micou12@gmail.com</a>> wrote:<br>
>><br>
>>><br>
>>><br>
>>> ---------- Forwarded message ---------<br>
>>> From: Michel Niyoyita <<a href="mailto:micou12@gmail.com" target="_blank">micou12@gmail.com</a>><br>
>>> Date: Thu, Sep 2, 2021 at 12:17 PM<br>
>>> Subject: Fwd: [ceph-users] Re: Replacing swift with RGW<br>
>>> To: <<a href="mailto:openstack-discuss@lists.openstack.org" target="_blank">openstack-discuss@lists.openstack.org</a>><br>
>>><br>
>>><br>
>>><br>
>>><br>
>>> ---------- Forwarded message ---------<br>
>>> From: Eugen Block <<a href="mailto:eblock@nde.ag" target="_blank">eblock@nde.ag</a>><br>
>>> Date: Thu, Sep 2, 2021 at 10:39 AM<br>
>>> Subject: Re: [ceph-users] Re: Replacing swift with RGW<br>
>>> To: Michel Niyoyita <<a href="mailto:micou12@gmail.com" target="_blank">micou12@gmail.com</a>><br>
>>><br>
>>><br>
>>> You should continue this thread on the openstack-discuss mailing list<br>
>>> (<a href="mailto:openstack-discuss@lists.openstack.org" target="_blank">openstack-discuss@lists.openstack.org</a>) since this is not a ceph issue.<br>
>>> I'm not familiar with kolla and I don't know the requirements to<br>
>>> install openstack-swift, you'll need to ask the openstack community.<br>
>>><br>
>>><br>
>>> Zitat von Michel Niyoyita <<a href="mailto:micou12@gmail.com" target="_blank">micou12@gmail.com</a>>:<br>
>>><br>
>>> > Below are errors I am getting once I try to run swift commands . the<br>
>>> second<br>
>>> > one is the error I get once try to install python-swiftclient<br>
>>> ><br>
>>> > (kolla-open) [stack@kolla-open ~]$ swift -v stat<br>
>>> > -bash: swift: command not found<br>
>>> > (kolla-open) [stack@kolla-open ~]$ sudo yum -y install<br>
>>> python-swiftclient<br>
>>> > Last metadata expiration check: 0:59:21 ago on Thu 02 Sep 2021 09:21:53<br>
>>> AM<br>
>>> > CAT.<br>
>>> > No match for argument: python-swiftclient<br>
>>> > Error: Unable to find a match: python-swiftclient<br>
>>> > (kolla-open) [stack@kolla-open ~]$<br>
>>> ><br>
>>> > Waiting for your help<br>
>>> ><br>
>>> > On Thu, Sep 2, 2021 at 10:17 AM Eugen Block <<a href="mailto:eblock@nde.ag" target="_blank">eblock@nde.ag</a>> wrote:<br>
>>> ><br>
>>> >> I can't tell for sure, but yes, I believe you need the openstack-swift<br>
>>> >> package (with dependencies). What errors do you get? The more<br>
>>> >> information you share the better people can help.<br>
>>> >><br>
>>> >><br>
>>> >> Zitat von Michel Niyoyita <<a href="mailto:micou12@gmail.com" target="_blank">micou12@gmail.com</a>>:<br>
>>> >><br>
>>> >> > I tried to install "sudo yum -y install python-swiftclient" on<br>
>>> openstack<br>
>>> >> > side but fails . are there openastack-shwift packages which are<br>
>>> needed?<br>
>>> >> > if are there please help me to get . may be also it is the cause I<br>
>>> am<br>
>>> >> > failing to run swift command on openstack cli side.<br>
>>> >> ><br>
>>> >> > thank you for your continued support.<br>
>>> >> ><br>
>>> >> > Micheal<br>
>>> >> ><br>
>>> >> > On Thu, Sep 2, 2021 at 9:14 AM Eugen Block <<a href="mailto:eblock@nde.ag" target="_blank">eblock@nde.ag</a>> wrote:<br>
>>> >> ><br>
>>> >> >> I only configured the endpoints for the clients to directly access<br>
>>> the<br>
>>> >> >> RGWs, but you'll probably need to install the openstack-swift<br>
>>> package.<br>
>>> >> >> Or have you done that already?<br>
>>> >> >><br>
>>> >> >><br>
>>> >> >> Zitat von Michel Niyoyita <<a href="mailto:micou12@gmail.com" target="_blank">micou12@gmail.com</a>>:<br>
>>> >> >><br>
>>> >> >> > Thank you Eugen for your prompt response.<br>
>>> >> >> ><br>
>>> >> >> > Now the commands provided work. but I am not finding the object<br>
>>> >> storage<br>
>>> >> >> on<br>
>>> >> >> > the horizon dashboard , but it appears in the system information<br>
>>> >> >> services.<br>
>>> >> >> > [image: image.png]<br>
>>> >> >> > so my question is how to configure it in order that it can appear<br>
>>> in<br>
>>> >> the<br>
>>> >> >> > dashboard .<br>
>>> >> >> ><br>
>>> >> >> > Michel<br>
>>> >> >> ><br>
>>> >> >> > On Wed, Sep 1, 2021 at 3:49 PM Eugen Block <<a href="mailto:eblock@nde.ag" target="_blank">eblock@nde.ag</a>> wrote:<br>
>>> >> >> ><br>
>>> >> >> >> Sorry, one little detail slipped through, the '--region' flag<br>
>>> has to<br>
>>> >> >> >> be put before the 'service' name. The correct command would be:<br>
>>> >> >> >><br>
>>> >> >> >> openstack endpoint create --region RegionOne swift admin<br>
>>> >> >> >> <a href="http://ceph-osd3:8080/swift/v1" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1</a><br>
>>> >> >> >><br>
>>> >> >> >> and respectively for the other interfaces.<br>
>>> >> >> >><br>
>>> >> >> >><br>
>>> >> >> >> Zitat von Eugen Block <<a href="mailto:eblock@nde.ag" target="_blank">eblock@nde.ag</a>>:<br>
>>> >> >> >><br>
>>> >> >> >> > Hi,<br>
>>> >> >> >> ><br>
>>> >> >> >> > this is not a ceph issue but your openstack cli command as the<br>
>>> >> error<br>
>>> >> >> >> > message states.<br>
>>> >> >> >> ><br>
>>> >> >> >> > Try one interface at a time:<br>
>>> >> >> >> ><br>
>>> >> >> >> > openstack endpoint create swift public<br>
>>> >> >> >> > <a href="http://ceph-osd3:8080/swift/v1" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1</a> --region RegionOne swift<br>
>>> >> >> >> > openstack endpoint create swift admin<br>
>>> >> <a href="http://ceph-osd3:8080/swift/v1" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1</a><br>
>>> >> >> >> > --region RegionOne swift<br>
>>> >> >> >> > openstack endpoint create swift internal<br>
>>> >> >> >> > <a href="http://ceph-osd3:8080/swift/v1" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1</a> --region RegionOne swift<br>
>>> >> >> >> ><br>
>>> >> >> >> ><br>
>>> >> >> >> > Zitat von Michel Niyoyita <<a href="mailto:micou12@gmail.com" target="_blank">micou12@gmail.com</a>>:<br>
>>> >> >> >> ><br>
>>> >> >> >> >> Hello ,<br>
>>> >> >> >> >><br>
>>> >> >> >> >> Below are errors I am getting once I am trying to integrate<br>
>>> swift<br>
>>> >> >> with<br>
>>> >> >> >> >> Radosgateway.<br>
>>> >> >> >> >><br>
>>> >> >> >> >> From openstack side once i try to endpoint which will point<br>
>>> to the<br>
>>> >> >> >> >> radosgateway :<br>
>>> >> >> >> >><br>
>>> >> >> >> >> (kolla-open) [stack@kolla-open kolla]$ openstack endpoint<br>
>>> create<br>
>>> >> >> >> >> --publicurl <a href="http://ceph-osd3:8080/swift/v1" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1</a> --adminurl<br>
>>> >> >> >> >> <a href="http://ceph-osd3:8080/swift/v1" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1</a> --internal<br>
>>> >> >> >> <a href="http://ceph-osd3:8080/swift/v1" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1</a><br>
>>> >> >> >> >> --region RegionOne swift<br>
>>> >> >> >> >> usage: openstack endpoint create [-h] [-f<br>
>>> >> >> {json,shell,table,value,yaml}]<br>
>>> >> >> >> >> [-c COLUMN] [--noindent]<br>
>>> [--prefix<br>
>>> >> >> >> PREFIX]<br>
>>> >> >> >> >> [--max-width <integer>]<br>
>>> >> [--fit-width]<br>
>>> >> >> >> >> [--print-empty] [--region<br>
>>> >> >> <region-id>]<br>
>>> >> >> >> >> [--enable | --disable]<br>
>>> >> >> >> >> <service> <interface> <url><br>
>>> >> >> >> >> openstack endpoint create: error: argument <interface>:<br>
>>> invalid<br>
>>> >> >> choice:<br>
>>> >> >> >> '<br>
>>> >> >> >> >> <a href="http://ceph-osd3:8080/swift/v1" rel="noreferrer" target="_blank">http://ceph-osd3:8080/swift/v1</a>' (choose from 'admin',<br>
>>> 'public',<br>
>>> >> >> >> 'internal')<br>
>>> >> >> >> >><br>
>>> >> >> >> >> (kolla-open) [stack@kolla-open kolla]$<br>
>>> >> >> >> >><br>
>>> >> >> >> >> below are my /etc/ceph/ceph.conf file :<br>
>>> >> >> >> >><br>
>>> >> >> >> >> [client.rgw.ceph-osd3]<br>
>>> >> >> >> >> rgw_dns_name = ceph-osd3<br>
>>> >> >> >> >> host = ceph-osd3<br>
>>> >> >> >> >> keyring = /var/lib/ceph/radosgw/ceph-rgw.ceph-osd3/keyring<br>
>>> >> >> >> >> log file = /var/log/ceph/ceph-rgw-ceph-osd3.log<br>
>>> >> >> >> >> rgw frontends = civetweb port=<a href="http://10.10.29.110:8080" rel="noreferrer" target="_blank">10.10.29.110:8080</a><br>
>>> num_threads=100<br>
>>> >> >> >> >> rgw_keystone_url=<a href="http://10.10.29.150:35357" rel="noreferrer" target="_blank">http://10.10.29.150:35357</a><br>
>>> >> >> >> >> rgw_keystone_admin_user=admin<br>
>>> >> >> >> >> rgw_keystone_admin_password=admin<br>
>>> >> >> >> >> rgw_keystone_admin_tenant=admin<br>
>>> >> >> >> >> rgw_keystone_accepted_role=admin Member swiftoperator<br>
>>> >> >> >> >> rgw_keystone_token_cache_size=200<br>
>>> >> >> >> >> rgw_keystone_revocation_interval=300<br>
>>> >> >> >> >><br>
>>> >> >> >> >> [client.rgw.ceph-osd3.rgw0]<br>
>>> >> >> >> >> host = ceph-osd3<br>
>>> >> >> >> >> keyring =<br>
>>> /var/lib/ceph/radosgw/ceph-rgw.ceph-osd3.rgw0/keyring<br>
>>> >> >> >> >> log file = /var/log/ceph/ceph-rgw-ceph-osd3.rgw0.log<br>
>>> >> >> >> >> rgw frontends = beast endpoint=<a href="http://10.10.29.110:8080" rel="noreferrer" target="_blank">10.10.29.110:8080</a><br>
>>> >> >> >> >> rgw thread pool size = 512<br>
>>> >> >> >> >><br>
>>> >> >> >> >> please note that my rgw_dns_name = ceph_osd3 with<br>
>>> 10.10.29.110 as<br>
>>> >> IP<br>
>>> >> >> >> >><br>
>>> >> >> >> >> and 10.10.29.150 all-in-one IP<br>
>>> >> >> >> >><br>
>>> >> >> >> >><br>
>>> >> >> >> >> Please crosscheck where I might make mistake and try to<br>
>>> correct.<br>
>>> >> >> >> >><br>
>>> >> >> >> >> Best regards<br>
>>> >> >> >> >><br>
>>> >> >> >> >> Michel<br>
>>> >> >> >> >><br>
>>> >> >> >> >> On Mon, Aug 30, 2021 at 11:25 AM Etienne Menguy <<br>
>>> >> >> >> <a href="mailto:etienne.menguy@croit.io" target="_blank">etienne.menguy@croit.io</a>><br>
>>> >> >> >> >> wrote:<br>
>>> >> >> >> >><br>
>>> >> >> >> >>> Hi,<br>
>>> >> >> >> >>><br>
>>> >> >> >> >>> There are some information on Ceph documentation<br>
>>> >> >> >> >>> <a href="https://docs.ceph.com/en/latest/radosgw/keystone/" rel="noreferrer" target="_blank">https://docs.ceph.com/en/latest/radosgw/keystone/</a> <<br>
>>> >> >> >> >>> <a href="https://docs.ceph.com/en/latest/radosgw/keystone/" rel="noreferrer" target="_blank">https://docs.ceph.com/en/latest/radosgw/keystone/</a>> .<br>
>>> >> >> >> >>> - Use keystone as auth for RGW<br>
>>> >> >> >> >>> - Create service and register your RGW as swift<br>
>>> >> >> >> >>><br>
>>> >> >> >> >>> Étienne<br>
>>> >> >> >> >>><br>
>>> >> >> >> >>>> On 27 Aug 2021, at 15:47, Michel Niyoyita <<br>
>>> <a href="mailto:micou12@gmail.com" target="_blank">micou12@gmail.com</a>><br>
>>> >> >> wrote:<br>
>>> >> >> >> >>>><br>
>>> >> >> >> >>>> Hello ,<br>
>>> >> >> >> >>>><br>
>>> >> >> >> >>>> I have configured RGW in my ceph cluster deployed using ceph<br>
>>> >> >> ansible<br>
>>> >> >> >> and<br>
>>> >> >> >> >>>> create sub user to access the created containers and would<br>
>>> like<br>
>>> >> to<br>
>>> >> >> >> >>> replace<br>
>>> >> >> >> >>>> swift by RGW in the openstack side. Anyone can help on<br>
>>> >> >> configuration<br>
>>> >> >> >> to<br>
>>> >> >> >> >>> be<br>
>>> >> >> >> >>>> done in the OpenStack side in order to integrate those<br>
>>> >> services. I<br>
>>> >> >> >> have<br>
>>> >> >> >> >>>> deployed OpenStack wallaby using Kolla-ansible on ubuntu<br>
>>> 20.04.<br>
>>> >> and<br>
>>> >> >> >> ceph<br>
>>> >> >> >> >>>> pacific 16.2.5 was deployed using ansible on ubuntu 20.04<br>
>>> >> >> >> >>>><br>
>>> >> >> >> >>>> Kindly help for the configuration or documentation.<br>
>>> >> >> >> >>>><br>
>>> >> >> >> >>>> Best Regards<br>
>>> >> >> >> >>>><br>
>>> >> >> >> >>>> Michel<br>
>>> >> >> >> >>>> _______________________________________________<br>
>>> >> >> >> >>>> ceph-users mailing list -- <a href="mailto:ceph-users@ceph.io" target="_blank">ceph-users@ceph.io</a><br>
>>> >> >> >> >>>> To unsubscribe send an email to <a href="mailto:ceph-users-leave@ceph.io" target="_blank">ceph-users-leave@ceph.io</a><br>
>>> >> >> >> >>><br>
>>> >> >> >> >>> _______________________________________________<br>
>>> >> >> >> >>> ceph-users mailing list -- <a href="mailto:ceph-users@ceph.io" target="_blank">ceph-users@ceph.io</a><br>
>>> >> >> >> >>> To unsubscribe send an email to <a href="mailto:ceph-users-leave@ceph.io" target="_blank">ceph-users-leave@ceph.io</a><br>
>>> >> >> >> >>><br>
>>> >> >> >> >> _______________________________________________<br>
>>> >> >> >> >> ceph-users mailing list -- <a href="mailto:ceph-users@ceph.io" target="_blank">ceph-users@ceph.io</a><br>
>>> >> >> >> >> To unsubscribe send an email to <a href="mailto:ceph-users-leave@ceph.io" target="_blank">ceph-users-leave@ceph.io</a><br>
>>> >> >> >><br>
>>> >> >> >><br>
>>> >> >> >><br>
>>> >> >> >> _______________________________________________<br>
>>> >> >> >> ceph-users mailing list -- <a href="mailto:ceph-users@ceph.io" target="_blank">ceph-users@ceph.io</a><br>
>>> >> >> >> To unsubscribe send an email to <a href="mailto:ceph-users-leave@ceph.io" target="_blank">ceph-users-leave@ceph.io</a><br>
>>> >> >> >><br>
>>> >> >><br>
>>> >> >><br>
>>> >> >><br>
>>> >> >><br>
>>> >><br>
>>> >><br>
>>> >><br>
>>> >><br>
>>><br>
>>><br>
>>><br>
>>><br>
<br>
<br>
<br>
<br>
</blockquote></div>