[Openstack] Struggling to get the s3 api interface to work with swift.
Yuxin Wang
wang.yuxin at ostorage.com.cn
Wed May 30 14:02:06 UTC 2018
Hi Shyam,
No problem. The output of the commands is attached.
And my test cluster is on Swift v2.15.1 with Swift3 v1.12
Also, here is the common process when I'm creating an S3 credential and using in s3curl. Hope it helps.
1. Create a user and a project, and assign a proper role.
openstack project create testproject
openstack user create testuser --password 123
openstack role add --project testproject --user testuser _member_
2. Check accessibility to swift
create a test-openrc file with above info
source test-openrc
swift list
3.Create a credential
openstack credential create --type ec2 --project testproject testuser '{"access": "testaccess", "secret": "testsecret"}'
4. Use it in s3curl
add the endpoint url to `my @endpoints` in s3curl.pl
add the credential to .s3curl config file
do `s3curl.pl -i cred_name --debug -- http://endpoint -X GET`
> 在 2018年5月25日，18:17，Shyam Prasad N <nspmangalore at gmail.com> 写道：
>
> Hi Yuxin,
>
> If you don't mind, can you share the output of the following commands in your running swift3 setup?
>
> openstack credential list
> openstack ec2 credentials list
> cat /etc/swift/proxy-server.conf
>
> Also, what are the access keys and secret keys that you use?
> I want to make sure that I'm not missing anything in configuration.
>
> Regards,
> Shyam
>
> On Fri, May 25, 2018 at 3:05 PM, Shyam Prasad N <nspmangalore at gmail.com <mailto:nspmangalore at gmail.com>> wrote:
> Tried that. Unfortunately same error.
> Is there anything I can do to troubleshoot this?
>
> On Fri, May 25, 2018 at 2:56 PM, Yuxin Wang <wang.yuxin at ostorage.com.cn <mailto:wang.yuxin at ostorage.com.cn>> wrote:
> They can be any strings.
>
> Replace them with whatever you want.
>
> - Yuxin
>
>> 在 2018年5月25日，14:57，Shyam Prasad N <nspmangalore at gmail.com <mailto:nspmangalore at gmail.com>> 写道：
>>
>> Thanks. I'll try this.
>> But what values do I use in place of ak and sk? I want to use some command to get those values, right?
>>
>> On Fri, May 25, 2018 at 9:52 AM, Yuxin Wang <wang.yuxin at ostorage.com.cn <mailto:wang.yuxin at ostorage.com.cn>> wrote:
>> I created ec2 credentials using command `openstack credential create`.
>>
>> i.e.
>>
>> openstack credential create --type ec2 --project proj user '{"access": "ak", "secret": "sk”}'
>>
>>
>> It seems the two credentials are not the same thing.
>>
>> Ref:
>>
>> https://www.ibm.com/support/knowledgecenter/en/STXKQY_4.1.1/com.ibm.spectrum.scale.v4r11.adv.doc/bl1adv_ConfigureOpenstackEC2credentials.htm <https://nam05.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fsupport%2Fknowledgecenter%2Fen%2FSTXKQY_4.1.1%2Fcom.ibm.spectrum.scale.v4r11.adv.doc%2Fbl1adv_ConfigureOpenstackEC2credentials.htm&data=02%7C01%7C%7Cc6d4af73a0fd4208f9ac08d5c20f0a30%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628292198191185&sdata=cBwi02p2zc3db3%2Bp8PDvrgAZ2%2FkqjB6wnuW%2FEt0zWPA%3D&reserved=0>
>>
>>> 在 2018年5月25日，10:32，Shyam Prasad N <nspmangalore at gmail.com <mailto:nspmangalore at gmail.com>> 写道：
>>>
>>> Yes, I did.
>>> I don't think this is s3curl related issue, because I tried with python AWS SDK, and got the same error.
>>>
>>> On Fri, May 25, 2018, 07:42 Yuxin Wang <wang.yuxin at ostorage.com.cn <mailto:wang.yuxin at ostorage.com.cn>> wrote:
>>> Did you add 127.0.0.1 to the endpoint list in s3curl.pl <https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Fs3curl.pl%2F&data=02%7C01%7C%7Cc6d4af73a0fd4208f9ac08d5c20f0a30%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628292198191185&sdata=nr9HL8HskZJ8OwCfpuU2pKg7%2FPnzWhTD1b4wEi02o5A%3D&reserved=0>?
>>>
>>> i.e.
>>>
>>> my @endpoints = (‘127.0.0.1’);
>>>
>>>> 在 2018年5月24日，19:48，Shyam Prasad N <nspmangalore at gmail.com <mailto:nspmangalore at gmail.com>> 写道：
>>>>
>>>> Hi,
>>>>
>>>> I've been trying to get swift3 to work for several days now. But I haven't managed to get it running.
>>>> Both with tempauth and keystoneauth, I'm getting the same error:
>>>>
>>>> eightkpc at objectstore1:~/s3curl$ ./s3curl.pl <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fs3curl.pl&data=02%7C01%7C%7C39742b8c6bf847ee381508d5c16d1b21%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636627596701206160&sdata=lZmKF41unLVD9J1ALYUv8Vkab448NOeGmcWcR56Rgxs%3D&reserved=0> --id=testerks -- http://127.0.0.1:8080/ <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2F127.0.0.1%3A8080%2F&data=02%7C01%7C%7C39742b8c6bf847ee381508d5c16d1b21%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636627596701206160&sdata=CEHEVR1HSpK0ehQ8mmOBA7fmjQsu7vjqKZda3NYVDWQ%3D&reserved=0>
>>>> <?xml version='1.0' encoding='UTF-8'?>
>>>> <Error><Code>SignatureDoesNotMatch</Code><Message>The request signature we calculated does not match the signature you provided. Check your key and signing method.</Message><RequestId>txa691e7ca97a44d56bc4c2-005b06a292</RequestId></Error>
>>>>
>>>> May 24 11:31:30 localhost proxy-server: 127.0.0.1 127.0.0.1 24/May/2018/11/31/30 GET / HTTP/1.0 403 - curl/7.58.0 - - 277 - txa691e7ca97a44d56bc4c2-005b06a292 - 0.0200 - - 1527161490.543112040 1527161490.563107014 -
>>>> May 24 11:31:30 localhost proxy-server: STDERR: 127.0.0.1 - - [24/May/2018 11:31:30] "GET / HTTP/1.1" 403 621 0.021979 (txn: txa691e7ca97a44d56bc4c2-005b06a292)
>>>>
>>>> eightkpc at objectstore1:~$ cat .s3curl
>>>> %awsSecretAccessKeys = (
>>>> tester => {
>>>> id => 'test:tester',
>>>> key => 'testing',
>>>> },
>>>> testerks => {
>>>> id => 'e6289a1b5692461388d0597a4873d054',
>>>> key => '88bb706887094696b082f008ba133ad7',
>>>> },
>>>> );
>>>>
>>>> eightkpc at objectstore1:~$ openstack ec2 credentials show e6289a1b5692461388d0597a4873d054
>>>> +------------+------------------------------------------------------------------------------------------------------------------------------------+
>>>> | Field | Value |
>>>> +------------+------------------------------------------------------------------------------------------------------------------------------------+
>>>> | access | e6289a1b5692461388d0597a4873d054 |
>>>> | links | {u'self': u'http://controller:5000/v3/users/d7df7b56343b4ea988869fc30efeda09/credentials/OS-EC2/e6289a1b5692461388d0597a4873d054 <http://controller:5000/v3/users/d7df7b56343b4ea988869fc30efeda09/credentials/OS-EC2/e6289a1b5692461388d0597a4873d054>'} |
>>>> | project_id | dc86f7d8787b46158268bd77098b6578 |
>>>> | secret | 88bb706887094696b082f008ba133ad7 |
>>>> | trust_id | None |
>>>> | user_id | d7df7b56343b4ea988869fc30efeda09 |
>>>> +------------+------------------------------------------------------------------------------------------------------------------------------------+
>>>>
>>>> Can someone please let me know what is going on?
>>>>
>>>> Regards,
>>>> Shyam
>>>> <proxy-server.conf>_______________________________________________
>>>> Mailing list: https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7C39742b8c6bf847ee381508d5c16d1b21%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636627596701206160&sdata=KI%2F2T2FhVQJTeX1KbIObDZVDiUA3SbTq6Pplo1bc7ak%3D&reserved=0 <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7C39742b8c6bf847ee381508d5c16d1b21%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636627596701206160&sdata=KI%2F2T2FhVQJTeX1KbIObDZVDiUA3SbTq6Pplo1bc7ak%3D&reserved=0>
>>>> Post to : openstack at lists.openstack.org <mailto:openstack at lists.openstack.org>
>>>> Unsubscribe : https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7C39742b8c6bf847ee381508d5c16d1b21%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636627596701206160&sdata=KI%2F2T2FhVQJTeX1KbIObDZVDiUA3SbTq6Pplo1bc7ak%3D&reserved=0 <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7C39742b8c6bf847ee381508d5c16d1b21%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636627596701206160&sdata=KI%2F2T2FhVQJTeX1KbIObDZVDiUA3SbTq6Pplo1bc7ak%3D&reserved=0>
>>>
>>
>>
>>
>>
>> --
>> -Shyam
>> _______________________________________________
>> Mailing list: https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7Cc6d4af73a0fd4208f9ac08d5c20f0a30%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628292198347486&sdata=tGhHmhX%2By9RVFjl%2B31%2BVgRiN1mD%2Fc%2B7QLiImlGnCv98%3D&reserved=0 <https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7Cc6d4af73a0fd4208f9ac08d5c20f0a30%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628292198347486&sdata=tGhHmhX%2By9RVFjl%2B31%2BVgRiN1mD%2Fc%2B7QLiImlGnCv98%3D&reserved=0>
>> Post to : openstack at lists.openstack.org <mailto:openstack at lists.openstack.org>
>> Unsubscribe : https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7Cc6d4af73a0fd4208f9ac08d5c20f0a30%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628292198347486&sdata=tGhHmhX%2By9RVFjl%2B31%2BVgRiN1mD%2Fc%2B7QLiImlGnCv98%3D&reserved=0 <https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7Cc6d4af73a0fd4208f9ac08d5c20f0a30%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628292198347486&sdata=tGhHmhX%2By9RVFjl%2B31%2BVgRiN1mD%2Fc%2B7QLiImlGnCv98%3D&reserved=0>
>
>
>
>
> --
> -Shyam
>
>
>
> --
> -Shyam
> _______________________________________________
> Mailing list: https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7C7bf3d25a540b4d402d3d08d5c22a5c90%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628409546910462&sdata=%2FhXb5bRIU0kCZSDj4pJXfEkVYEtBApcA6OjhKHw1fMQ%3D&reserved=0 <https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7C7bf3d25a540b4d402d3d08d5c22a5c90%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628409546910462&sdata=%2FhXb5bRIU0kCZSDj4pJXfEkVYEtBApcA6OjhKHw1fMQ%3D&reserved=0>
> Post to : openstack at lists.openstack.org <mailto:openstack at lists.openstack.org>
> Unsubscribe : https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7C7bf3d25a540b4d402d3d08d5c22a5c90%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628409546910462&sdata=%2FhXb5bRIU0kCZSDj4pJXfEkVYEtBApcA6OjhKHw1fMQ%3D&reserved=0 <https://nam05.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.openstack.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fopenstack&data=02%7C01%7C%7C7bf3d25a540b4d402d3d08d5c22a5c90%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C636628409546910462&sdata=%2FhXb5bRIU0kCZSDj4pJXfEkVYEtBApcA6OjhKHw1fMQ%3D&reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20180530/2f9a0e29/attachment.html>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: test_cluster_outputs.txt
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20180530/2f9a0e29/attachment.txt>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20180530/2f9a0e29/attachment-0001.html>
More information about the Openstack
mailing list