[Openstack] [OpenStack][Swift] Fast way of uploading 200GB of 200KB files to Swift

Chuck Thier cthier at gmail.com
Mon Jan 14 19:01:41 UTC 2013


Rather than ping-ponging emails back and forth on this list, it would
be easier if you could hop on to the #openstack-swift IRC channel on
freenode to discuss further.

--
Chuck

On Mon, Jan 14, 2013 at 1:00 PM, Leander Bessa Beernaert
<leanderbb at gmail.com> wrote:
> Neither keystone nor swift proxy are producing any logs. I'm not sure what
> to do :S
>
>
> On Mon, Jan 14, 2013 at 6:50 PM, Chuck Thier <cthier at gmail.com> wrote:
>>
>> You would have to look at the proxy log to see if a request is being
>> made.  The results from the swift command line are just the calls that
>> the client makes.  The server still haves to validate the token on
>> every request.
>>
>> --
>> Chuck
>>
>> On Mon, Jan 14, 2013 at 12:37 PM, Leander Bessa Beernaert
>> <leanderbb at gmail.com> wrote:
>> > Below is an output from Swift stat, since I don't see any requests to
>> > keystone, I'm assuming that memcache is being used right?
>> >
>> > REQ: curl -i http://192.168.111.215:8080/v1/AUTH_[ID] -X HEAD -H
>> > "X-Auth-Token: [TOKEN]"
>> >
>> > DEBUG:swiftclient:REQ: curl -i http://192.168.111.215:8080/v1/AUTH_[ID]
>> > -X
>> > HEAD -H "X-Auth-Token: [TOKEN]"
>> >
>> > RESP STATUS: 204
>> >
>> > DEBUG:swiftclient:RESP STATUS: 204
>> >
>> >    Account: AUTH_[ID]
>> > Containers: 44
>> >    Objects: 4818
>> >      Bytes: 112284450
>> > Accept-Ranges: bytes
>> > X-Timestamp: 1358184925.20885
>> > X-Trans-Id: tx8cffb469c9c542be830db10a2b90d901
>> >
>> >
>> >
>> >
>> > On Mon, Jan 14, 2013 at 6:31 PM, Dolph Mathews <dolph.mathews at gmail.com>
>> > wrote:
>> >>
>> >> If memcache is being utilized by your keystone middleware, you should
>> >> see
>> >> keystone attaching to it on the first incoming request, e.g.:
>> >>
>> >>   keystoneclient.middleware.auth_token [INFO]: Using Keystone memcache
>> >> for
>> >> caching token
>> >>
>> >> You may also want to use auth_token from keystoneclient >= v0.2.0 if
>> >> you're not already (instead of from keystone itself).
>> >>
>> >>
>> >> -Dolph
>> >>
>> >>
>> >> On Mon, Jan 14, 2013 at 11:43 AM, Leander Bessa Beernaert
>> >> <leanderbb at gmail.com> wrote:
>> >>>
>> >>> Are you by any chance referring to this topic
>> >>> https://lists.launchpad.net/openstack/msg08639.html regarding the
>> >>> keystone
>> >>> token cache? If so I've already added the configuration line and have
>> >>> not
>> >>> noticed any speedup :/
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> On Mon, Jan 14, 2013 at 5:19 PM, Leander Bessa Beernaert
>> >>> <leanderbb at gmail.com> wrote:
>> >>>>
>> >>>> I'm using the ubuntu 12.04 packages of the folsom repository by the
>> >>>> way.
>> >>>>
>> >>>>
>> >>>> On Mon, Jan 14, 2013 at 5:18 PM, Chuck Thier <cthier at gmail.com>
>> >>>> wrote:
>> >>>>>
>> >>>>> On Mon, Jan 14, 2013 at 11:03 AM, Leander Bessa Beernaert
>> >>>>> <leanderbb at gmail.com> wrote:
>> >>>>> > Also, I'm unable to run the swift-bench with keystone.
>> >>>>> >
>> >>>>>
>> >>>>> Hrm... That was supposed to be fixed with this bug:
>> >>>>> https://bugs.launchpad.net/swift/+bug/1011727
>> >>>>>
>> >>>>> My keystone dev instance isn't working at the moment, but I'll see
>> >>>>> if
>> >>>>> I can get one of the team to take a look at it.
>> >>>>>
>> >>>>> --
>> >>>>> Chuck
>> >>>>
>> >>>>
>> >>>
>> >>>
>> >>> _______________________________________________
>> >>> Mailing list: https://launchpad.net/~openstack
>> >>> Post to     : openstack at lists.launchpad.net
>> >>> Unsubscribe : https://launchpad.net/~openstack
>> >>> More help   : https://help.launchpad.net/ListHelp
>> >>>
>> >>
>> >
>
>




More information about the Openstack mailing list