[Openstack] [OpenStack] [Swift] Is it possible to create chunked upload?

John van Ommen john.vanommen at gmail.com
Tue Aug 23 16:21:39 UTC 2016


The Swift3 plugin for Swift supports multipart upload.

So you could do the following:

1) install the Swift3 plugin
2) use Amazon's s3 API for multi part upload

http://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html

On Aug 23, 2016 9:16 AM, "Alexandr Porunov" <alexandr.porunov at gmail.com>
wrote:

> Hello Jay,
>
> Unfortunately I don't know python. I am writing on java. Could you explain
> me briefly what I have to use to send chunks in the Swift and then combine
> those chunks? Or maybe we can append bytes to file somehow?
> If I understand correctly I need to store my first chunk as an individual
> object (0 - 4095 bytes) and then when I recieve the second chunk (with 4096
> - 8192 bytes) I have to append that chunk to the first object. Is it
> correct? How can we append second chunk?
>
> Sincerely,
> Alexandr
>
> On Tue, Aug 23, 2016 at 5:49 PM, Jay Pipes <jaypipes at gmail.com> wrote:
>
>> On 08/23/2016 10:13 AM, Alexandr Porunov wrote:
>>
>>> Hello,
>>>
>>> My server accepts files in chunks (4 Kbytes each chunk. File's size can
>>> be till 8 GB). Is it possible somehow store those chunks in Swift like a
>>> single file? Does somebody know any solution to solve this problem?
>>>
>>
>> Yes, you can do this.
>>
>> The Glance Swift driver shows an example of how to do this:
>>
>> https://github.com/openstack/glance_store/blob/master/glance
>> _store/_drivers/swift/store.py#L829-L944
>>
>> Best,
>> -jay
>>
>> _______________________________________________
>> Mailing list: http://lists.openstack.org/cgi
>> -bin/mailman/listinfo/openstack
>> Post to     : openstack at lists.openstack.org
>> Unsubscribe : http://lists.openstack.org/cgi
>> -bin/mailman/listinfo/openstack
>>
>
>
> _______________________________________________
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/
> openstack
> Post to     : openstack at lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/
> openstack
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20160823/08d9fcfe/attachment.html>


More information about the Openstack mailing list