[dev][glance_storage][s3] improving download speed from s3 backend

Gökhan Koçak goekhan.kocak at cloudandheat.com
Tue Aug 22 13:06:32 UTC 2023


Hello everyone,

I did not find any option to use something like multipart downloads 
(only uploads) or concurrency when downloading from s3 storage. So my 
first question is if this is correct?

Second, I see that boto3 is being used:
https://opendev.org/openstack/glance_store/src/branch/master/glance_store/_drivers/s3.py#L25 

and I wonder if it is possible to implement using the concurrency 
settings from boto:
https://boto3.amazonaws.com/v1/documentation/api/latest/reference/customizations/s3.html#boto3.s3.transfer.TransferConfig
?

Best,

Gökhan
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_0xEC1C94B1F2A53181.asc
Type: application/pgp-keys
Size: 3975 bytes
Desc: OpenPGP public key
URL: <https://lists.openstack.org/pipermail/openstack-discuss/attachments/20230822/bce0fb45/attachment-0001.key>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: OpenPGP_signature.asc
Type: application/pgp-signature
Size: 840 bytes
Desc: OpenPGP digital signature
URL: <https://lists.openstack.org/pipermail/openstack-discuss/attachments/20230822/bce0fb45/attachment-0001.sig>


More information about the openstack-discuss mailing list