<div dir="ltr"><div><div><div><div><div>Hey all,<br></div>So I finally tested your pull requests, it does not work.<br></div>1 - For uploads, swiftclient is not using threads when source is given by glance: <a href="https://github.com/openstack/python-swiftclient/blob/master/swiftclient/service.py#L1847">https://github.com/openstack/python-swiftclient/blob/master/swiftclient/service.py#L1847</a></div><div><br></div><div>2 - For downloads, when requesting the file from swift, it is recomposing the chunks into one big file.</div><div><br></div><div><br></div><div>So patch is not so easy.</div><div><br></div>IMHO, for uploads, we should try to uploads chunks using multithreads. Sounds doable.<br></div>For downloads, I need to dig a little bit more in glance store code to be sure, but maybe we can try to download the chunks separately and recompose them locally before sending it to the requester (compute / cli).<br><br></div>Cheers,<br><br></div><div class="gmail_extra"><br><div class="gmail_quote">On 6 September 2017 at 21:19, Arnaud MORIN <span dir="ltr"><<a href="mailto:arnaud.morin@gmail.com" target="_blank">arnaud.morin@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hey, <div>I would love to see that reviving!</div><div><br></div><div>Cheers,</div><div>Arnaud</div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On 6 September 2017 at 21:00, Mikhail Fedosin <span dir="ltr"><<a href="mailto:mfedosin@gmail.com" target="_blank">mfedosin@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hey! As you said it's not possible now.<div><br><div>I implemented the support several years ago, bit unfortunately no one wanted to review it: <a href="https://review.openstack.org/#/c/218993" target="_blank">https://review.openstack.o<wbr>rg/#/c/218993</a></div><div>If you want, we can revive it.</div><div><br></div><div>Best,</div><div>Mike</div></div></div><div class="m_-2318570670206067854HOEnZb"><div class="m_-2318570670206067854h5"><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Sep 6, 2017 at 9:05 PM, Clay Gerrard <span dir="ltr"><<a href="mailto:clay.gerrard@gmail.com" target="_blank">clay.gerrard@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I'm pretty sure that would only be possible with a code change in glance to move the consumption of the swiftclient abstraction up a layer from the client/connection objects to swiftclient's service objects [1]. I'm not sure if that'd be something that would make a lot of sense to the Image Service team.<div><br></div><div>-Clay<br><div><br></div><div>1. <a href="https://docs.openstack.org/python-swiftclient/latest/service-api.html" target="_blank">https://docs.openstack.org/<wbr>python-swiftclient/latest/serv<wbr>ice-api.html</a></div></div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-2318570670206067854m_-2556776938662539398h5">On Wed, Sep 6, 2017 at 9:02 AM, Arnaud MORIN <span dir="ltr"><<a href="mailto:arnaud.morin@gmail.com" target="_blank">arnaud.morin@gmail.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="m_-2318570670206067854m_-2556776938662539398h5"><div dir="ltr">Hi all,<div><br></div><div>Is there any chance that glance can use the multiprocessing from swiftclient library (equivalent of xxx-threads options from cli)?</div><div>If yes, how to enable it?</div><div>I did not find anything useful in the glance configuration options.</div><div>And looking at glance_store code make me think that it's not possible...</div><div>Am I wrong?</div><div><br></div><div>Regards,</div><div>Arnaud</div></div>
<br></div></div>______________________________<wbr>______________________________<wbr>______________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.op<wbr>enstack.org?subject:unsubscrib<wbr>e</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k-dev</a><br>
<br></blockquote></div><br></div>
<br>______________________________<wbr>______________________________<wbr>______________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.op<wbr>enstack.org?subject:unsubscrib<wbr>e</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k-dev</a><br>
<br></blockquote></div><br></div>
</div></div><br>______________________________<wbr>______________________________<wbr>______________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.op<wbr>enstack.org?subject:unsubscrib<wbr>e</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k-dev</a><br>
<br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>