<html><head><meta http-equiv="content-type" content="text/html; charset=UTF-8"><style>body { line-height: 1.5; }blockquote { margin-top: 0px; margin-bottom: 0px; margin-left: 0.5em; }ol, ul { margin-top: 0px; margin-bottom: 0px; list-style-position: inside; }p { margin-top: 0px; margin-bottom: 0px; }div.foxdiv20170105111600510243 { }body { font-size: 10.5pt; font-family: 微软雅黑; color: rgb(0, 0, 0); line-height: 1.5; }</style></head><body>
<div><b><span></span>Hi <span style="font-size: 10.5pt; line-height: 1.5; background-color: window;">Charles,</span></b></div><div><span style="font-size: 10.5pt; line-height: 1.5; background-color: window;"><b><br></b></span></div><div><span style="font-size: 10.5pt; line-height: 1.5; background-color: window;"><b>There's no any log file on the controller(swift proxy server), it's a Newton manual installation, just one controller.</b></span></div><div><span style="font-size: 10.5pt; line-height: 1.5; background-color: window;"><br></span></div>
<div><span style="color: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);">[root@controller swift]# pwd<br>/var/log/swift<br>[root@controller swift]# ls<br>[root@controller swift]# cd ..<br>[root@controller log]# ls<br>anaconda dmesg.old maillog-20170101 secure-20170101<br>audit firewalld mariadb spooler<br>boot.log glance messages spooler-20170101<br>btmp glusterfs messages-20170101 swift<br>btmp-20170101 grubby neutron tallylog<br>chrony horizon nova tuned<br>cinder httpd ppp wtmp<br>cron keystone rabbitmq yum.log<br>cron-20170101 lastlog rhsm yum.log-20170101<br>dmesg maillog secure<br></span></div><hr style="width: 210px; height: 1px;" color="#b5c4df" size="1" align="left">
<div><span><div style="MARGIN: 10px; FONT-FAMILY: verdana; FONT-SIZE: 10pt"><div style="margin: 10px; font-size: 10pt;">=========================================</div><div style="margin: 10px; font-size: 10pt;"><span style="color: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);">董 建 华<br>地址：杭州滨江区南环路3766号新世纪办公楼<br>邮编：310053<br>手机：13857132818<br>总机：0571-28996000<br>传真：0571-28996001<br>热线：4006728686<br>网址：www.ahope.com.cn<br>Email：dongjh@</span><span style="font-size: 10pt; line-height: 1.5; background-color: window;">ahope.com.cn</span></div></div></span></div>
<blockquote style="margin-top: 0px; margin-bottom: 0px; margin-left: 0.5em;"><div> </div><div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"><div style="PADDING-RIGHT: 8px; PADDING-LEFT: 8px; FONT-SIZE: 12px;FONT-FAMILY:tahoma;COLOR:#000000; BACKGROUND: #efefef; PADDING-BOTTOM: 8px; PADDING-TOP: 8px"><div><b>From:</b> <a href="mailto:charles0126@gmail.com">Charles Hsu</a></div><div><b>Date:</b> 2017-01-05 11:13</div><div><b>To:</b> <a href="mailto:dongjh@ahope.com.cn">dongjh@ahope.com.cn</a></div><div><b>CC:</b> <a href="mailto:nasir.mahmood@gmail.com">nasir.mahmood</a>; <a href="mailto:rick.jones2@hpe.com">Rick Jones</a>; <a href="mailto:openstack@lists.openstack.org">openstack</a></div><div><b>Subject:</b> Re: [Openstack] Download file from swift extremely slow</div></div></div><div><div class="FoxDiv20170105111600510243"><div dir="ltr">Hi Dongjh,<div><br></div><div>I saw there is tran-id (`<span style="font-size:14px">tx559e7d3d28aa49c995467-</span><wbr style="font-size:14px"><span style="font-size:14px">00586d03cf</span>`) in your log, please try to find the swift log in your controller node and grep it likes `grep <span style="font-size:14px">tx559e7d3d28aa49c995467-</span><wbr style="font-size:14px"><span style="font-size:14px">00586d03cf /var/log/<swiftlog></span>` and paste output here.</div><div><br></div><div>It seems like you deploy this openstack env with Mirantis Fuel? How many controller nodes that you have on this test env?<br><br>Best,</div><div>Charles</div><div><br></div><div class="gmail_extra"><br><div class="gmail_quote">2017-01-05 10:56 GMT+08:00 <a href="mailto:dongjh@ahope.com.cn">dongjh@ahope.com.cn</a> <span dir="ltr"><<a href="mailto:dongjh@ahope.com.cn" target="_blank">dongjh@ahope.com.cn</a>></span>:<br><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex;"><div>
<div><span></span><ul style="margin-top: 0px;"><li><p class="m_8669138340125139880first">In the <code class="m_8669138340125139880docutils m_8669138340125139880literal">[filter:cache]</code> section, configure the <code class="m_8669138340125139880docutils m_8669138340125139880literal">memcached</code> location:</p><div class="m_8669138340125139880highlight-none"><div class="m_8669138340125139880highlight"><pre>[filter:cache]
use = egg:swift#memcache
...
memcache_servers = controller:11211
</pre></div></div></li></ul><div><pre><b>memcache_server or <span style="font-family:微软雅黑;font-size:10.5pt;line-height:1.5;background-color:window">memcached_server ?</span></b></pre></div></div><span class="">
<div><br></div><hr style="width:210px;height:1px" color="#b5c4df" size="1" align="left">
<div><span><div style="MARGIN:10px;FONT-FAMILY:verdana;FONT-SIZE:10pt"><div style="margin:10px;font-size:10pt">==============================<wbr>===========</div><div style="margin:10px;font-size:10pt"><span style="color:rgb(0,0,0);background-color:rgba(0,0,0,0)">董 建 华<br>地址：杭州滨江区南环路3766号新世纪办公楼<br>邮编：310053<br>手机：<a href="tel:(385)%20713-2818" value="+13857132818" target="_blank">13857132818</a><br>总机：0571-28996000<br>传真：0571-28996001<br>热线：4006728686<br>网址：<a href="http://www.ahope.com.cn" target="_blank">www.ahope.com.cn</a><br>Email：dongjh@</span><span style="font-size:10pt;line-height:1.5;background-color:window"><a href="http://ahope.com.cn" target="_blank">ahope.com.cn</a></span></div></div></span></div>
</span><blockquote style="margin-top: 0px; margin-bottom: 0px; margin-left: 0.5em;"><div> </div><div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm"><div style="PADDING-RIGHT:8px;PADDING-LEFT:8px;FONT-SIZE:12px;FONT-FAMILY:tahoma;COLOR:#000000;BACKGROUND:#efefef;PADDING-BOTTOM:8px;PADDING-TOP:8px"><div><b>From:</b> <a href="mailto:nasir.mahmood@gmail.com" target="_blank">Nasir Mahmood</a></div><div><b>Date:</b> 2017-01-05 02:25</div><div><b>To:</b> <a href="mailto:rick.jones2@hpe.com" target="_blank">Rick Jones</a></div><div><b>CC:</b> <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack</a></div><span class=""><div><b>Subject:</b> Re: [Openstack] Download file from swift extremely slow</div></span></div></div><div><div class="h5"><div><div class="m_8669138340125139880FoxDiv20170105105605176959"><div dir="auto"><span style="font-family:sans-serif">Just a side note, can you please run the 'iostat -xnpz 1' on your swift nodes and share results while downloading file , including network performance tests suggested earlier ... </span><div dir="auto"><span style="font-family:sans-serif"><br></span></div><div dir="auto"><span style="font-family:sans-serif">I would also suggest to share the logs on swift nodes would be much helpful on this by enabling debug in config.</span></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Jan 4, 2017 22:51, "Rick Jones" <<a href="mailto:rick.jones2@hpe.com" target="_blank">rick.jones2@hpe.com</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex;">On 01/04/2017 12:59 AM, <a href="mailto:dongjh@ahope.com.cn" target="_blank">dongjh@ahope.com.cn</a> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex;">
Hi experts<br>
<br>
I finished the swift installation following the install<br>
guide(<a href="http://docs.openstack.org/project-install-guide/object-storage/draft/get_started.html" rel="noreferrer" target="_blank">http://docs.openstack.or<wbr>g/project-install-guide/object<wbr>-storage/draft/get_started.htm<wbr>l</a>),<br>
file upload is very fast, but file download is extremely slow, why ?<br>
<br>
[root@controller admin]#* time openstack object create container1 cirros-0.3.4-x86_64-disk.img*<br>
+-----------------------------<wbr>-+------------+---------------<wbr>-------------------+<br>
| object | container | etag |<br>
+-----------------------------<wbr>-+------------+---------------<wbr>-------------------+<br>
| cirros-0.3.4-x86_64-disk.img | container1 | ee1eca47dc88f4879d8a229cc70a07<wbr>c6 |<br>
+-----------------------------<wbr>-+------------+---------------<wbr>-------------------+<br>
<br>
real 0m3.807s<br>
user 0m2.127s<br>
sys 0m0.161s<br>
<br>
<br>
[root@controller /]#* time openstack object save container1 cirros-0.3.4-x86_64-disk.img*<br>
real 5m51.489s<br>
user 5m48.172s<br>
sys 0m2.094s<br>
</blockquote>
<br>
Are you able to run something like netperf or iperf between your client and the swift proxy? For example:<br>
<br>
netperf -H <proxy> # get a feel for "to swift" basic network perf<br>
netperf -H <proxy> -t TCP_MAERTS # get a feel for "from swift"<br>
<br>
The idea there is to measure the network separate from the storage and swift processing, and go from there.<br>
<br>
If there isn't much else happening on your setup at the time, you could also look at some snapshots of netstat -s on the proxy when you are downloading the object - look to see if there are many TCP retransmissions. You can get something similar "directly" for the netperf tests with:<br>
<br>
netperf -H <proxy> -- -o throughput,local_transport_ret<wbr>rans,remote_transport_retrans<br>
<br>
netperf -H <proxy> -t TCP_MAERTS -- -o throughput,local_transport_ret<wbr>rans,remote_transport_retrans<br>
<br>
rick jones<br>
<br>
______________________________<wbr>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi<wbr>-bin/mailman/listinfo/openstac<wbr>k</a><br>
</blockquote></div></div>
</div></div></div></div></blockquote>
</div><br>______________________________<wbr>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
<br></blockquote></div><br></div></div>
</div></div></blockquote>
</body></html>