<div>Hi all , </div><div><br></div>I did several loading tests for swift in recent days. <div><br></div><div>I'm facing an issue ....... Hope you can share you consideration to me ... </div><div><br></div><div>My environment:</div>
<div>Swift-proxy with Tempauth in one server : 4 cores/32G rams </div><div><br></div><div>Swift-object + Swift-account + Swift-container in storage node * 3 , each for : 8 cores/32G rams 2TB SATA HDD * 7 </div><div>=====================================================================================</div>
<div>bench.conf :</div><div><br></div><div><div>[bench]</div><div>auth = <a href="http://172.168.1.1:8082/auth/v1.0" target="_blank">http://172.168.1.1:8082/auth/v1.0</a></div><div>user = admin:admin</div><div>key = admin</div>
<div>concurrency = 200</div>
<div>object_size = 4048</div><div>num_objects = 100000</div><div>num_gets = 100000</div><div>delete = yes</div></div><div>=====================================================================</div><div><br></div><div>After 70 rounds .....</div>
<div><br></div><div>PUT operations get lots of failures , but GET still works properly</div><div><b style="background-color:rgb(255,0,0)">ERROR log:</b></div><div><div>Jul 1 04:35:03 proxy-server ERROR with Object server <a href="http://192.168.100.103:36000/DISK6" target="_blank">192.168.100.103:36000/DISK6</a> re: <span style="background-color:rgb(51,204,0)">Trying to get final status of PUT</span> to /v1/AUTH_admin/af5862e653054f7b803d8cf1728412d2_6/24fc2f997bcc4986a86ac5ff992c4370: <font color="#cc0000">Timeout (10s)</font> (txn: txd60a2a729bae46be9b667d10063a319f) (client_ip: 172.168.1.2)</div>
<div>Jul 1 04:34:32 proxy-server ERROR with Object server <a href="http://192.168.100.103:36000/DISK2" target="_blank">192.168.100.103:36000/DISK2</a> re: <span style="background-color:rgb(51,204,0)">Expect: 100-continue</span> on /AUTH_admin/af5862e653054f7b803d8cf1728412d2_19/35993faa53b849a89f96efd732652e31:<font color="#ff0000"> Timeout (10s)</font></div>
</div><div><br></div><div><br></div><div>And kernel starts to report failed message as below</div><div><span style="background-color:rgb(204,0,0)"><b>kernel failed log:</b></span></div><div><span style="background-color:rgb(204,0,0)"><div>
76666 Jul 1 16:37:50 angryman-storage-03 kernel: [350840.020736] w83795 0-002f: Failed to read from register 0x03c, err -6</div><div> 76667 Jul 1 16:37:50 angryman-storage-03 kernel: [350840.052654] w83795 0-002f: Failed to read from register 0x015, err -6</div>
<div> 76668 Jul 1 16:37:50 angryman-storage-03 kernel: [350840.080613] w83795 0-002f: Failed to read from register 0x03c, err -6</div><div> 76669 Jul 1 16:37:50 angryman-storage-03 kernel: [350840.112583] w83795 0-002f: Failed to read from register 0x016, err -6</div>
<div> 76670 Jul 1 16:37:50 angryman-storage-03 kernel: [350840.144517] w83795 0-002f: Failed to read from register 0x03c, err -6</div><div> 76671 Jul 1 16:37:50 angryman-storage-03 kernel: [350840.176468] w83795 0-002f: Failed to read from register 0x017, err -6</div>
<div> 76672 Jul 1 16:37:50 angryman-storage-03 kernel: [350840.208455] w83795 0-002f: Failed to read from register 0x03c, err -6</div><div> 76673 Jul 1 16:37:51 angryman-storage-03 kernel: [350840.240410] w83795 0-002f: Failed to read from register 0x01b, err -6</div>
<div> 76674 Jul 1 16:37:51 angryman-storage-03 kernel: [350840.272Jul 1 17:05:28 angryman-storage-03 kernel: imklog 6.2.0, log source = /proc/kmsg started.</div><div><br></div><div>PUTs become slower and slower , from 1,200/s to 200/s ...</div>
<div><br></div><div>I'm not sure if this is a bug or that's the limitation of XFS. If it's an limit of XFS . How to improve it ?</div><div><br></div><div>An additional question is XFS seems consume lots of memory , does anyone know about the reason of this behavior?</div>
<div><br></div><div><br></div><div>Appreciate .......</div><div><span style="background-color:transparent"> </span></div></span></div><div><div><br></div>-- <br><div>+Hugo Kuo+</div><div><a href="mailto:tonytkdk@gmail.com" target="_blank">tonytkdk@gmail.com<br>
</a></div><div><a href="mailto:tonytkdk@gmail.com" target="_blank">+</a>886 935004793</div>
<br>
</div>