<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META content="text/html; charset=gb2312" http-equiv=Content-Type>
<STYLE>
BLOCKQUOTE {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px; MARGIN-LEFT: 2em
}
OL {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
UL {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
P {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
BODY {
LINE-HEIGHT: 1.5; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt
}
</STYLE>
<META name=GENERATOR content="MSHTML 9.00.8112.16450"></HEAD>
<BODY style="MARGIN: 10px">
<DIV>hi openstackers£¬</DIV>
<DIV style="TEXT-INDENT: 2em">I'm a learner of swift. I took some benchmark
about swift last week and the result is not pleasant.</DIV>
<DIV style="TEXT-INDENT: 2em">When I put a large number of small files(4KB)
under high concurrency, the performance degradation of PUT appeared.</DIV>
<DIV style="TEXT-INDENT: 2em"><SPAN
style="FONT-STYLE: normal; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal; TEXT-DECORATION: ">The
speed of PUT even can reach to 2000/s at beginning. But it down to
600/s after one minute. It's stable at 100/s at last and some error
like '503' occured. But when I flushed all disk in cluster it
could reach back 2000/s. </SPAN></DIV>
<DIV style="TEXT-INDENT: 2em"><SPAN
style="FONT-STYLE: normal; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal; TEXT-DECORATION: "><SPAN
style="FONT-STYLE: normal; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal; TEXT-DECORATION: ">In
fact, I also took some benchmark about GET in the same environment but it works
very well(5000/s).</SPAN></SPAN></DIV>
<DIV style="TEXT-INDENT: 2em"><SPAN
style="FONT-STYLE: normal; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal; TEXT-DECORATION: "><SPAN
style="FONT-STYLE: normal; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal; TEXT-DECORATION: "></SPAN></SPAN> </DIV>
<DIV style="TEXT-INDENT: 2em"><SPAN
style="FONT-STYLE: normal; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal; TEXT-DECORATION: "><SPAN
style="FONT-STYLE: normal; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal; TEXT-DECORATION: ">There
are some information which maybe useful:</DIV>
<DIV
style="FONT-STYLE: normal; TEXT-INDENT: 2em; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal"></DIV>
<DIV
style="FONT-STYLE: normal; TEXT-INDENT: 2em; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal"><PRE style="BORDER-BOTTOM: rgb(136,136,136) 1px solid; BORDER-LEFT: rgb(136,136,136) 1px solid; PADDING-BOTTOM: 2px; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(245,245,245); TEXT-INDENT: 0px; MARGIN: 0px 0px 18px; PADDING-LEFT: 2px; LETTER-SPACING: normal; PADDING-RIGHT: 2px; DISPLAY: block; FONT: 12px/18px Menlo,Monaco,'Courier New',monospace; WORD-WRAP: break-word; WHITE-SPACE: pre-wrap; COLOR: rgb(51,51,51); CLEAR: both; WORD-BREAK: break-all; BORDER-TOP: rgb(136,136,136) 1px solid; BORDER-RIGHT: rgb(136,136,136) 1px solid; WORD-SPACING: 0px; PADDING-TOP: 2px; border-top-left-radius: 4px; border-top-right-radius: 4px; border-bottom-right-radius: 4px; border-bottom-left-radius: 4px"><CODE><SPAN style="COLOR: rgb(102,0,102)">Test</SPAN><SPAN style="COLOR: rgb(0,0,0)"> environment</SPAN><SPAN style="COLOR: rgb(102,102,0)">:</SPAN><SPAN style="COLOR: rgb(0,0,0)">
</SPAN><SPAN style="COLOR: rgb(102,0,102)">Ubuntu</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">12.04</SPAN><SPAN style="COLOR: rgb(0,0,0)">
</SPAN><SPAN style="COLOR: rgb(0,102,102)">1</SPAN><SPAN style="COLOR: rgb(0,0,0)"> proxy</SPAN><SPAN style="COLOR: rgb(102,102,0)">-</SPAN><SPAN style="COLOR: rgb(0,0,0)">node </SPAN><SPAN style="COLOR: rgb(102,102,0)">:</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">128GB</SPAN><SPAN style="COLOR: rgb(102,102,0)">-</SPAN><SPAN style="COLOR: rgb(0,0,0)">ram </SPAN><SPAN style="COLOR: rgb(102,102,0)">/</SPAN><SPAN style="COLOR: rgb(0,0,0)"> CPU </SPAN><SPAN style="COLOR: rgb(0,102,102)">16core</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(102,102,0)">/</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">1Gb</SPAN><SPAN style="COLOR: rgb(0,0,0)"> NIC</SPAN><SPAN style="COLOR: rgb(102,102,0)">*</SPAN><SPAN style="COLOR: rgb(0,102,102)">1</SPAN><SPAN style="COLOR: rgb(0,0,0)">
</SPAN><SPAN style="COLOR: rgb(0,102,102)">5</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(102,0,102)">Storage</SPAN><SPAN style="COLOR: rgb(102,102,0)">-</SPAN><SPAN style="COLOR: rgb(0,0,0)">nodes </SPAN><SPAN style="COLOR: rgb(102,102,0)">:</SPAN><SPAN style="COLOR: rgb(0,0,0)"> each </SPAN><SPAN style="COLOR: rgb(0,0,136)">for</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">128GB</SPAN><SPAN style="COLOR: rgb(102,102,0)">-</SPAN><SPAN style="COLOR: rgb(0,0,0)">ram </SPAN><SPAN style="COLOR: rgb(102,102,0)">/</SPAN><SPAN style="COLOR: rgb(0,0,0)"> CPU </SPAN><SPAN style="COLOR: rgb(0,102,102)">16core</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(102,102,0)">/</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">2TB</SPAN><SPAN style="COLOR: rgb(102,102,0)">*</SPAN><SPAN style="COLOR: rgb(0,102,102)">4</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(102,102,0)">/</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">1Gb</SPAN><SPAN style="COLOR: rgb(0,0,0)"> NIC</SPAN><SPAN style="COLOR: rgb(102,102,0)">*</SPAN><SPAN style="COLOR: rgb(0,102,102)">1.</SPAN></CODE></PRE></DIV>
<DIV
style="FONT-STYLE: normal; TEXT-INDENT: 2em; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal"><FONT
color=#4b4b4b face=Arial></FONT></DIV>
<DIV
style="FONT-STYLE: normal; TEXT-INDENT: 2em; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal"><PRE style="BORDER-BOTTOM: rgb(136,136,136) 1px solid; BORDER-LEFT: rgb(136,136,136) 1px solid; PADDING-BOTTOM: 2px; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(245,245,245); TEXT-INDENT: 0px; MARGIN: 0px 0px 18px; PADDING-LEFT: 2px; LETTER-SPACING: normal; PADDING-RIGHT: 2px; DISPLAY: block; FONT: 12px/18px Menlo,Monaco,'Courier New',monospace; WORD-WRAP: break-word; WHITE-SPACE: pre-wrap; COLOR: rgb(51,51,51); CLEAR: both; WORD-BREAK: break-all; BORDER-TOP: rgb(136,136,136) 1px solid; BORDER-RIGHT: rgb(136,136,136) 1px solid; WORD-SPACING: 0px; PADDING-TOP: 2px; border-top-left-radius: 4px; border-top-right-radius: 4px; border-bottom-right-radius: 4px; border-bottom-left-radius: 4px"><CODE><SPAN style="COLOR: rgb(102,102,0)">[</SPAN><SPAN style="COLOR: rgb(0,0,0)">bench</SPAN><SPAN style="COLOR: rgb(102,102,0)">]</SPAN><SPAN style="COLOR: rgb(0,0,0)">
concurrency </SPAN><SPAN style="COLOR: rgb(102,102,0)">=</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">200</SPAN><SPAN style="COLOR: rgb(0,0,0)">
object_size </SPAN><SPAN style="COLOR: rgb(102,102,0)">=</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">4096</SPAN><SPAN style="COLOR: rgb(0,0,0)">
num_objects </SPAN><SPAN style="COLOR: rgb(102,102,0)">=</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">2000000</SPAN><SPAN style="COLOR: rgb(0,0,0)">
num_containers </SPAN><SPAN style="COLOR: rgb(102,102,0)">=</SPAN><SPAN style="COLOR: rgb(0,0,0)"> </SPAN><SPAN style="COLOR: rgb(0,102,102)">200</SPAN><SPAN style="COLOR: rgb(0,0,0)">
</SPAN><SPAN style="COLOR: rgb(102,102,0)">=============================================</SPAN></CODE></PRE></DIV>
<BLOCKQUOTE
style="FONT-STYLE: normal; TEXT-INDENT: 2em; FONT-FAMILY: ΢ÈíÑźÚ; COLOR: #000000; FONT-SIZE: 10.5pt; FONT-WEIGHT: normal; MARGIN-RIGHT: 0px"
dir=ltr>
<DIV><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px">I
have traced the code of PUT operation to find out what cause
the performance degradation while putting objects. Some code cost
a long</SPAN><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"> time
in ObjectController::PUT(swift/obj/server.py).</SPAN></DIV>
<DIV><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"></SPAN> </DIV>
<DIV><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">>
for chunk in iter(<SPAN style="COLOR: #ff0000">lambda:
reader(self.network_chunk_size), </SPAN>¡±):</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">
start_time = time.time()</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">>
upload_size += len(chunk)</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">>
if time.time() > upload_expiration:</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">>
self.logger.increment(¡®PUT.timeouts¡¯)</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">>
return HTTPRequestTimeout(request=request)</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">>
etag.update(chunk)</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">>
while chunk:</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">>
written = os.write(fd, chunk)</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">>
chunk = chunk[written:]</SPAN><BR
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; BACKGROUND-COLOR: rgb(255,255,255); TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 12px/18px Geneva, Helvetica, Verdana, Arial, sans-serif; WHITE-SPACE: normal; FLOAT: none; COLOR: rgb(68,68,68); WORD-SPACING: 0px; -webkit-text-stroke-width: 0px">> <SPAN
style="COLOR: #ff0000"> sleep()</SPAN></SPAN><SPAN
style="COLOR: #ff0000"> </SPAN></SPAN></DIV>
<DIV><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"><SPAN
style="COLOR: #ff0000"></SPAN></SPAN> </DIV></BLOCKQUOTE>
<DIV dir=ltr><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"><SPAN
style="COLOR: #ff0000"> <SPAN
style="COLOR: #000000"> '<SPAN style="COLOR: #ff0000">lambda: reader</SPAN>'
will cost average of 600ms per execution. And 'sleep()' will cost 500ms per
execution.In fact, 'fsync' also spend a lot time when file flush to disk at last
and I removed it already just for testing. </SPAN></SPAN></SPAN><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"><SPAN
style="COLOR: #ff0000"><SPAN style="COLOR: #000000"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px">I
think the time is too long. </SPAN></SPAN></SPAN></SPAN></DIV>
<BLOCKQUOTE style="MARGIN-RIGHT: 0px" dir=ltr>
<DIV style="TEXT-INDENT: 8em" dir=ltr><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"><SPAN
style="COLOR: #ff0000"><SPAN style="COLOR: #000000"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px">I
monitor resource of cluster while putting object.The usage of bandwidth is
very low and the load of CPUs were very
light.</SPAN></SPAN></SPAN></SPAN></DIV>
<DIV dir=ltr><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"><SPAN
style="COLOR: #ff0000"><SPAN style="COLOR: #000000"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px">I
have tried to change vfs_cache_pressure to a low value and it
does not seem to
work. </SPAN></SPAN></SPAN></SPAN></DIV></BLOCKQUOTE>
<BLOCKQUOTE style="MARGIN-RIGHT: 0px" dir=ltr>
<DIV style="TEXT-INDENT: 4em" dir=ltr><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"><SPAN
style="COLOR: #ff0000"><SPAN style="COLOR: #000000"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px">Is
there any advice to figure out the
problem?</SPAN></SPAN></SPAN></SPAN></DIV>
<DIV dir=ltr><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px"><SPAN
style="COLOR: #ff0000"><SPAN style="COLOR: #000000"><SPAN
style="TEXT-ALIGN: left; TEXT-TRANSFORM: none; TEXT-INDENT: 0px; LETTER-SPACING: normal; DISPLAY: inline !important; FONT: 10.5pt/18px ΢ÈíÑźÚ; WHITE-SPACE: normal; FLOAT: none; COLOR: #000000; WORD-SPACING: 0px; TEXT-DECORATION: ; -webkit-text-stroke-width: 0px">appreciate~</SPAN></SPAN></SPAN></SPAN></SPAN></DIV></BLOCKQUOTE></SPAN>
<HR style="WIDTH: 210px; HEIGHT: 1px" align=left color=#b5c4df SIZE=1>
<DIV><SPAN>kalrey</SPAN></DIV></BODY></HTML>