<div dir="ltr"><div dir="ltr">Those logs are curious.<div><br></div><div>After uploading file-segments, the final request to create a static large object manifest will validate all of the referenced segments with HEAD requests. All the referenced SLO segments have to return a successful 2XX response before the manifest object will be created.</div><div><br></div><div>I can see you included the partial logs from transaction tx30e82374b98845bab6883-0062e7d225 and txf09676de38964ca299b77-0062e7dcc8 - but it's not entirely clear what happened between the object-server PUT that created the file-segment object (response 201) and the HEAD that failed (response 404).</div><div><br></div><div>It appears both requests went to the same node (swift0-1-object01) and device (/mpathc) - so unless the file was deleted (or expired, or corrupted, or rebalanced) I would not expect the 404 response. Can you check on the file-segment object AFTER the SLO validation fails? Does it keep returning 404? Where did it go?!</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Aug 3, 2022 at 12:26 PM Komarov, Aleksandr <<a href="mailto:aleksandr.komarov@itglobal.com">aleksandr.komarov@itglobal.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="RU">
<div class="gmail-m_7804281490066577709WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi to all!<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Please suggest how to fix the situation.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">When uploading files larger than 100GB, at the stage of multipart-manifest validation, we get 404 error for some segments that were previously uploaded successfully. As a result, the client receives a 400 response. Uploading
a large file is not possible.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Logs:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Aug 1 13:18:30 swift01-object01 object-server: IP - - [01/Aug/2022:13:18:30 +0000] "PUT /mpathc/12130/AUTH_5affc785b3454cddb2d1f69ce62b4441/bucket/.file-segments/150.file/000<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">00032" 201 - "PUT <a href="http://domain-name/v1/AUTH_5affc785b3454cddb2d1f69ce62b4441/bucket/.file-segments/150.file/00000032" target="_blank">http://domain-name/v1/AUTH_5affc785b3454cddb2d1f69ce62b4441/bucket/.file-segments/150.file/00000032</a>" "tx30e82374b98845bab6883-0062e7d225" "proxy-server 8367" 128.7641 "-" 21577 0<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Aug 1 13:18:30 swift01-object01 container-server: IP - - [01/Aug/2022:13:18:30 +0000] "PUT /mpathb/952/AUTH_5affc785b3454cddb2d1f69ce62b4441/bucket/.file-segments/150.file/00<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">000032" 201 - "PUT <a href="http://domain-name/mpathe/12130/AUTH_5affc785b3454cddb2d1f69ce62b4441/bucket/.file-segments/150.file/00000032" target="_blank">http://domain-name/mpathe/12130/AUTH_5affc785b3454cddb2d1f69ce62b4441/bucket/.file-segments/150.file/00000032</a>" "tx30e82374b98845bab6883-0062<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">e7d225" "object-server 24710" 0.0005 "-" 13211 0<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Aug 1 14:01:46 swift01-object01 object-server: IP - - [01/Aug/2022:14:01:46 +0000] "HEAD /mpathc/12130/AUTH_5affc785b3454cddb2d1f69ce62b4441/bucket/.file-segments/150.file/00000032" 404 - "HEAD <a href="http://domain-name/v1/AUTH_5affc785b3454cddb2d1f69ce62b4441/bucket/.file-segments/150.file/00000032" target="_blank">http://domain-name/v1/AUTH_5affc785b3454cddb2d1f69ce62b4441/bucket/.file-segments/150.file/00000032</a>"
"txf09676de38964ca299b77-0062e7dcc8" "proxy-server 8367" 0.0003 "-" 21579 0<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">At the same time, some segments successfully found. With files less than 50GB everything is fine.<u></u><u></u></span></p>
</div>
</div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr">Clay Gerrard</div></div></div>