<div dir="ltr">Well, my current theory is that npm's default timeout and retries are set too permissively for cold AFS caches (2 retries, 10 second mintimeout, 1 minute maxtimeout). We _just_ landed this patch (<a href="https://review.openstack.org/#/c/318279/">https://review.openstack.org/#/c/318279/</a>) which increases both the # of retries and the timeouts, which would address that issue.<div><br></div><div>We've got two choices- revert the mirror configuration, or wait for this patch to be propagated to our slaves. Both of them will require a dib run, which happens once a day, so neither fix will be available until tomorrow. Frankly, I'd prefer to move forward than back, so I'm going to check in the infra channel to see if we can trigger that run manually.</div><div><br></div><div>Michael</div></div><br><div class="gmail_quote"><div dir="ltr">On Thu, May 19, 2016 at 5:41 AM Vitaly Kramskikh <<a href="mailto:vkramskikh@mirantis.com">vkramskikh@mirantis.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>It seems this issue started to affect us on OpenStack infra about 13 hours ago. The main 2 reasons of failing tests are "Unexpected end of input"/"registry error parsing json" (<a href="http://logs.openstack.org/19/315119/5/check/gate-fuel-ui-npm-run-lint/2622df4/console.html" target="_blank">example</a>) and "Error: socket hang up" (<a href="http://logs.openstack.org/04/318204/2/check/gate-fuel-ui-npm-run-lint/a390ea7/console.html" target="_blank">example</a>). See <a href="https://review.openstack.org/#/c/315119/" target="_blank">https://review.openstack.org/#/c/315119/</a> for a long list of similar failures (though almost every gate-fuel-ui-npm-run-lint run now fails).<br><br></div>What should we do?<br></div><div class="gmail_extra"><br><div class="gmail_quote">2016-05-16 16:58 GMT+03:00 Michael Krotscheck <span dir="ltr"><<a href="mailto:krotscheck@gmail.com" target="_blank">krotscheck@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hey there, Vitaly-<div><br></div><div>I suspect that the issue you're encountering is actually a cross-atlantic lag, combined with the Mirror's AFS cache warming up. As of this morning, fuel-ui seems to be installing fine from <span style="line-height:1.5">dfw.rax, though you may run into similar issues with other mirrors until those caches warm up.</span></div><span><font color="#888888"><div><span style="line-height:1.5"><br></span></div><div><span style="line-height:1.5">Michael</span></div><div></div>
</font></span><div><br><div class="gmail_quote"><span><div dir="ltr">On Thu, May 12, 2016 at 4:10 AM Vitaly Kramskikh <<a href="mailto:vkramskikh@mirantis.com" target="_blank">vkramskikh@mirantis.com</a>> wrote:<br></div></span><div><div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hi, Michael,<br><br></div>I randomly get "error parsing json" for <a href="https://github.com/openstack/fuel-ui" target="_blank">fuel-ui</a> project: <a href="http://paste.openstack.org/show/496871/" target="_blank">http://paste.openstack.org/show/496871/</a>. Got such errors 2 times out of 5. <br></div><div class="gmail_extra"><br><div class="gmail_quote"></div></div><div class="gmail_extra"><div class="gmail_quote">2016-05-11 22:07 GMT+03:00 Michael Krotscheck <span dir="ltr"><<a href="mailto:krotscheck@gmail.com" target="_blank">krotscheck@gmail.com</a>></span>:<br></div></div><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello everyone!<br><br><div>We've recently added NPM mirrors to our infrastructure, and are about to turn them on. Before that happens, however, we'd like to get a sanity check from impacted projects to make sure that we don't wedge your gate.<div><br></div><div>If you are in charge of a project that invokes `npm install` during any of its gate jobs, then please invoke the following commands at your project root.<br> <br>echo "registry=<a href="http://mirror.dfw.rax.openstack.org/npm/" target="_blank">http://mirror.dfw.rax.openstack.org/npm/</a>" >> .npmrc<br>rm -rf ./node_modules/<br>rm -rf ~/.npm/<div>npm install</div><div><br></div><div>If you encounter an error, put it in <a href="http://paste.openstack.org" target="_blank">paste.openstack.org</a> and reply to this thread. If not, great! Delete the .npmrc file and go on your merry way.</div><div><br></div><div>Have a great day!</div></div></div><span><font color="#888888"><div dir="ltr"><div dir="ltr"><div><div><div><br></div><div>Michael<br><br></div></div></div></div></div></font></span></div>
<br></blockquote></div></div><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div><div dir="ltr"><div><div dir="ltr">Vitaly Kramskikh,<br>Fuel UI Tech Lead,<br>Mirantis, Inc.</div></div></div></div>
</div>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
</blockquote></div></div></div></div></div>
<br>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div><div dir="ltr"><div><div dir="ltr">Vitaly Kramskikh,<br>Fuel UI Tech Lead,<br>Mirantis, Inc.</div></div></div></div>
</div>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
</blockquote></div>