[openstack-dev] [OpenStack-Infra] Intermittent failures cloning noVNC from github.com/kanaka

Sean Dague sean at dague.net
Thu Mar 13 14:44:09 UTC 2014


I think a bigger question is why are we using a git version of something
outside of OpenStack.

Where is a noNVC release we can point to and use?

In Juno I'd really be pro removing all the devstack references to git
repos not on git.openstack.org, because these kinds of failures have
real impact.

Currently we have 4 repositories that fit this bill:

SWIFT3_REPO=${SWIFT3_REPO:-http://github.com/fujita/swift3.git}
NOVNC_REPO=${NOVNC_REPO:-https://github.com/kanaka/noVNC.git}
RYU_REPO=${RYU_REPO:-https://github.com/osrg/ryu.git}
SPICE_REPO=${SPICE_REPO:-http://anongit.freedesktop.org/git/spice/spice-html5.git}

I think all of these probably need to be removed from devstack. We
should be using release versions (preferably in distros, though allowed
to be in language specific package manager).

	-Sean

On 03/13/2014 10:26 AM, Solly Ross wrote:
> @bnemec: I don't think that's been considered.  I'm actually one of the upstream maintainers for noVNC.  The only concern that I'd have with OpenStack adopting noVNC (there are other maintainers, as well as the author, so I'd have to check with them as well) is that there are a few other projects that use noVNC, so we'd need to make sure that no OpenStack-specific code gets merged into noVNC if we adopt it.  Other that that, though, adopting noVNC doesn't sound like a horrible idea.
> 
> Best Regards,
> Solly Ross
> 
> ----- Original Message -----
> From: "Ben Nemec" <openstack at nemebean.com>
> To: "OpenStack Development Mailing List (not for usage questions)" <openstack-dev at lists.openstack.org>
> Cc: openstack-infra at lists.openstack.org
> Sent: Wednesday, March 12, 2014 3:38:19 PM
> Subject: Re: [openstack-dev] [OpenStack-Infra] Intermittent failures cloning	noVNC from github.com/kanaka
> 
> 
> 
> On 2014-03-11 20:34, Joshua Harlow wrote: 
> 
> 
> https://status.github.com/messages 
> * 'GitHub.com is operating normally, despite an ongoing DDoS attack. The mitigations we have in place are proving effective in protecting us and we're hopeful that we've got this one resolved.' 
> If you were cloning from github.org and not http://git.openstack.org then you were likely seeing some of the DDoS attack in action. 
> Unfortunately I don't think novnc is in git.openstack.org because it's not an OpenStack project. I wonder if we should investigate adopting it (if the author(s) are amenable to that) since we're using the git version of it. Maybe that's already been considered and I just don't know about it. :-) 
> -Ben 
> 
> 
> 
> From: Sukhdev Kapur < sukhdevkapur at gmail.com > 
> Reply-To: "OpenStack Development Mailing List (not for usage questions)" < openstack-dev at lists.openstack.org > 
> Date: Tuesday, March 11, 2014 at 4:08 PM 
> To: "Dane Leblanc (leblancd)" < leblancd at cisco.com > 
> Cc: "OpenStack Development Mailing List (not for usage questions)" < openstack-dev at lists.openstack.org >, " openstack-infra at lists.openstack.org " < openstack-infra at lists.openstack.org > 
> Subject: Re: [openstack-dev] [OpenStack-Infra] Intermittent failures cloning noVNC from github.com/kanaka 
> 
> 
> 
> I have noticed that even clone of devstack has failed few times within last couple of hours - it was running fairly smooth so far. 
> -Sukhdev 
> 
> 
> On Tue, Mar 11, 2014 at 5:05 PM, Sukhdev Kapur < sukhdevkapur at gmail.com > wrote: 
> 
> 
> 
> [adding openstack-dev list as well ] 
> I have noticed that this has stated hitting my builds within last few hours. I have noticed exact same failures on almost 10 builds. 
> Looks like something has happened within last few hours - perhaps the load? 
> -Sukhdev 
> 
> 
> On Tue, Mar 11, 2014 at 4:28 PM, Dane Leblanc (leblancd) < leblancd at cisco.com > wrote: 
> 
> 
> 
> 
> 
> Apologies if this is the wrong audience for this question... 
> 
> 
> 
> I'm seeing intermittent failures running stack.sh whereby 'git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC' is returning various errors. Below are 2 examples. 
> 
> 
> 
> Is this a known issue? Are there any localrc settings which might help here? 
> 
> 
> 
> Example 1: 
> 
> 
> 
> 2014-03-11 15:00:33.779 | + is_service_enabled n-novnc 
> 
> 2014-03-11 15:00:33.780 | + return 0 
> 
> 2014-03-11 15:00:33.781 | ++ trueorfalse False 
> 
> 2014-03-11 15:00:33.782 | + NOVNC_FROM_PACKAGE=False 
> 
> 2014-03-11 15:00:33.783 | + '[' False = True ']' 
> 
> 2014-03-11 15:00:33.784 | + NOVNC_WEB_DIR=/opt/stack/noVNC 
> 
> 2014-03-11 15:00:33.785 | + git_clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC master 
> 
> 2014-03-11 15:00:33.786 | + GIT_REMOTE= https://github.com/kanaka/noVNC.git 
> 
> 2014-03-11 15:00:33.788 | + GIT_DEST=/opt/stack/noVNC 
> 
> 2014-03-11 15:00:33.789 | + GIT_REF=master 
> 
> 2014-03-11 15:00:33.790 | ++ trueorfalse False False 
> 
> 2014-03-11 15:00:33.791 | + RECLONE=False 
> 
> 2014-03-11 15:00:33.792 | + [[ False = \T\r\u\e ]] 
> 
> 2014-03-11 15:00:33.793 | + echo master 
> 
> 2014-03-11 15:00:33.794 | + egrep -q '^refs' 
> 
> 2014-03-11 15:00:33.795 | + [[ ! -d /opt/stack/noVNC ]] 
> 
> 2014-03-11 15:00:33.796 | + [[ False = \T\r\u\e ]] 
> 
> 2014-03-11 15:00:33.797 | + git_timed clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC 
> 
> 2014-03-11 15:00:33.798 | + local count=0 
> 
> 2014-03-11 15:00:33.799 | + local timeout=0 
> 
> 2014-03-11 15:00:33.801 | + [[ -n 0 ]] 
> 
> 2014-03-11 15:00:33.802 | + timeout=0 
> 
> 2014-03-11 15:00:33.803 | + timeout -s SIGINT 0 git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC 
> 
> 2014-03-11 15:00:33.804 | Cloning into '/opt/stack/noVNC'... 
> 
> 2014-03-11 15:03:13.694 | error: RPC failed; result=56, HTTP code = 200 
> 
> 2014-03-11 15:03:13.695 | fatal: The remote end hung up unexpectedly 
> 
> 2014-03-11 15:03:13.697 | fatal: early EOF 
> 
> 2014-03-11 15:03:13.698 | fatal: index-pack failed 
> 
> 2014-03-11 15:03:13.699 | + [[ 128 -ne 124 ]] 
> 
> 2014-03-11 15:03:13.700 | + die 596 'git call failed: [git clone' https://github.com/kanaka/noVNC.git '/opt/stack/noVNC]' 
> 
> 2014-03-11 15:03:13.701 | + local exitcode=0 
> 
> 2014-03-11 15:03:13.702 | [Call Trace] 
> 
> 2014-03-11 15:03:13.703 | ./stack.sh:736:install_nova 
> 
> 2014-03-11 15:03:13.705 | /var/lib/jenkins/devstack/lib/nova:618:git_clone 
> 
> 2014-03-11 15:03:13.706 | /var/lib/jenkins/devstack/functions-common:543:git_timed 
> 
> 2014-03-11 15:03:13.707 | /var/lib/jenkins/devstack/functions-common:596:die 
> 
> 2014-03-11 15:03:13.708 | [ERROR] /var/lib/jenkins/devstack/functions-common:596 git call failed: [git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC] 
> 
> 
> 
> 
> 
> Example 2: 
> 
> 
> 2014-03-11 14:12:58.472 | + is_service_enabled n-novnc 
> 2014-03-11 14:12:58.473 | + return 0 
> 2014-03-11 14:12:58.474 | ++ trueorfalse False 
> 2014-03-11 14:12:58.475 | + NOVNC_FROM_PACKAGE=False 
> 2014-03-11 14:12:58.476 | + '[' False = True ']' 
> 2014-03-11 14:12:58.477 | + NOVNC_WEB_DIR=/opt/stack/noVNC 
> 2014-03-11 14:12:58.478 | + git_clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC master 
> 2014-03-11 14:12:58.479 | + GIT_REMOTE= https://github.com/kanaka/noVNC.git 
> 2014-03-11 14:12:58.480 | + GIT_DEST=/opt/stack/noVNC 
> 2014-03-11 14:12:58.481 | + GIT_REF=master 
> 2014-03-11 14:12:58.482 | ++ trueorfalse False False 
> 2014-03-11 14:12:58.483 | + RECLONE=False 
> 2014-03-11 14:12:58.484 | + [[ False = \T\r\u\e ]] 
> 2014-03-11 14:12:58.485 | + echo master 
> 2014-03-11 14:12:58.486 | + egrep -q '^refs' 
> 2014-03-11 14:12:58.487 | + [[ ! -d /opt/stack/noVNC ]] 
> 2014-03-11 14:12:58.488 | + [[ False = \T\r\u\e ]] 
> 2014-03-11 14:12:58.489 | + git_timed clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC 
> 2014-03-11 14:12:58.490 | + local count=0 
> 2014-03-11 14:12:58.491 | + local timeout=0 
> 2014-03-11 14:12:58.492 | + [[ -n 0 ]] 
> 2014-03-11 14:12:58.493 | + timeout=0 
> 2014-03-11 14:12:58.494 | + timeout -s SIGINT 0 git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC 
> 2014-03-11 14:12:58.495 | Cloning into '/opt/stack/noVNC'... 
> 2014-03-11 14:14:02.315 | error: The requested URL returned error: 403 while accessing https://github.com/kanaka/noVNC.git/info/refs 
> 2014-03-11 14:14:02.316 | fatal: HTTP request failed 
> 2014-03-11 14:14:02.317 | + [[ 128 -ne 124 ]] 
> 2014-03-11 14:14:02.318 | + die 596 'git call failed: [git clone' https://github.com/kanaka/noVNC.git '/opt/stack/noVNC]' 
> 2014-03-11 14:14:02.319 | + local exitcode=0 
> 2014-03-11 14:14:02.321 | [Call Trace] 
> 2014-03-11 14:14:02.322 | ./stack.sh:736:install_nova 
> 2014-03-11 14:14:02.323 | /var/lib/jenkins/devstack/lib/nova:618:git_clone 
> 2014-03-11 14:14:02.324 | /var/lib/jenkins/devstack/functions-common:543:git_timed 
> 2014-03-11 14:14:02.326 | /var/lib/jenkins/devstack/functions-common:596:die 
> 2014-03-11 14:14:02.327 | [ERROR] /var/lib/jenkins/devstack/functions-common:596 git call failed: [git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC] 
> 
> 
> 
> 
> Thanks, 
> 
> Dane 
> 
> 
> _______________________________________________ 
> OpenStack-Infra mailing list 
> OpenStack-Infra at lists.openstack.org 
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra 
> 
> 
> _______________________________________________
> OpenStack-dev mailing list OpenStack-dev at lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev 
> 
> 
> 
> 
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 


-- 
Sean Dague
Samsung Research America
sean at dague.net / sean.dague at samsung.com
http://dague.net

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 482 bytes
Desc: OpenPGP digital signature
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140313/aa61991f/attachment.pgp>


More information about the OpenStack-dev mailing list