[openstack-dev] [OpenStack-Infra] Intermittent failures cloning noVNC from github.com/kanaka

Solly Ross sross at redhat.com
Thu Mar 13 14:56:36 UTC 2014 

@sdague: We (the upstream noVNC/websockify maintainers) are attempting to get back on the bandwagon WRT releases.  Unfortunately, before a few months back, the developer had taken a break from noVNC work, so there isn't a recent release.  We just pushed a new release of Websockify the week before last, and I'll start the discussion about a new release of noVNC.

Best Regards,
Solly Ross

----- Original Message -----
From: "Sean Dague" <sean at dague.net>
To: "OpenStack Development Mailing List (not for usage questions)" <openstack-dev at lists.openstack.org>, openstack at nemebean.com
Cc: openstack-infra at lists.openstack.org
Sent: Thursday, March 13, 2014 10:44:09 AM
Subject: Re: [openstack-dev] [OpenStack-Infra] Intermittent failures cloning noVNC from github.com/kanaka

I think a bigger question is why are we using a git version of something
outside of OpenStack.

Where is a noNVC release we can point to and use?

In Juno I'd really be pro removing all the devstack references to git
repos not on git.openstack.org, because these kinds of failures have
real impact.

Currently we have 4 repositories that fit this bill:

SWIFT3_REPO=${SWIFT3_REPO:-http://github.com/fujita/swift3.git}
NOVNC_REPO=${NOVNC_REPO:-https://github.com/kanaka/noVNC.git}
RYU_REPO=${RYU_REPO:-https://github.com/osrg/ryu.git}
SPICE_REPO=${SPICE_REPO:-http://anongit.freedesktop.org/git/spice/spice-html5.git}

I think all of these probably need to be removed from devstack. We
should be using release versions (preferably in distros, though allowed
to be in language specific package manager).

	-Sean

On 03/13/2014 10:26 AM, Solly Ross wrote:
> @bnemec: I don't think that's been considered.  I'm actually one of the upstream maintainers for noVNC.  The only concern that I'd have with OpenStack adopting noVNC (there are other maintainers, as well as the author, so I'd have to check with them as well) is that there are a few other projects that use noVNC, so we'd need to make sure that no OpenStack-specific code gets merged into noVNC if we adopt it.  Other that that, though, adopting noVNC doesn't sound like a horrible idea.
> 
> Best Regards,
> Solly Ross
> 
> ----- Original Message -----
> From: "Ben Nemec" <openstack at nemebean.com>
> To: "OpenStack Development Mailing List (not for usage questions)" <openstack-dev at lists.openstack.org>
> Cc: openstack-infra at lists.openstack.org
> Sent: Wednesday, March 12, 2014 3:38:19 PM
> Subject: Re: [openstack-dev] [OpenStack-Infra] Intermittent failures cloning	noVNC from github.com/kanaka
> 
> 
> 
> On 2014-03-11 20:34, Joshua Harlow wrote: 
> 
> 
> https://status.github.com/messages 
> * 'GitHub.com is operating normally, despite an ongoing DDoS attack. The mitigations we have in place are proving effective in protecting us and we're hopeful that we've got this one resolved.' 
> If you were cloning from github.org and not http://git.openstack.org then you were likely seeing some of the DDoS attack in action. 
> Unfortunately I don't think novnc is in git.openstack.org because it's not an OpenStack project. I wonder if we should investigate adopting it (if the author(s) are amenable to that) since we're using the git version of it. Maybe that's already been considered and I just don't know about it. :-) 
> -Ben 
> 
> 
> 
> From: Sukhdev Kapur < sukhdevkapur at gmail.com > 
> Reply-To: "OpenStack Development Mailing List (not for usage questions)" < openstack-dev at lists.openstack.org > 
> Date: Tuesday, March 11, 2014 at 4:08 PM 
> To: "Dane Leblanc (leblancd)" < leblancd at cisco.com > 
> Cc: "OpenStack Development Mailing List (not for usage questions)" < openstack-dev at lists.openstack.org >, " openstack-infra at lists.openstack.org " < openstack-infra at lists.openstack.org > 
> Subject: Re: [openstack-dev] [OpenStack-Infra] Intermittent failures cloning noVNC from github.com/kanaka 
> 
> 
> 
> I have noticed that even clone of devstack has failed few times within last couple of hours - it was running fairly smooth so far. 
> -Sukhdev 
> 
> 
> On Tue, Mar 11, 2014 at 5:05 PM, Sukhdev Kapur < sukhdevkapur at gmail.com > wrote: 
> 
> 
> 
> [adding openstack-dev list as well ] 
> I have noticed that this has stated hitting my builds within last few hours. I have noticed exact same failures on almost 10 builds. 
> Looks like something has happened within last few hours - perhaps the load? 
> -Sukhdev 
> 
> 
> On Tue, Mar 11, 2014 at 4:28 PM, Dane Leblanc (leblancd) < leblancd at cisco.com > wrote: 
> 
> 
> 
> 
> 
> Apologies if this is the wrong audience for this question... 
> 
> 
> 
> I'm seeing intermittent failures running stack.sh whereby 'git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC' is returning various errors. Below are 2 examples. 
> 
> 
> 
> Is this a known issue? Are there any localrc settings which might help here? 
> 
> 
> 
> Example 1: 
> 
> 
> 
> 2014-03-11 15:00:33.779 | + is_service_enabled n-novnc 
> 
> 2014-03-11 15:00:33.780 | + return 0 
> 
> 2014-03-11 15:00:33.781 | ++ trueorfalse False 
> 
> 2014-03-11 15:00:33.782 | + NOVNC_FROM_PACKAGE=False 
> 
> 2014-03-11 15:00:33.783 | + '[' False = True ']' 
> 
> 2014-03-11 15:00:33.784 | + NOVNC_WEB_DIR=/opt/stack/noVNC 
> 
> 2014-03-11 15:00:33.785 | + git_clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC master 
> 
> 2014-03-11 15:00:33.786 | + GIT_REMOTE= https://github.com/kanaka/noVNC.git 
> 
> 2014-03-11 15:00:33.788 | + GIT_DEST=/opt/stack/noVNC 
> 
> 2014-03-11 15:00:33.789 | + GIT_REF=master 
> 
> 2014-03-11 15:00:33.790 | ++ trueorfalse False False 
> 
> 2014-03-11 15:00:33.791 | + RECLONE=False 
> 
> 2014-03-11 15:00:33.792 | + [[ False = \T\r\u\e ]] 
> 
> 2014-03-11 15:00:33.793 | + echo master 
> 
> 2014-03-11 15:00:33.794 | + egrep -q '^refs' 
> 
> 2014-03-11 15:00:33.795 | + [[ ! -d /opt/stack/noVNC ]] 
> 
> 2014-03-11 15:00:33.796 | + [[ False = \T\r\u\e ]] 
> 
> 2014-03-11 15:00:33.797 | + git_timed clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC 
> 
> 2014-03-11 15:00:33.798 | + local count=0 
> 
> 2014-03-11 15:00:33.799 | + local timeout=0 
> 
> 2014-03-11 15:00:33.801 | + [[ -n 0 ]] 
> 
> 2014-03-11 15:00:33.802 | + timeout=0 
> 
> 2014-03-11 15:00:33.803 | + timeout -s SIGINT 0 git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC 
> 
> 2014-03-11 15:00:33.804 | Cloning into '/opt/stack/noVNC'... 
> 
> 2014-03-11 15:03:13.694 | error: RPC failed; result=56, HTTP code = 200 
> 
> 2014-03-11 15:03:13.695 | fatal: The remote end hung up unexpectedly 
> 
> 2014-03-11 15:03:13.697 | fatal: early EOF 
> 
> 2014-03-11 15:03:13.698 | fatal: index-pack failed 
> 
> 2014-03-11 15:03:13.699 | + [[ 128 -ne 124 ]] 
> 
> 2014-03-11 15:03:13.700 | + die 596 'git call failed: [git clone' https://github.com/kanaka/noVNC.git '/opt/stack/noVNC]' 
> 
> 2014-03-11 15:03:13.701 | + local exitcode=0 
> 
> 2014-03-11 15:03:13.702 | [Call Trace] 
> 
> 2014-03-11 15:03:13.703 | ./stack.sh:736:install_nova 
> 
> 2014-03-11 15:03:13.705 | /var/lib/jenkins/devstack/lib/nova:618:git_clone 
> 
> 2014-03-11 15:03:13.706 | /var/lib/jenkins/devstack/functions-common:543:git_timed 
> 
> 2014-03-11 15:03:13.707 | /var/lib/jenkins/devstack/functions-common:596:die 
> 
> 2014-03-11 15:03:13.708 | [ERROR] /var/lib/jenkins/devstack/functions-common:596 git call failed: [git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC] 
> 
> 
> 
> 
> 
> Example 2: 
> 
> 
> 2014-03-11 14:12:58.472 | + is_service_enabled n-novnc 
> 2014-03-11 14:12:58.473 | + return 0 
> 2014-03-11 14:12:58.474 | ++ trueorfalse False 
> 2014-03-11 14:12:58.475 | + NOVNC_FROM_PACKAGE=False 
> 2014-03-11 14:12:58.476 | + '[' False = True ']' 
> 2014-03-11 14:12:58.477 | + NOVNC_WEB_DIR=/opt/stack/noVNC 
> 2014-03-11 14:12:58.478 | + git_clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC master 
> 2014-03-11 14:12:58.479 | + GIT_REMOTE= https://github.com/kanaka/noVNC.git 
> 2014-03-11 14:12:58.480 | + GIT_DEST=/opt/stack/noVNC 
> 2014-03-11 14:12:58.481 | + GIT_REF=master 
> 2014-03-11 14:12:58.482 | ++ trueorfalse False False 
> 2014-03-11 14:12:58.483 | + RECLONE=False 
> 2014-03-11 14:12:58.484 | + [[ False = \T\r\u\e ]] 
> 2014-03-11 14:12:58.485 | + echo master 
> 2014-03-11 14:12:58.486 | + egrep -q '^refs' 
> 2014-03-11 14:12:58.487 | + [[ ! -d /opt/stack/noVNC ]] 
> 2014-03-11 14:12:58.488 | + [[ False = \T\r\u\e ]] 
> 2014-03-11 14:12:58.489 | + git_timed clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC 
> 2014-03-11 14:12:58.490 | + local count=0 
> 2014-03-11 14:12:58.491 | + local timeout=0 
> 2014-03-11 14:12:58.492 | + [[ -n 0 ]] 
> 2014-03-11 14:12:58.493 | + timeout=0 
> 2014-03-11 14:12:58.494 | + timeout -s SIGINT 0 git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC 
> 2014-03-11 14:12:58.495 | Cloning into '/opt/stack/noVNC'... 
> 2014-03-11 14:14:02.315 | error: The requested URL returned error: 403 while accessing https://github.com/kanaka/noVNC.git/info/refs 
> 2014-03-11 14:14:02.316 | fatal: HTTP request failed 
> 2014-03-11 14:14:02.317 | + [[ 128 -ne 124 ]] 
> 2014-03-11 14:14:02.318 | + die 596 'git call failed: [git clone' https://github.com/kanaka/noVNC.git '/opt/stack/noVNC]' 
> 2014-03-11 14:14:02.319 | + local exitcode=0 
> 2014-03-11 14:14:02.321 | [Call Trace] 
> 2014-03-11 14:14:02.322 | ./stack.sh:736:install_nova 
> 2014-03-11 14:14:02.323 | /var/lib/jenkins/devstack/lib/nova:618:git_clone 
> 2014-03-11 14:14:02.324 | /var/lib/jenkins/devstack/functions-common:543:git_timed 
> 2014-03-11 14:14:02.326 | /var/lib/jenkins/devstack/functions-common:596:die 
> 2014-03-11 14:14:02.327 | [ERROR] /var/lib/jenkins/devstack/functions-common:596 git call failed: [git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC] 
> 
> 
> 
> 
> Thanks, 
> 
> Dane 
> 
> 
> _______________________________________________ 
> OpenStack-Infra mailing list 
> OpenStack-Infra at lists.openstack.org 
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra 
> 
> 
> _______________________________________________
> OpenStack-dev mailing list OpenStack-dev at lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev 
> 
> 
> 
> 
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 


-- 
Sean Dague
Samsung Research America
sean at dague.net / sean.dague at samsung.com
http://dague.net


_______________________________________________
OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

More information about the OpenStack-dev mailing list