[openstack-dev] [OpenStack-Infra] Intermittent failures cloning noVNC from github.com/kanaka

Monty Taylor mordred at inaugust.com
Thu Mar 13 16:09:01 UTC 2014


I agree.

Solly - in addition to potentially 'adopting' noVNC - or as a parallel 
train of thought ...

As we started working on storyboard in infra, we've started using the 
bower tool for html/javascript packaging - and we have some ability to 
cache the output of that pretty easily. Would you accept patches to 
noVNC to add bower config things and/or publication of tarballs of 
releases via it? Since noVNC isn't likely to be participating in the 
integrated gate in either case, we could potentially split the question 
of "how do we get copies of it in a way that doesn't depend on OS 
distros" (which is why we use pip for our python depends) and "does 
noVNC want to have its git repo exist in OpenStack Infra systems.

Monty

On 03/13/2014 07:44 AM, Sean Dague wrote:
> I think a bigger question is why are we using a git version of something
> outside of OpenStack.
>
> Where is a noNVC release we can point to and use?
>
> In Juno I'd really be pro removing all the devstack references to git
> repos not on git.openstack.org, because these kinds of failures have
> real impact.
>
> Currently we have 4 repositories that fit this bill:
>
> SWIFT3_REPO=${SWIFT3_REPO:-http://github.com/fujita/swift3.git}
> NOVNC_REPO=${NOVNC_REPO:-https://github.com/kanaka/noVNC.git}
> RYU_REPO=${RYU_REPO:-https://github.com/osrg/ryu.git}
> SPICE_REPO=${SPICE_REPO:-http://anongit.freedesktop.org/git/spice/spice-html5.git}
>
> I think all of these probably need to be removed from devstack. We
> should be using release versions (preferably in distros, though allowed
> to be in language specific package manager).
>
> 	-Sean
>
> On 03/13/2014 10:26 AM, Solly Ross wrote:
>> @bnemec: I don't think that's been considered.  I'm actually one of the upstream maintainers for noVNC.  The only concern that I'd have with OpenStack adopting noVNC (there are other maintainers, as well as the author, so I'd have to check with them as well) is that there are a few other projects that use noVNC, so we'd need to make sure that no OpenStack-specific code gets merged into noVNC if we adopt it.  Other that that, though, adopting noVNC doesn't sound like a horrible idea.
>>
>> Best Regards,
>> Solly Ross
>>
>> ----- Original Message -----
>> From: "Ben Nemec" <openstack at nemebean.com>
>> To: "OpenStack Development Mailing List (not for usage questions)" <openstack-dev at lists.openstack.org>
>> Cc: openstack-infra at lists.openstack.org
>> Sent: Wednesday, March 12, 2014 3:38:19 PM
>> Subject: Re: [openstack-dev] [OpenStack-Infra] Intermittent failures cloning	noVNC from github.com/kanaka
>>
>>
>>
>> On 2014-03-11 20:34, Joshua Harlow wrote:
>>
>>
>> https://status.github.com/messages
>> * 'GitHub.com is operating normally, despite an ongoing DDoS attack. The mitigations we have in place are proving effective in protecting us and we're hopeful that we've got this one resolved.'
>> If you were cloning from github.org and not http://git.openstack.org then you were likely seeing some of the DDoS attack in action.
>> Unfortunately I don't think novnc is in git.openstack.org because it's not an OpenStack project. I wonder if we should investigate adopting it (if the author(s) are amenable to that) since we're using the git version of it. Maybe that's already been considered and I just don't know about it. :-)
>> -Ben
>>
>>
>>
>> From: Sukhdev Kapur < sukhdevkapur at gmail.com >
>> Reply-To: "OpenStack Development Mailing List (not for usage questions)" < openstack-dev at lists.openstack.org >
>> Date: Tuesday, March 11, 2014 at 4:08 PM
>> To: "Dane Leblanc (leblancd)" < leblancd at cisco.com >
>> Cc: "OpenStack Development Mailing List (not for usage questions)" < openstack-dev at lists.openstack.org >, " openstack-infra at lists.openstack.org " < openstack-infra at lists.openstack.org >
>> Subject: Re: [openstack-dev] [OpenStack-Infra] Intermittent failures cloning noVNC from github.com/kanaka
>>
>>
>>
>> I have noticed that even clone of devstack has failed few times within last couple of hours - it was running fairly smooth so far.
>> -Sukhdev
>>
>>
>> On Tue, Mar 11, 2014 at 5:05 PM, Sukhdev Kapur < sukhdevkapur at gmail.com > wrote:
>>
>>
>>
>> [adding openstack-dev list as well ]
>> I have noticed that this has stated hitting my builds within last few hours. I have noticed exact same failures on almost 10 builds.
>> Looks like something has happened within last few hours - perhaps the load?
>> -Sukhdev
>>
>>
>> On Tue, Mar 11, 2014 at 4:28 PM, Dane Leblanc (leblancd) < leblancd at cisco.com > wrote:
>>
>>
>>
>>
>>
>> Apologies if this is the wrong audience for this question...
>>
>>
>>
>> I'm seeing intermittent failures running stack.sh whereby 'git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC' is returning various errors. Below are 2 examples.
>>
>>
>>
>> Is this a known issue? Are there any localrc settings which might help here?
>>
>>
>>
>> Example 1:
>>
>>
>>
>> 2014-03-11 15:00:33.779 | + is_service_enabled n-novnc
>>
>> 2014-03-11 15:00:33.780 | + return 0
>>
>> 2014-03-11 15:00:33.781 | ++ trueorfalse False
>>
>> 2014-03-11 15:00:33.782 | + NOVNC_FROM_PACKAGE=False
>>
>> 2014-03-11 15:00:33.783 | + '[' False = True ']'
>>
>> 2014-03-11 15:00:33.784 | + NOVNC_WEB_DIR=/opt/stack/noVNC
>>
>> 2014-03-11 15:00:33.785 | + git_clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC master
>>
>> 2014-03-11 15:00:33.786 | + GIT_REMOTE= https://github.com/kanaka/noVNC.git
>>
>> 2014-03-11 15:00:33.788 | + GIT_DEST=/opt/stack/noVNC
>>
>> 2014-03-11 15:00:33.789 | + GIT_REF=master
>>
>> 2014-03-11 15:00:33.790 | ++ trueorfalse False False
>>
>> 2014-03-11 15:00:33.791 | + RECLONE=False
>>
>> 2014-03-11 15:00:33.792 | + [[ False = \T\r\u\e ]]
>>
>> 2014-03-11 15:00:33.793 | + echo master
>>
>> 2014-03-11 15:00:33.794 | + egrep -q '^refs'
>>
>> 2014-03-11 15:00:33.795 | + [[ ! -d /opt/stack/noVNC ]]
>>
>> 2014-03-11 15:00:33.796 | + [[ False = \T\r\u\e ]]
>>
>> 2014-03-11 15:00:33.797 | + git_timed clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC
>>
>> 2014-03-11 15:00:33.798 | + local count=0
>>
>> 2014-03-11 15:00:33.799 | + local timeout=0
>>
>> 2014-03-11 15:00:33.801 | + [[ -n 0 ]]
>>
>> 2014-03-11 15:00:33.802 | + timeout=0
>>
>> 2014-03-11 15:00:33.803 | + timeout -s SIGINT 0 git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC
>>
>> 2014-03-11 15:00:33.804 | Cloning into '/opt/stack/noVNC'...
>>
>> 2014-03-11 15:03:13.694 | error: RPC failed; result=56, HTTP code = 200
>>
>> 2014-03-11 15:03:13.695 | fatal: The remote end hung up unexpectedly
>>
>> 2014-03-11 15:03:13.697 | fatal: early EOF
>>
>> 2014-03-11 15:03:13.698 | fatal: index-pack failed
>>
>> 2014-03-11 15:03:13.699 | + [[ 128 -ne 124 ]]
>>
>> 2014-03-11 15:03:13.700 | + die 596 'git call failed: [git clone' https://github.com/kanaka/noVNC.git '/opt/stack/noVNC]'
>>
>> 2014-03-11 15:03:13.701 | + local exitcode=0
>>
>> 2014-03-11 15:03:13.702 | [Call Trace]
>>
>> 2014-03-11 15:03:13.703 | ./stack.sh:736:install_nova
>>
>> 2014-03-11 15:03:13.705 | /var/lib/jenkins/devstack/lib/nova:618:git_clone
>>
>> 2014-03-11 15:03:13.706 | /var/lib/jenkins/devstack/functions-common:543:git_timed
>>
>> 2014-03-11 15:03:13.707 | /var/lib/jenkins/devstack/functions-common:596:die
>>
>> 2014-03-11 15:03:13.708 | [ERROR] /var/lib/jenkins/devstack/functions-common:596 git call failed: [git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC]
>>
>>
>>
>>
>>
>> Example 2:
>>
>>
>> 2014-03-11 14:12:58.472 | + is_service_enabled n-novnc
>> 2014-03-11 14:12:58.473 | + return 0
>> 2014-03-11 14:12:58.474 | ++ trueorfalse False
>> 2014-03-11 14:12:58.475 | + NOVNC_FROM_PACKAGE=False
>> 2014-03-11 14:12:58.476 | + '[' False = True ']'
>> 2014-03-11 14:12:58.477 | + NOVNC_WEB_DIR=/opt/stack/noVNC
>> 2014-03-11 14:12:58.478 | + git_clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC master
>> 2014-03-11 14:12:58.479 | + GIT_REMOTE= https://github.com/kanaka/noVNC.git
>> 2014-03-11 14:12:58.480 | + GIT_DEST=/opt/stack/noVNC
>> 2014-03-11 14:12:58.481 | + GIT_REF=master
>> 2014-03-11 14:12:58.482 | ++ trueorfalse False False
>> 2014-03-11 14:12:58.483 | + RECLONE=False
>> 2014-03-11 14:12:58.484 | + [[ False = \T\r\u\e ]]
>> 2014-03-11 14:12:58.485 | + echo master
>> 2014-03-11 14:12:58.486 | + egrep -q '^refs'
>> 2014-03-11 14:12:58.487 | + [[ ! -d /opt/stack/noVNC ]]
>> 2014-03-11 14:12:58.488 | + [[ False = \T\r\u\e ]]
>> 2014-03-11 14:12:58.489 | + git_timed clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC
>> 2014-03-11 14:12:58.490 | + local count=0
>> 2014-03-11 14:12:58.491 | + local timeout=0
>> 2014-03-11 14:12:58.492 | + [[ -n 0 ]]
>> 2014-03-11 14:12:58.493 | + timeout=0
>> 2014-03-11 14:12:58.494 | + timeout -s SIGINT 0 git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC
>> 2014-03-11 14:12:58.495 | Cloning into '/opt/stack/noVNC'...
>> 2014-03-11 14:14:02.315 | error: The requested URL returned error: 403 while accessing https://github.com/kanaka/noVNC.git/info/refs
>> 2014-03-11 14:14:02.316 | fatal: HTTP request failed
>> 2014-03-11 14:14:02.317 | + [[ 128 -ne 124 ]]
>> 2014-03-11 14:14:02.318 | + die 596 'git call failed: [git clone' https://github.com/kanaka/noVNC.git '/opt/stack/noVNC]'
>> 2014-03-11 14:14:02.319 | + local exitcode=0
>> 2014-03-11 14:14:02.321 | [Call Trace]
>> 2014-03-11 14:14:02.322 | ./stack.sh:736:install_nova
>> 2014-03-11 14:14:02.323 | /var/lib/jenkins/devstack/lib/nova:618:git_clone
>> 2014-03-11 14:14:02.324 | /var/lib/jenkins/devstack/functions-common:543:git_timed
>> 2014-03-11 14:14:02.326 | /var/lib/jenkins/devstack/functions-common:596:die
>> 2014-03-11 14:14:02.327 | [ERROR] /var/lib/jenkins/devstack/functions-common:596 git call failed: [git clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC]
>>
>>
>>
>>
>> Thanks,
>>
>> Dane
>>
>>
>> _______________________________________________
>> OpenStack-Infra mailing list
>> OpenStack-Infra at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
>>
>>
>> _______________________________________________
>> OpenStack-dev mailing list OpenStack-dev at lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>>
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>
>
>
>
> _______________________________________________
> OpenStack-Infra mailing list
> OpenStack-Infra at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
>




More information about the OpenStack-dev mailing list