Open Stack

On 2014-03-13 09:44, Sean Dague wrote:
> I think a bigger question is why are we using a git version of 
> something
> outside of OpenStack.
> 
> Where is a noNVC release we can point to and use?
> 
> In Juno I'd really be pro removing all the devstack references to git
> repos not on git.openstack.org, because these kinds of failures have
> real impact.
> 
> Currently we have 4 repositories that fit this bill:
> 
> SWIFT3_REPO=${SWIFT3_REPO:-http://github.com/fujita/swift3.git}
> NOVNC_REPO=${NOVNC_REPO:-https://github.com/kanaka/noVNC.git}
> RYU_REPO=${RYU_REPO:-https://github.com/osrg/ryu.git}
> SPICE_REPO=${SPICE_REPO:-http://anongit.freedesktop.org/git/spice/spice-html5.git}
> 
> I think all of these probably need to be removed from devstack. We
> should be using release versions (preferably in distros, though allowed
> to be in language specific package manager).

IIRC, when I looked into using the distro-packaged noVNC it broke all 
kinds of things because for some reason noVNC has a dependency on 
nova-common (now python-nova it looks like), so we end up pulling in all 
kinds of distro nova stuff that conflicts with the devstack installed 
pieces.  It doesn't seem like a correct dep to me, but maybe Solly can 
comment on whether it's necessary or not.

-Ben

> 
> 	-Sean
> 
> On 03/13/2014 10:26 AM, Solly Ross wrote:
>> @bnemec: I don't think that's been considered.  I'm actually one of 
>> the upstream maintainers for noVNC.  The only concern that I'd have 
>> with OpenStack adopting noVNC (there are other maintainers, as well as 
>> the author, so I'd have to check with them as well) is that there are 
>> a few other projects that use noVNC, so we'd need to make sure that no 
>> OpenStack-specific code gets merged into noVNC if we adopt it.  Other 
>> that that, though, adopting noVNC doesn't sound like a horrible idea.
>> 
>> Best Regards,
>> Solly Ross
>> 
>> ----- Original Message -----
>> From: "Ben Nemec" <openstack at nemebean.com>
>> To: "OpenStack Development Mailing List (not for usage questions)" 
>> <openstack-dev at lists.openstack.org>
>> Cc: openstack-infra at lists.openstack.org
>> Sent: Wednesday, March 12, 2014 3:38:19 PM
>> Subject: Re: [openstack-dev] [OpenStack-Infra] Intermittent failures 
>> cloning	noVNC from github.com/kanaka
>> 
>> 
>> 
>> On 2014-03-11 20:34, Joshua Harlow wrote:
>> 
>> 
>> https://status.github.com/messages
>> * 'GitHub.com is operating normally, despite an ongoing DDoS attack. 
>> The mitigations we have in place are proving effective in protecting 
>> us and we're hopeful that we've got this one resolved.'
>> If you were cloning from github.org and not http://git.openstack.org 
>> then you were likely seeing some of the DDoS attack in action.
>> Unfortunately I don't think novnc is in git.openstack.org because it's 
>> not an OpenStack project. I wonder if we should investigate adopting 
>> it (if the author(s) are amenable to that) since we're using the git 
>> version of it. Maybe that's already been considered and I just don't 
>> know about it. :-)
>> -Ben
>> 
>> 
>> 
>> From: Sukhdev Kapur < sukhdevkapur at gmail.com >
>> Reply-To: "OpenStack Development Mailing List (not for usage 
>> questions)" < openstack-dev at lists.openstack.org >
>> Date: Tuesday, March 11, 2014 at 4:08 PM
>> To: "Dane Leblanc (leblancd)" < leblancd at cisco.com >
>> Cc: "OpenStack Development Mailing List (not for usage questions)" < 
>> openstack-dev at lists.openstack.org >, " 
>> openstack-infra at lists.openstack.org " < 
>> openstack-infra at lists.openstack.org >
>> Subject: Re: [openstack-dev] [OpenStack-Infra] Intermittent failures 
>> cloning noVNC from github.com/kanaka
>> 
>> 
>> 
>> I have noticed that even clone of devstack has failed few times within 
>> last couple of hours - it was running fairly smooth so far.
>> -Sukhdev
>> 
>> 
>> On Tue, Mar 11, 2014 at 5:05 PM, Sukhdev Kapur < 
>> sukhdevkapur at gmail.com > wrote:
>> 
>> 
>> 
>> [adding openstack-dev list as well ]
>> I have noticed that this has stated hitting my builds within last few 
>> hours. I have noticed exact same failures on almost 10 builds.
>> Looks like something has happened within last few hours - perhaps the 
>> load?
>> -Sukhdev
>> 
>> 
>> On Tue, Mar 11, 2014 at 4:28 PM, Dane Leblanc (leblancd) < 
>> leblancd at cisco.com > wrote:
>> 
>> 
>> 
>> 
>> 
>> Apologies if this is the wrong audience for this question...
>> 
>> 
>> 
>> I'm seeing intermittent failures running stack.sh whereby 'git clone 
>> https://github.com/kanaka/noVNC.git /opt/stack/noVNC' is returning 
>> various errors. Below are 2 examples.
>> 
>> 
>> 
>> Is this a known issue? Are there any localrc settings which might help 
>> here?
>> 
>> 
>> 
>> Example 1:
>> 
>> 
>> 
>> 2014-03-11 15:00:33.779 | + is_service_enabled n-novnc
>> 
>> 2014-03-11 15:00:33.780 | + return 0
>> 
>> 2014-03-11 15:00:33.781 | ++ trueorfalse False
>> 
>> 2014-03-11 15:00:33.782 | + NOVNC_FROM_PACKAGE=False
>> 
>> 2014-03-11 15:00:33.783 | + '[' False = True ']'
>> 
>> 2014-03-11 15:00:33.784 | + NOVNC_WEB_DIR=/opt/stack/noVNC
>> 
>> 2014-03-11 15:00:33.785 | + git_clone 
>> https://github.com/kanaka/noVNC.git /opt/stack/noVNC master
>> 
>> 2014-03-11 15:00:33.786 | + GIT_REMOTE= 
>> https://github.com/kanaka/noVNC.git
>> 
>> 2014-03-11 15:00:33.788 | + GIT_DEST=/opt/stack/noVNC
>> 
>> 2014-03-11 15:00:33.789 | + GIT_REF=master
>> 
>> 2014-03-11 15:00:33.790 | ++ trueorfalse False False
>> 
>> 2014-03-11 15:00:33.791 | + RECLONE=False
>> 
>> 2014-03-11 15:00:33.792 | + [[ False = \T\r\u\e ]]
>> 
>> 2014-03-11 15:00:33.793 | + echo master
>> 
>> 2014-03-11 15:00:33.794 | + egrep -q '^refs'
>> 
>> 2014-03-11 15:00:33.795 | + [[ ! -d /opt/stack/noVNC ]]
>> 
>> 2014-03-11 15:00:33.796 | + [[ False = \T\r\u\e ]]
>> 
>> 2014-03-11 15:00:33.797 | + git_timed clone 
>> https://github.com/kanaka/noVNC.git /opt/stack/noVNC
>> 
>> 2014-03-11 15:00:33.798 | + local count=0
>> 
>> 2014-03-11 15:00:33.799 | + local timeout=0
>> 
>> 2014-03-11 15:00:33.801 | + [[ -n 0 ]]
>> 
>> 2014-03-11 15:00:33.802 | + timeout=0
>> 
>> 2014-03-11 15:00:33.803 | + timeout -s SIGINT 0 git clone 
>> https://github.com/kanaka/noVNC.git /opt/stack/noVNC
>> 
>> 2014-03-11 15:00:33.804 | Cloning into '/opt/stack/noVNC'...
>> 
>> 2014-03-11 15:03:13.694 | error: RPC failed; result=56, HTTP code = 
>> 200
>> 
>> 2014-03-11 15:03:13.695 | fatal: The remote end hung up unexpectedly
>> 
>> 2014-03-11 15:03:13.697 | fatal: early EOF
>> 
>> 2014-03-11 15:03:13.698 | fatal: index-pack failed
>> 
>> 2014-03-11 15:03:13.699 | + [[ 128 -ne 124 ]]
>> 
>> 2014-03-11 15:03:13.700 | + die 596 'git call failed: [git clone' 
>> https://github.com/kanaka/noVNC.git '/opt/stack/noVNC]'
>> 
>> 2014-03-11 15:03:13.701 | + local exitcode=0
>> 
>> 2014-03-11 15:03:13.702 | [Call Trace]
>> 
>> 2014-03-11 15:03:13.703 | ./stack.sh:736:install_nova
>> 
>> 2014-03-11 15:03:13.705 | 
>> /var/lib/jenkins/devstack/lib/nova:618:git_clone
>> 
>> 2014-03-11 15:03:13.706 | 
>> /var/lib/jenkins/devstack/functions-common:543:git_timed
>> 
>> 2014-03-11 15:03:13.707 | 
>> /var/lib/jenkins/devstack/functions-common:596:die
>> 
>> 2014-03-11 15:03:13.708 | [ERROR] 
>> /var/lib/jenkins/devstack/functions-common:596 git call failed: [git 
>> clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC]
>> 
>> 
>> 
>> 
>> 
>> Example 2:
>> 
>> 
>> 2014-03-11 14:12:58.472 | + is_service_enabled n-novnc
>> 2014-03-11 14:12:58.473 | + return 0
>> 2014-03-11 14:12:58.474 | ++ trueorfalse False
>> 2014-03-11 14:12:58.475 | + NOVNC_FROM_PACKAGE=False
>> 2014-03-11 14:12:58.476 | + '[' False = True ']'
>> 2014-03-11 14:12:58.477 | + NOVNC_WEB_DIR=/opt/stack/noVNC
>> 2014-03-11 14:12:58.478 | + git_clone 
>> https://github.com/kanaka/noVNC.git /opt/stack/noVNC master
>> 2014-03-11 14:12:58.479 | + GIT_REMOTE= 
>> https://github.com/kanaka/noVNC.git
>> 2014-03-11 14:12:58.480 | + GIT_DEST=/opt/stack/noVNC
>> 2014-03-11 14:12:58.481 | + GIT_REF=master
>> 2014-03-11 14:12:58.482 | ++ trueorfalse False False
>> 2014-03-11 14:12:58.483 | + RECLONE=False
>> 2014-03-11 14:12:58.484 | + [[ False = \T\r\u\e ]]
>> 2014-03-11 14:12:58.485 | + echo master
>> 2014-03-11 14:12:58.486 | + egrep -q '^refs'
>> 2014-03-11 14:12:58.487 | + [[ ! -d /opt/stack/noVNC ]]
>> 2014-03-11 14:12:58.488 | + [[ False = \T\r\u\e ]]
>> 2014-03-11 14:12:58.489 | + git_timed clone 
>> https://github.com/kanaka/noVNC.git /opt/stack/noVNC
>> 2014-03-11 14:12:58.490 | + local count=0
>> 2014-03-11 14:12:58.491 | + local timeout=0
>> 2014-03-11 14:12:58.492 | + [[ -n 0 ]]
>> 2014-03-11 14:12:58.493 | + timeout=0
>> 2014-03-11 14:12:58.494 | + timeout -s SIGINT 0 git clone 
>> https://github.com/kanaka/noVNC.git /opt/stack/noVNC
>> 2014-03-11 14:12:58.495 | Cloning into '/opt/stack/noVNC'...
>> 2014-03-11 14:14:02.315 | error: The requested URL returned error: 403 
>> while accessing https://github.com/kanaka/noVNC.git/info/refs
>> 2014-03-11 14:14:02.316 | fatal: HTTP request failed
>> 2014-03-11 14:14:02.317 | + [[ 128 -ne 124 ]]
>> 2014-03-11 14:14:02.318 | + die 596 'git call failed: [git clone' 
>> https://github.com/kanaka/noVNC.git '/opt/stack/noVNC]'
>> 2014-03-11 14:14:02.319 | + local exitcode=0
>> 2014-03-11 14:14:02.321 | [Call Trace]
>> 2014-03-11 14:14:02.322 | ./stack.sh:736:install_nova
>> 2014-03-11 14:14:02.323 | 
>> /var/lib/jenkins/devstack/lib/nova:618:git_clone
>> 2014-03-11 14:14:02.324 | 
>> /var/lib/jenkins/devstack/functions-common:543:git_timed
>> 2014-03-11 14:14:02.326 | 
>> /var/lib/jenkins/devstack/functions-common:596:die
>> 2014-03-11 14:14:02.327 | [ERROR] 
>> /var/lib/jenkins/devstack/functions-common:596 git call failed: [git 
>> clone https://github.com/kanaka/noVNC.git /opt/stack/noVNC]
>> 
>> 
>> 
>> 
>> Thanks,
>> 
>> Dane
>> 
>> 
>> _______________________________________________
>> OpenStack-Infra mailing list
>> OpenStack-Infra at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
>> 
>> 
>> _______________________________________________
>> OpenStack-dev mailing list OpenStack-dev at lists.openstack.org 
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>> 
>> 
>> 
>> 
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>> 
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>