[openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI
Eduard Matei
eduard.matei at cloudfounders.com
Fri Dec 19 11:35:54 UTC 2014
Hi all,
After a little struggle with the config scripts i managed to get a working
setup that is able to process openstack-dev/sandbox and run
noop-check-comunication.
Then, i tried enabling dsvm-tempest-full job but it keeps returning
"NOT_REGISTERED"
2014-12-19 12:07:14,683 INFO zuul.IndependentPipelineManager: Change
<Change 0x7fe5ec029b50 139585,9> depends on changes []
2014-12-19 12:07:14,683 INFO zuul.Gearman: Launch job
noop-check-communication for change <Change 0x7fe5ec029b50 139585,9> with
dependent changes []
2014-12-19 12:07:14,693 INFO zuul.Gearman: Launch job dsvm-tempest-full for
change <Change 0x7fe5ec029b50 139585,9> with dependent changes []
2014-12-19 12:07:14,694 ERROR zuul.Gearman: Job <gear.Job 0x7fe5ec2e2f10
handle: None name: build:dsvm-tempest-full unique:
a9199d304d1140a8bf4448dfb1ae42c1> is not registered with Gearman
2014-12-19 12:07:14,694 INFO zuul.Gearman: Build <gear.Job 0x7fe5ec2e2f10
handle: None name: build:dsvm-tempest-full unique:
a9199d304d1140a8bf4448dfb1ae42c1> complete, result NOT_REGISTERED
2014-12-19 12:07:14,765 INFO zuul.Gearman: Build <gear.Job 0x7fe5ec2e2d10
handle: H:127.0.0.1:2 name: build:noop-check-communication unique:
333c6ea077324a788e3c37a313d872c5> started
2014-12-19 12:07:14,910 INFO zuul.Gearman: Build <gear.Job 0x7fe5ec2e2d10
handle: H:127.0.0.1:2 name: build:noop-check-communication unique:
333c6ea077324a788e3c37a313d872c5> complete, result SUCCESS
2014-12-19 12:07:14,916 INFO zuul.IndependentPipelineManager: Reporting
change <Change 0x7fe5ec029b50 139585,9>, actions: [<ActionReporter
<zuul.reporter.gerrit.Reporter object at 0x2694a10>, {'verified': -1}>]
Nodepoold's log show no reference to dsvm-tempest-full and neither jenkins'
logs.
Any idea how to enable this job?
Also, i got the "Cloud provider" setup and i can access it from the jenkins
master.
Any idea how i can manually trigger dsvm-tempest-full job to run and test
the cloud provider without having to push a review to Gerrit?
Thanks,
Eduard
On Thu, Dec 18, 2014 at 7:52 PM, Eduard Matei <
eduard.matei at cloudfounders.com> wrote:
>
> Thanks for the input.
>
> I managed to get another master working (on Ubuntu 13.10), again with some
> issues since it was already setup.
> I'm now working towards setting up the slave.
>
> Will add comments to those reviews.
>
> Thanks,
> Eduard
>
> On Thu, Dec 18, 2014 at 7:42 PM, Asselin, Ramy <ramy.asselin at hp.com>
> wrote:
>
>> Yes, Ubuntu 12.04 is tested as mentioned in the readme [1]. Note that
>> the referenced script is just a wrapper that pulls all the latest from
>> various locations in openstack-infra, e.g. [2].
>>
>> Ubuntu 14.04 support is WIP [3]
>>
>> FYI, there’s a spec to get an in-tree 3rd party ci solution [4]. Please
>> add your comments if this interests you.
>>
>>
>>
>> [1] https://github.com/rasselin/os-ext-testing/blob/master/README.md
>>
>> [2]
>> https://github.com/rasselin/os-ext-testing/blob/master/puppet/install_master.sh#L29
>>
>> [3] https://review.openstack.org/#/c/141518/
>>
>> [4] https://review.openstack.org/#/c/139745/
>>
>>
>>
>>
>>
>> *From:* Punith S [mailto:punith.s at cloudbyte.com]
>> *Sent:* Thursday, December 18, 2014 3:12 AM
>> *To:* OpenStack Development Mailing List (not for usage questions);
>> Eduard Matei
>>
>> *Subject:* Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need
>> help setting up CI
>>
>>
>>
>> Hi Eduard
>>
>>
>>
>> we tried running
>> https://raw.githubusercontent.com/rasselin/os-ext-testing/master/puppet/install_master.sh
>>
>> on ubuntu master 12.04, and it appears to be working fine on 12.04.
>>
>>
>>
>> thanks
>>
>>
>>
>> On Thu, Dec 18, 2014 at 1:57 PM, Eduard Matei <
>> eduard.matei at cloudfounders.com> wrote:
>>
>> Hi,
>>
>> Seems i can't install using puppet on the jenkins master using
>> install_master.sh from
>> https://raw.githubusercontent.com/rasselin/os-ext-testing/master/puppet/install_master.sh
>> because it's running Ubuntu 11.10 and it appears unsupported.
>>
>> I managed to install puppet manually on master and everything else fails
>>
>> So i'm trying to manually install zuul and nodepool and jenkins job
>> builder, see where i end up.
>>
>>
>>
>> The slave looks complete, got some errors on running install_slave so i
>> ran parts of the script manually, changing some params and it appears
>> installed but no way to test it without the master.
>>
>>
>>
>> Any ideas welcome.
>>
>>
>>
>> Thanks,
>>
>>
>>
>> Eduard
>>
>>
>>
>> On Wed, Dec 17, 2014 at 3:37 AM, Asselin, Ramy <ramy.asselin at hp.com>
>> wrote:
>>
>> Manually running the script requires a few environment settings. Take
>> a look at the README here:
>>
>> https://github.com/openstack-infra/devstack-gate
>>
>>
>>
>> Regarding cinder, I’m using this repo to run our cinder jobs (fork from
>> jaypipes).
>>
>> https://github.com/rasselin/os-ext-testing
>>
>>
>>
>> Note that this solution doesn’t use the Jenkins gerrit trigger pluggin,
>> but zuul.
>>
>>
>>
>> There’s a sample job for cinder here. It’s in Jenkins Job Builder format.
>>
>>
>> https://github.com/rasselin/os-ext-testing-data/blob/master/etc/jenkins_jobs/config/dsvm-cinder-driver.yaml.sample
>>
>>
>>
>> You can ask more questions in IRC freenode #openstack-cinder. (irc#
>> asselin)
>>
>>
>>
>> Ramy
>>
>>
>>
>> *From:* Eduard Matei [mailto:eduard.matei at cloudfounders.com]
>> *Sent:* Tuesday, December 16, 2014 12:41 AM
>> *To:* Bailey, Darragh
>> *Cc:* OpenStack Development Mailing List (not for usage questions);
>> OpenStack
>> *Subject:* Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need
>> help setting up CI
>>
>>
>>
>> Hi,
>>
>>
>>
>> Can someone point me to some working documentation on how to setup third
>> party CI? (joinfu's instructions don't seem to work, and manually running
>> devstack-gate scripts fails:
>>
>> Running gate_hook
>>
>> Job timeout set to: 163 minutes
>>
>> timeout: failed to run command ‘/opt/stack/new/devstack-gate/devstack-vm-gate.sh’: No such file or directory
>>
>> ERROR: the main setup script run by this job failed - exit code: 127
>>
>> please look at the relevant log files to determine the root cause
>>
>> Cleaning up host
>>
>> ... this takes 3 - 4 minutes (logs at logs/devstack-gate-cleanup-host.txt.gz)
>>
>> Build step 'Execute shell' marked build as failure.
>>
>>
>>
>> I have a working Jenkins slave with devstack and our internal libraries,
>> i have Gerrit Trigger Plugin working and triggering on patches created, i
>> just need the actual job contents so that it can get to comment with the
>> test results.
>>
>>
>>
>> Thanks,
>>
>>
>>
>> Eduard
>>
>>
>>
>> On Tue, Dec 9, 2014 at 1:59 PM, Eduard Matei <
>> eduard.matei at cloudfounders.com> wrote:
>>
>> Hi Darragh, thanks for your input
>>
>>
>>
>> I double checked the job settings and fixed it:
>>
>> - build triggers is set to Gerrit event
>>
>> - Gerrit trigger server is "Gerrit" (configured from Gerrit Trigger
>> Plugin and tested separately)
>>
>> - Trigger on: Patchset Created
>>
>> - Gerrit Project: Type: Path, Pattern openstack-dev/sandbox, Branches:
>> Type: Path, Pattern: ** (was Type Plain on both)
>>
>> Now the job is triggered by commit on openstack-dev/sandbox :)
>>
>>
>>
>> Regarding the Query and Trigger Gerrit Patches, i found my patch using
>> query: status:open project:openstack-dev/sandbox change:139585 and i can
>> trigger it manually and it executes the job.
>>
>>
>>
>> But i still have the problem: what should the job do? It doesn't actually
>> do anything, it doesn't run tests or comment on the patch.
>>
>> Do you have an example of job?
>>
>>
>>
>> Thanks,
>>
>> Eduard
>>
>>
>>
>> On Tue, Dec 9, 2014 at 1:13 PM, Bailey, Darragh <dbailey at hp.com> wrote:
>>
>> Hi Eduard,
>>
>>
>> I would check the trigger settings in the job, particularly which "type"
>> of pattern matching is being used for the branches. Found it tends to be
>> the spot that catches most people out when configuring jobs with the
>> Gerrit Trigger plugin. If you're looking to trigger against all branches
>> then you would want "Type: Path" and "Pattern: **" appearing in the UI.
>>
>> If you have sufficient access using the 'Query and Trigger Gerrit
>> Patches' page accessible from the main view will make it easier to
>> confirm that your Jenkins instance can actually see changes in gerrit
>> for the given project (which should mean that it can see the
>> corresponding events as well). Can also use the same page to re-trigger
>> for PatchsetCreated events to see if you've set the patterns on the job
>> correctly.
>>
>> Regards,
>> Darragh Bailey
>>
>> "Nothing is foolproof to a sufficiently talented fool" - Unknown
>>
>> On 08/12/14 14:33, Eduard Matei wrote:
>> > Resending this to dev ML as it seems i get quicker response :)
>> >
>> > I created a job in Jenkins, added as Build Trigger: "Gerrit Event:
>> > Patchset Created", chose as server the configured Gerrit server that
>> > was previously tested, then added the project openstack-dev/sandbox
>> > and saved.
>> > I made a change on dev sandbox repo but couldn't trigger my job.
>> >
>> > Any ideas?
>> >
>> > Thanks,
>> > Eduard
>> >
>> > On Fri, Dec 5, 2014 at 10:32 AM, Eduard Matei
>> > <eduard.matei at cloudfounders.com
>> > <mailto:eduard.matei at cloudfounders.com>> wrote:
>> >
>> > Hello everyone,
>> >
>> > Thanks to the latest changes to the creation of service accounts
>> > process we're one step closer to setting up our own CI platform
>> > for Cinder.
>> >
>> > So far we've got:
>> > - Jenkins master (with Gerrit plugin) and slave (with DevStack and
>> > our storage solution)
>> > - Service account configured and tested (can manually connect to
>> > review.openstack.org <http://review.openstack.org> and get events
>> > and publish comments)
>> >
>> > Next step would be to set up a job to do the actual testing, this
>> > is where we're stuck.
>> > Can someone please point us to a clear example on how a job should
>> > look like (preferably for testing Cinder on Kilo)? Most links
>> > we've found are broken, or tools/scripts are no longer working.
>> > Also, we cannot change the Jenkins master too much (it's owned by
>> > Ops team and they need a list of tools/scripts to review before
>> > installing/running so we're not allowed to experiment).
>> >
>> > Thanks,
>> > Eduard
>> >
>> > --
>> >
>> > *Eduard Biceri Matei, Senior Software Developer*
>> > www.cloudfounders.com
>> > <http://www.cloudfounders.com/> | eduard.matei at cloudfounders.com
>> > <mailto:eduard.matei at cloudfounders.com>
>> >
>> >
>> >
>> > *CloudFounders, The Private Cloud Software Company*
>> >
>> > Disclaimer:
>> > This email and any files transmitted with it are confidential and
>> > intended solely for the use of the individual or entity to whom
>> > they are addressed.If you are not the named addressee or an
>> > employee or agent responsible for delivering this message to the
>> > named addressee, you are hereby notified that you are not
>> > authorized to read, print, retain, copy or disseminate this
>> > message or any part of it. If you have received this email in
>> > error we request you to notify us by reply e-mail and to delete
>> > all electronic files of the message. If you are not the intended
>> > recipient you are notified that disclosing, copying, distributing
>> > or taking any action in reliance on the contents of this
>> > information is strictly prohibited. E-mail transmission cannot be
>> > guaranteed to be secure or error free as information could be
>> > intercepted, corrupted, lost, destroyed, arrive late or
>> > incomplete, or contain viruses. The sender therefore does not
>> > accept liability for any errors or omissions in the content of
>> > this message, and shall have no liability for any loss or damage
>> > suffered by the user, which arise as a result of e-mail
>> transmission.
>> >
>> >
>> >
>> >
>> > --
>> > *Eduard Biceri Matei, Senior Software Developer*
>> > www.cloudfounders.com
>> > <http://www.cloudfounders.com/> | eduard.matei at cloudfounders.com
>> > <mailto:eduard.matei at cloudfounders.com>
>> >
>> >
>> >
>> > *CloudFounders, The Private Cloud Software Company*
>> >
>> > Disclaimer:
>> > This email and any files transmitted with it are confidential and
>> > intended solely for the use of the individual or entity to whom they
>> > are addressed.If you are not the named addressee or an employee or
>> > agent responsible for delivering this message to the named addressee,
>> > you are hereby notified that you are not authorized to read, print,
>> > retain, copy or disseminate this message or any part of it. If you
>> > have received this email in error we request you to notify us by reply
>> > e-mail and to delete all electronic files of the message. If you are
>> > not the intended recipient you are notified that disclosing, copying,
>> > distributing or taking any action in reliance on the contents of this
>> > information is strictly prohibited. E-mail transmission cannot be
>> > guaranteed to be secure or error free as information could be
>> > intercepted, corrupted, lost, destroyed, arrive late or incomplete, or
>> > contain viruses. The sender therefore does not accept liability for
>> > any errors or omissions in the content of this message, and shall have
>> > no liability for any loss or damage suffered by the user, which arise
>> > as a result of e-mail transmission.
>> >
>> >
>>
>> > _______________________________________________
>> > OpenStack-Infra mailing list
>> > OpenStack-Infra at lists.openstack.org
>> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
>>
>>
>>
>>
>>
>> --
>>
>> *Eduard Biceri Matei, Senior Software Developer*
>>
>> www.cloudfounders.com
>>
>> | eduard.matei at cloudfounders.com
>>
>>
>>
>>
>>
>>
>>
>> *CloudFounders, The Private Cloud Software Company*
>>
>>
>>
>> Disclaimer:
>>
>> This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
>> If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
>> E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
>>
>>
>>
>>
>>
>> --
>>
>> *Eduard Biceri Matei, Senior Software Developer*
>>
>> www.cloudfounders.com
>>
>> | eduard.matei at cloudfounders.com
>>
>>
>>
>>
>>
>>
>>
>> *CloudFounders, The Private Cloud Software Company*
>>
>>
>>
>> Disclaimer:
>>
>> This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
>> If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
>> E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
>>
>>
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>>
>>
>>
>> --
>>
>> *Eduard Biceri Matei, Senior Software Developer*
>>
>> www.cloudfounders.com
>>
>> | eduard.matei at cloudfounders.com
>>
>>
>>
>>
>>
>>
>>
>> *CloudFounders, The Private Cloud Software Company*
>>
>>
>>
>> Disclaimer:
>>
>> This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
>> If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
>> E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
>>
>>
>> _______________________________________________
>> OpenStack-dev mailing list
>> OpenStack-dev at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>>
>>
>>
>> --
>>
>> regards,
>>
>>
>>
>> punith s
>>
>> cloudbyte.com
>>
>
>
>
> --
>
> *Eduard Biceri Matei, Senior Software Developer*
> www.cloudfounders.com
> | eduard.matei at cloudfounders.com
>
>
>
> *CloudFounders, The Private Cloud Software Company*
>
> Disclaimer:
> This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
> If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
> E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
>
>
--
*Eduard Biceri Matei, Senior Software Developer*
www.cloudfounders.com
| eduard.matei at cloudfounders.com
*CloudFounders, The Private Cloud Software Company*
Disclaimer:
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed.
If you are not the named addressee or an employee or agent responsible
for delivering this message to the named addressee, you are hereby
notified that you are not authorized to read, print, retain, copy or
disseminate this message or any part of it. If you have received this
email in error we request you to notify us by reply e-mail and to
delete all electronic files of the message. If you are not the
intended recipient you are notified that disclosing, copying,
distributing or taking any action in reliance on the contents of this
information is strictly prohibited.
E-mail transmission cannot be guaranteed to be secure or error free as
information could be intercepted, corrupted, lost, destroyed, arrive
late or incomplete, or contain viruses. The sender therefore does not
accept liability for any errors or omissions in the content of this
message, and shall have no liability for any loss or damage suffered
by the user, which arise as a result of e-mail transmission.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20141219/ce7859ab/attachment.html>
More information about the OpenStack-dev
mailing list