[openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI
Asselin, Ramy
ramy.asselin at hp.com
Tue Dec 23 15:16:34 UTC 2014
You should use 14.04 for the slave. The limitation for using 12.04 is only for the master since zuul’s apache configuration is WIP on 14.04 [1], and zuul does not run on the slave.
Ramy
[1] https://review.openstack.org/#/c/141518/
From: Punith S [mailto:punith.s at cloudbyte.com]
Sent: Monday, December 22, 2014 11:37 PM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI
Hi Asselin,
i'm following your readme https://github.com/rasselin/os-ext-testing
for setting up our cloudbyte CI on two ubuntu 12.04 VM's(master and slave)
currently the scripts and setup went fine as followed with the document.
now both master and slave have been connected successfully, but in order to run the tempest integration test against our proposed cloudbyte cinder driver for kilo, we need to have devstack installed in the slave.(in my understanding)
but on installing the master devstack i'm getting permission issues in 12.04 in executing ./stack.sh since master devstack suggests the 14.04 or 13.10 ubuntu. and on contrary running install_slave.sh is failing on 13.10 due to puppet modules on found error.
is there a way to get this work ?
thanks in advance
On Mon, Dec 22, 2014 at 11:10 PM, Asselin, Ramy <ramy.asselin at hp.com<mailto:ramy.asselin at hp.com>> wrote:
Eduard,
A few items you can try:
1. Double-check that the job is in Jenkins
a. If not, then that’s the issue
2. Check that the processes are running correctly
a. ps -ef | grep zuul
i. Should have 2 zuul-server & 1 zuul-merger
b. ps -ef | grep Jenkins
i. Should have 1 /usr/bin/daemon --name=jenkins & 1 /usr/bin/java
3. In Jenkins, Manage Jenkins, Gearman Plugin Config, “Test Connection”
4. Stop and Zuul & Jenkins. Start Zuul & Jenkins
a. service Jenkins stop
b. service zuul stop
c. service zuul-merger stop
d. service Jenkins start
e. service zuul start
f. service zuul-merger start
Otherwise, I suggest you ask in #openstack-infra irc channel.
Ramy
From: Eduard Matei [mailto:eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>]
Sent: Sunday, December 21, 2014 11:01 PM
To: Asselin, Ramy
Cc: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI
Thanks Ramy,
Unfortunately i don't see dsvm-tempest-full in the "status" output.
Any idea how i can get it "registered"?
Thanks,
Eduard
On Fri, Dec 19, 2014 at 9:43 PM, Asselin, Ramy <ramy.asselin at hp.com<mailto:ramy.asselin at hp.com>> wrote:
Eduard,
If you run this command, you can see which jobs are registered:
>telnet localhost 4730
>status
There are 3 numbers per job: queued, running and workers that can run job. Make sure the job is listed & last ‘workers’ is non-zero.
To run the job again without submitting a patch set, leave a “recheck” comment on the patch & make sure your zuul layout.yaml is configured to trigger off that comment. For example [1].
Be sure to use the sandbox repository. [2]
I’m not aware of other ways.
Ramy
[1] https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L20
[2] https://github.com/openstack-dev/sandbox
From: Eduard Matei [mailto:eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>]
Sent: Friday, December 19, 2014 3:36 AM
To: Asselin, Ramy
Cc: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI
Hi all,
After a little struggle with the config scripts i managed to get a working setup that is able to process openstack-dev/sandbox and run noop-check-comunication.
Then, i tried enabling dsvm-tempest-full job but it keeps returning "NOT_REGISTERED"
2014-12-19 12:07:14,683 INFO zuul.IndependentPipelineManager: Change <Change 0x7fe5ec029b50 139585,9> depends on changes []
2014-12-19 12:07:14,683 INFO zuul.Gearman: Launch job noop-check-communication for change <Change 0x7fe5ec029b50 139585,9> with dependent changes []
2014-12-19 12:07:14,693 INFO zuul.Gearman: Launch job dsvm-tempest-full for change <Change 0x7fe5ec029b50 139585,9> with dependent changes []
2014-12-19 12:07:14,694 ERROR zuul.Gearman: Job <gear.Job 0x7fe5ec2e2f10 handle: None name: build:dsvm-tempest-full unique: a9199d304d1140a8bf4448dfb1ae42c1> is not registered with Gearman
2014-12-19 12:07:14,694 INFO zuul.Gearman: Build <gear.Job 0x7fe5ec2e2f10 handle: None name: build:dsvm-tempest-full unique: a9199d304d1140a8bf4448dfb1ae42c1> complete, result NOT_REGISTERED
2014-12-19 12:07:14,765 INFO zuul.Gearman: Build <gear.Job 0x7fe5ec2e2d10 handle: H:127.0.0.1:2<http://127.0.0.1:2> name: build:noop-check-communication unique: 333c6ea077324a788e3c37a313d872c5> started
2014-12-19 12:07:14,910 INFO zuul.Gearman: Build <gear.Job 0x7fe5ec2e2d10 handle: H:127.0.0.1:2<http://127.0.0.1:2> name: build:noop-check-communication unique: 333c6ea077324a788e3c37a313d872c5> complete, result SUCCESS
2014-12-19 12:07:14,916 INFO zuul.IndependentPipelineManager: Reporting change <Change 0x7fe5ec029b50 139585,9>, actions: [<ActionReporter <zuul.reporter.gerrit.Reporter object at 0x2694a10>, {'verified': -1}>]
Nodepoold's log show no reference to dsvm-tempest-full and neither jenkins' logs.
Any idea how to enable this job?
Also, i got the "Cloud provider" setup and i can access it from the jenkins master.
Any idea how i can manually trigger dsvm-tempest-full job to run and test the cloud provider without having to push a review to Gerrit?
Thanks,
Eduard
On Thu, Dec 18, 2014 at 7:52 PM, Eduard Matei <eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>> wrote:
Thanks for the input.
I managed to get another master working (on Ubuntu 13.10), again with some issues since it was already setup.
I'm now working towards setting up the slave.
Will add comments to those reviews.
Thanks,
Eduard
On Thu, Dec 18, 2014 at 7:42 PM, Asselin, Ramy <ramy.asselin at hp.com<mailto:ramy.asselin at hp.com>> wrote:
Yes, Ubuntu 12.04 is tested as mentioned in the readme [1]. Note that the referenced script is just a wrapper that pulls all the latest from various locations in openstack-infra, e.g. [2].
Ubuntu 14.04 support is WIP [3]
FYI, there’s a spec to get an in-tree 3rd party ci solution [4]. Please add your comments if this interests you.
[1] https://github.com/rasselin/os-ext-testing/blob/master/README.md
[2] https://github.com/rasselin/os-ext-testing/blob/master/puppet/install_master.sh#L29
[3] https://review.openstack.org/#/c/141518/
[4] https://review.openstack.org/#/c/139745/
From: Punith S [mailto:punith.s at cloudbyte.com<mailto:punith.s at cloudbyte.com>]
Sent: Thursday, December 18, 2014 3:12 AM
To: OpenStack Development Mailing List (not for usage questions); Eduard Matei
Subject: Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI
Hi Eduard
we tried running https://raw.githubusercontent.com/rasselin/os-ext-testing/master/puppet/install_master.sh
on ubuntu master 12.04, and it appears to be working fine on 12.04.
thanks
On Thu, Dec 18, 2014 at 1:57 PM, Eduard Matei <eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>> wrote:
Hi,
Seems i can't install using puppet on the jenkins master using install_master.sh from https://raw.githubusercontent.com/rasselin/os-ext-testing/master/puppet/install_master.sh because it's running Ubuntu 11.10 and it appears unsupported.
I managed to install puppet manually on master and everything else fails
So i'm trying to manually install zuul and nodepool and jenkins job builder, see where i end up.
The slave looks complete, got some errors on running install_slave so i ran parts of the script manually, changing some params and it appears installed but no way to test it without the master.
Any ideas welcome.
Thanks,
Eduard
On Wed, Dec 17, 2014 at 3:37 AM, Asselin, Ramy <ramy.asselin at hp.com<mailto:ramy.asselin at hp.com>> wrote:
Manually running the script requires a few environment settings. Take a look at the README here:
https://github.com/openstack-infra/devstack-gate
Regarding cinder, I’m using this repo to run our cinder jobs (fork from jaypipes).
https://github.com/rasselin/os-ext-testing
Note that this solution doesn’t use the Jenkins gerrit trigger pluggin, but zuul.
There’s a sample job for cinder here. It’s in Jenkins Job Builder format.
https://github.com/rasselin/os-ext-testing-data/blob/master/etc/jenkins_jobs/config/dsvm-cinder-driver.yaml.sample
You can ask more questions in IRC freenode #openstack-cinder. (irc# asselin)
Ramy
From: Eduard Matei [mailto:eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>]
Sent: Tuesday, December 16, 2014 12:41 AM
To: Bailey, Darragh
Cc: OpenStack Development Mailing List (not for usage questions); OpenStack
Subject: Re: [openstack-dev] [OpenStack-Infra] [ThirdPartyCI] Need help setting up CI
Hi,
Can someone point me to some working documentation on how to setup third party CI? (joinfu's instructions don't seem to work, and manually running devstack-gate scripts fails:
Running gate_hook
Job timeout set to: 163 minutes
timeout: failed to run command ‘/opt/stack/new/devstack-gate/devstack-vm-gate.sh’: No such file or directory
ERROR: the main setup script run by this job failed - exit code: 127
please look at the relevant log files to determine the root cause
Cleaning up host
... this takes 3 - 4 minutes (logs at logs/devstack-gate-cleanup-host.txt.gz)
Build step 'Execute shell' marked build as failure.
I have a working Jenkins slave with devstack and our internal libraries, i have Gerrit Trigger Plugin working and triggering on patches created, i just need the actual job contents so that it can get to comment with the test results.
Thanks,
Eduard
On Tue, Dec 9, 2014 at 1:59 PM, Eduard Matei <eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>> wrote:
Hi Darragh, thanks for your input
I double checked the job settings and fixed it:
- build triggers is set to Gerrit event
- Gerrit trigger server is "Gerrit" (configured from Gerrit Trigger Plugin and tested separately)
- Trigger on: Patchset Created
- Gerrit Project: Type: Path, Pattern openstack-dev/sandbox, Branches: Type: Path, Pattern: ** (was Type Plain on both)
Now the job is triggered by commit on openstack-dev/sandbox :)
Regarding the Query and Trigger Gerrit Patches, i found my patch using query: status:open project:openstack-dev/sandbox change:139585 and i can trigger it manually and it executes the job.
But i still have the problem: what should the job do? It doesn't actually do anything, it doesn't run tests or comment on the patch.
Do you have an example of job?
Thanks,
Eduard
On Tue, Dec 9, 2014 at 1:13 PM, Bailey, Darragh <dbailey at hp.com<mailto:dbailey at hp.com>> wrote:
Hi Eduard,
I would check the trigger settings in the job, particularly which "type"
of pattern matching is being used for the branches. Found it tends to be
the spot that catches most people out when configuring jobs with the
Gerrit Trigger plugin. If you're looking to trigger against all branches
then you would want "Type: Path" and "Pattern: **" appearing in the UI.
If you have sufficient access using the 'Query and Trigger Gerrit
Patches' page accessible from the main view will make it easier to
confirm that your Jenkins instance can actually see changes in gerrit
for the given project (which should mean that it can see the
corresponding events as well). Can also use the same page to re-trigger
for PatchsetCreated events to see if you've set the patterns on the job
correctly.
Regards,
Darragh Bailey
"Nothing is foolproof to a sufficiently talented fool" - Unknown
On 08/12/14 14:33, Eduard Matei wrote:
> Resending this to dev ML as it seems i get quicker response :)
>
> I created a job in Jenkins, added as Build Trigger: "Gerrit Event:
> Patchset Created", chose as server the configured Gerrit server that
> was previously tested, then added the project openstack-dev/sandbox
> and saved.
> I made a change on dev sandbox repo but couldn't trigger my job.
>
> Any ideas?
>
> Thanks,
> Eduard
>
> On Fri, Dec 5, 2014 at 10:32 AM, Eduard Matei
> <eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>
> <mailto:eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>>> wrote:
>
> Hello everyone,
>
> Thanks to the latest changes to the creation of service accounts
> process we're one step closer to setting up our own CI platform
> for Cinder.
>
> So far we've got:
> - Jenkins master (with Gerrit plugin) and slave (with DevStack and
> our storage solution)
> - Service account configured and tested (can manually connect to
> review.openstack.org<http://review.openstack.org> <http://review.openstack.org> and get events
> and publish comments)
>
> Next step would be to set up a job to do the actual testing, this
> is where we're stuck.
> Can someone please point us to a clear example on how a job should
> look like (preferably for testing Cinder on Kilo)? Most links
> we've found are broken, or tools/scripts are no longer working.
> Also, we cannot change the Jenkins master too much (it's owned by
> Ops team and they need a list of tools/scripts to review before
> installing/running so we're not allowed to experiment).
>
> Thanks,
> Eduard
>
> --
>
> *Eduard Biceri Matei, Senior Software Developer*
> www.cloudfounders.com<http://www.cloudfounders.com>
> <http://www.cloudfounders.com/> | eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>
> <mailto:eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>>
>
>
>
> *CloudFounders, The Private Cloud Software Company*
>
> Disclaimer:
> This email and any files transmitted with it are confidential and
> intended solely for the use of the individual or entity to whom
> they are addressed.If you are not the named addressee or an
> employee or agent responsible for delivering this message to the
> named addressee, you are hereby notified that you are not
> authorized to read, print, retain, copy or disseminate this
> message or any part of it. If you have received this email in
> error we request you to notify us by reply e-mail and to delete
> all electronic files of the message. If you are not the intended
> recipient you are notified that disclosing, copying, distributing
> or taking any action in reliance on the contents of this
> information is strictly prohibited. E-mail transmission cannot be
> guaranteed to be secure or error free as information could be
> intercepted, corrupted, lost, destroyed, arrive late or
> incomplete, or contain viruses. The sender therefore does not
> accept liability for any errors or omissions in the content of
> this message, and shall have no liability for any loss or damage
> suffered by the user, which arise as a result of e-mail transmission.
>
>
>
>
> --
> *Eduard Biceri Matei, Senior Software Developer*
> www.cloudfounders.com<http://www.cloudfounders.com>
> <http://www.cloudfounders.com/> | eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>
> <mailto:eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>>
>
>
>
> *CloudFounders, The Private Cloud Software Company*
>
> Disclaimer:
> This email and any files transmitted with it are confidential and
> intended solely for the use of the individual or entity to whom they
> are addressed.If you are not the named addressee or an employee or
> agent responsible for delivering this message to the named addressee,
> you are hereby notified that you are not authorized to read, print,
> retain, copy or disseminate this message or any part of it. If you
> have received this email in error we request you to notify us by reply
> e-mail and to delete all electronic files of the message. If you are
> not the intended recipient you are notified that disclosing, copying,
> distributing or taking any action in reliance on the contents of this
> information is strictly prohibited. E-mail transmission cannot be
> guaranteed to be secure or error free as information could be
> intercepted, corrupted, lost, destroyed, arrive late or incomplete, or
> contain viruses. The sender therefore does not accept liability for
> any errors or omissions in the content of this message, and shall have
> no liability for any loss or damage suffered by the user, which arise
> as a result of e-mail transmission.
>
>
> _______________________________________________
> OpenStack-Infra mailing list
> OpenStack-Infra at lists.openstack.org<mailto:OpenStack-Infra at lists.openstack.org>
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
--
Eduard Biceri Matei, Senior Software Developer
www.cloudfounders.com<http://www.cloudfounders.com/>
| eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>
CloudFounders, The Private Cloud Software Company
Disclaimer:
This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
--
Eduard Biceri Matei, Senior Software Developer
www.cloudfounders.com<http://www.cloudfounders.com/>
| eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>
CloudFounders, The Private Cloud Software Company
Disclaimer:
This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
_______________________________________________
OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org<mailto:OpenStack-dev at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
--
Eduard Biceri Matei, Senior Software Developer
www.cloudfounders.com<http://www.cloudfounders.com/>
| eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>
CloudFounders, The Private Cloud Software Company
Disclaimer:
This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
_______________________________________________
OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org<mailto:OpenStack-dev at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
--
regards,
punith s
cloudbyte.com<http://cloudbyte.com>
--
Eduard Biceri Matei, Senior Software Developer
www.cloudfounders.com<http://www.cloudfounders.com/>
| eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>
CloudFounders, The Private Cloud Software Company
Disclaimer:
This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
--
Eduard Biceri Matei, Senior Software Developer
www.cloudfounders.com<http://www.cloudfounders.com/>
| eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>
CloudFounders, The Private Cloud Software Company
Disclaimer:
This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
--
Eduard Biceri Matei, Senior Software Developer
www.cloudfounders.com<http://www.cloudfounders.com/>
| eduard.matei at cloudfounders.com<mailto:eduard.matei at cloudfounders.com>
CloudFounders, The Private Cloud Software Company
Disclaimer:
This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed.
If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you have received this email in error we request you to notify us by reply e-mail and to delete all electronic files of the message. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.
E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the content of this message, and shall have no liability for any loss or damage suffered by the user, which arise as a result of e-mail transmission.
_______________________________________________
OpenStack-dev mailing list
OpenStack-dev at lists.openstack.org<mailto:OpenStack-dev at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
--
regards,
punith s
cloudbyte.com<http://cloudbyte.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20141223/80d99fcc/attachment-0001.html>
More information about the OpenStack-dev
mailing list