<div dir="ltr"><div>Hello Tang, Openstack slaves only have a single executor so what you are probably seeing is due to using build slaves that have multiple executors. There were a few bugs[1] that was fixed recently around these types of deadlock issues. The new gearman-plugin release[2] contains fixes for those issues. Also if you want to test the gearman-plugin with Jenkins independently of zuul you can use the simple gearman-plugin-client[3] to send jobs your gearman server to see if the jobs get built.</div><div><div><br></div><div>[1] <a href="https://issues.jenkins-ci.org/browse/JENKINS-28891">https://issues.jenkins-ci.org/browse/JENKINS-28891</a> and <a href="https://issues.jenkins-ci.org/browse/JENKINS-25867">https://issues.jenkins-ci.org/browse/JENKINS-25867</a></div><div>[2] <a href="http://repo.jenkins-ci.org/repo/org/jenkins-ci/plugins/gearman-plugin/0.1.2/">http://repo.jenkins-ci.org/repo/org/jenkins-ci/plugins/gearman-plugin/0.1.2/</a></div><div>[3] <a href="https://github.com/zaro0508/gearman-plugin-client">https://github.com/zaro0508/gearman-plugin-client</a><br><div class="gmail_extra"><br></div><div class="gmail_extra">-Khai</div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jul 23, 2015 at 9:13 PM, Tang Chen <span dir="ltr"><<a href="mailto:tangchen@cn.fujitsu.com" target="_blank">tangchen@cn.fujitsu.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class=""><br>
On 07/24/2015 12:00 PM, Tang Chen wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
On 07/24/2015 10:08 AM, Tang Chen wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
On 07/23/2015 11:44 PM, Asselin, Ramy wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Are you running on 'master' nodes? I remember seeing an issue where with a recent version of Jenkins or a plugin where it doesn't execute jobs on the master node.<br>
But when run on non-master jenkins slaves, it works fine.<br>
</blockquote>
<br>
I checked my configuration, and made sure these things:<br>
1. I have only a master node, no slave node.<br>
2. I have 20 idle executors on master node.<br>
3. My master node is online.<br>
4. My master node is set to "Utilize this node as much as possible".<br>
5. zuul is able to be notified by Gerrit, and tell Jenkins to start jobs.<br>
<br>
But the jobs are always pending.<br>
</blockquote>
<br>
And my Gearman reports this error sometimes.<br>
<br>
2015-07-25 10:50:44,914 ERROR gear.Server: Exception in poll loop:<br>
Traceback (most recent call last):<br>
File "/usr/local/lib/python2.7/dist-packages/gear/__init__.py", line 2614, in _doPollLoop<br>
self._pollLoop()<br>
File "/usr/local/lib/python2.7/dist-packages/gear/__init__.py", line 2626, in _pollLoop<br>
ret = self.poll.poll()<br>
IOError: [Errno 4] Interrupted system call<br>
<br>
Not sure if it has anything to do with this problem.<br>
<br>
In Jenkins GUI, Gearman connection is tested successfully on <a href="http://127.0.0.1:4730" rel="noreferrer" target="_blank">127.0.0.1:4730</a>.<br>
</blockquote>
<br></span>
Seeing from zuul debug log, Gearman has successfully submitted the jobs.<br>
<br>
2015-07-25 11:42:09,255 DEBUG zuul.Scheduler: Adding trigger event: <TriggerEvent patchset-created openstack-dev/sandbox master 205360,1><br>
2015-07-25 11:42:09,256 DEBUG zuul.Scheduler: Done adding trigger event: <TriggerEvent patchset-created openstack-dev/sandbox master 205360,1><br>
2015-07-25 11:42:09,256 DEBUG zuul.Scheduler: Run handler awake<br>
2015-07-25 11:42:09,256 DEBUG zuul.Scheduler: Fetching trigger event<br>
2015-07-25 11:42:09,256 DEBUG zuul.Scheduler: Processing trigger event <TriggerEvent patchset-created openstack-dev/sandbox master 205360,1><br>
2015-07-25 11:42:09,257 DEBUG zuul.IndependentPipelineManager: Event <TriggerEvent patchset-created openstack-dev/sandbox master 205360,1> for change <Change 0x7ff518312c10 205360,1> matched <EventFilter types: patchset-created> in pipeline <IndependentPipelineManager check><br>
2015-07-25 11:42:09,257 INFO zuul.Scheduler: Adding openstack-dev/sandbox, <Change 0x7ff518312c10 205360,1> to <Pipeline check><br>
2015-07-25 11:42:09,257 DEBUG zuul.IndependentPipelineManager: Considering adding change <Change 0x7ff518312c10 205360,1><br>
2015-07-25 11:42:09,257 DEBUG zuul.IndependentPipelineManager: Checking for changes needed by <Change 0x7ff518312c10 205360,1>:<br>
2015-07-25 11:42:09,257 DEBUG zuul.IndependentPipelineManager: No changes needed<br>
2015-07-25 11:42:09,257 DEBUG zuul.IndependentPipelineManager: Adding change <Change 0x7ff518312c10 205360,1> to queue <ChangeQueue check: openstack-dev/sandbox><br>
2015-07-25 11:42:09,258 DEBUG zuul.IndependentPipelineManager: Event <TriggerEvent patchset-created openstack-dev/sandbox master 205360,1> for change <Change 0x7ff518312c10 205360,1> matched <EventFilter types: patchset-created> in pipeline <IndependentPipelineManager silent><br>
2015-07-25 11:42:09,258 INFO zuul.Scheduler: Adding openstack-dev/sandbox, <Change 0x7ff518312c10 205360,1> to <Pipeline silent><br>
2015-07-25 11:42:09,258 DEBUG zuul.IndependentPipelineManager: Considering adding change <Change 0x7ff518312c10 205360,1><br>
2015-07-25 11:42:09,258 DEBUG zuul.IndependentPipelineManager: Unable to find change queue for change <Change 0x7ff518312c10 205360,1> in project openstack-dev/sandbox<br>
2015-07-25 11:42:09,306 DEBUG zuul.IndependentPipelineManager: Starting queue processor: check<br>
2015-07-25 11:42:09,306 DEBUG zuul.IndependentPipelineManager: Checking for changes needed by <Change 0x7ff518312c10 205360,1>:<br>
2015-07-25 11:42:09,306 DEBUG zuul.IndependentPipelineManager: No changes needed<br>
2015-07-25 11:42:09,306 DEBUG zuul.IndependentPipelineManager: Preparing ref for: <Change 0x7ff518312c10 205360,1><br>
2015-07-25 11:42:09,307 INFO zuul.IndependentPipelineManager: Change <Change 0x7ff518312c10 205360,1> depends on changes []<br>
2015-07-25 11:42:09,307 DEBUG zuul.MergeClient: Submitting job <gear.Job 0x7ff518325490 handle: None name: merger:merge unique: b425daae0cec4ff3b0d4920ee5533c9c> with data {'items': [{'oldrev': None, 'newrev': None, 'refspec': u'refs/changes/60/205360/1', 'merge_mode': 2, 'number': u'205360', 'project': 'openstack-dev/sandbox', 'url': 'ssh://<a href="http://Fnst@review.openstack.org:29418/openstack-dev/sandbox" rel="noreferrer" target="_blank">Fnst@review.openstack.org:29418/openstack-dev/sandbox</a>', 'branch': u'master', 'patchset': u'1', 'ref': 'Z81183af13086459d9d9fb8c06af86c09'}]}<br>
2015-07-25 11:42:09,308 DEBUG zuul.IndependentPipelineManager: Finished queue processor: check (changed: False)<br>
2015-07-25 11:42:09,309 DEBUG zuul.IndependentPipelineManager: Starting queue processor: silent<br>
2015-07-25 11:42:09,309 DEBUG zuul.IndependentPipelineManager: Finished queue processor: silent (changed: False)<br>
2015-07-25 11:42:09,309 DEBUG zuul.IndependentPipelineManager: Starting queue processor: patch<br>
2015-07-25 11:42:09,309 DEBUG zuul.IndependentPipelineManager: Finished queue processor: patch (changed: False)<br>
2015-07-25 11:42:09,309 DEBUG zuul.Scheduler: Run handler sleeping<br>
<br>
Thanks. :)<div class="HOEnZb"><div class="h5"><br></div></div></blockquote></div></div></div></div></div>