[OpenStack-Infra] multiple gerrit connections for ZUUL
Hejral, VaclavX
vaclavx.hejral at intel.com
Thu Apr 7 07:17:05 UTC 2016
Hello,
I realized, issue (limitation #1 as I called it) is there really because of comments. And it throws different kind of errors into zuul logs depending on fact WHERE VERTICALLY I put the comments.
I validated my layout via yaml-lint and yamllint (thanks for tip) and it is valid yaml file (it has only long-lines reported)
Sometimes [1], when change-queue is empty (sandbox pipeline) it works. This is after I zuul stop & start zuul. Sandbox pipeline gets broken after few patchsets arrived.
Sometimes [2] it happens that it does not work even for 1st time (after fresh start of zuul and sending 1st patchset into sandbox pipeline)
Sometimes [3] I got in advance additional error.
All is happening despite the fact comments are aligned as they should (validate via yaml-lint) HORIZONTALLY.
I realized that it is because section jobs: I have in /etc/zuul/layout/layout.yaml
But even without comments, after a while, it gets broken.
Working for some while (without comments):
jobs:
- name: ^.*$
parameter-function: single_use_node
- name: ^3rdparty-nfv-ci.*$
parameter-function: single_use_node
NOT working (below):
- name: ^.*$
parameter-function: single_use_node
- name: ^3rdparty-nfv-ci.*$
parameter-function: single_use_node
# branch: ^(?!.*stable/mitaka).*$
# parameter-function: set_proxy
NOT working (above – working only for 1st patchset):
- name: ^.*$
parameter-function: single_use_node
# branch: ^(?!.*stable/mitaka).*$
# parameter-function: set_proxy
- name: ^3rdparty-nfv-ci.*$
parameter-function: single_use_node
NOT working (below with one empty line):
- name: ^.*$
parameter-function: single_use_node
- name: ^3rdparty-nfv-ci.*$
parameter-function: single_use_node
# branch: ^(?!.*stable/mitaka).*$
# parameter-function: set_proxy
NOT working (below and not aligned horizontally – yaml-lint blames me):
- name: ^.*$
parameter-function: single_use_node
- name: ^3rdparty-nfv-ci.*$
parameter-function: single_use_node
# branch: ^(?!.*stable/mitaka).*$
# parameter-function: set_proxy
[1]
2016-04-04 14:39:53,504 INFO zuul.Scheduler: Adding openstack-dev/ci-sandbox, <Change 0x7fcb20753a90 282323,1> to <Pipeline sandbox>
2016-04-04 14:39:53,504 DEBUG zuul.IndependentPipelineManager: Considering adding change <Change 0x7fcb20753a90 282323,1>
2016-04-04 14:39:53,505 ERROR zuul.Scheduler: Exception in run handler:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 962, in run
self.process_event_queue()
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1018, in process_event_queue
pipeline.manager.addChange(change)
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1366, in addChange
with self.getChangeQueue(change, change_queue) as change_queue:
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1889, in getChangeQueue
if change.project not in self.pipeline.getProjects():
File "/usr/local/lib/python2.7/dist-packages/zuul/model.py", line 111, in getProjects
return sorted(self.job_trees.keys(), lambda a, b: cmp(a.name, b.name))
File "/usr/local/lib/python2.7/dist-packages/zuul/model.py", line 111, in <lambda>
return sorted(self.job_trees.keys(), lambda a, b: cmp(a.name, b.name))
AttributeError: 'NoneType' object has no attribute 'name'
[2]
2016-04-07 07:06:28,874 INFO zuul.Scheduler: Adding openstack-dev/ci-sandbox, <Change 0x7f29902898d0 282323,1> to <Pipeline sandbox>
2016-04-07 07:06:28,875 ERROR zuul.Scheduler: Exception in run handler:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 962, in run
self.process_event_queue()
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1018, in process_event_queue
pipeline.manager.addChange(change)
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1366, in addChange
with self.getChangeQueue(change, change_queue) as change_queue:
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1892, in getChangeQueue
change_queue.addProject(change.project)
File "/usr/local/lib/python2.7/dist-packages/zuul/model.py", line 332, in addProject
names = [x.name for x in self.projects]
2016-04-07 07:06:31,055 INFO zuul.Scheduler: Adding openstack-dev/ci-sandbox, <Change 0x7f29902898d0 282323,1> to <Pipeline sandbox>
2016-04-07 07:40:11,027 ERROR zuul.Scheduler: Exception in run handler:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 962, in run
self.process_event_queue()
File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1001, in process_event_queue
change = pipeline.source.getChange(event, project)
File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 133, in getChange
refresh=refresh)
File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 156, in _getChange
self._updateChange(change, history)
File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 275, in _updateChange
dep = self._getChange(dep_num, dep_ps, history=history)
File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 156, in _getChange
self._updateChange(change, history)
File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 219, in _updateChange
data = self.connection.query(change.number)
File "/usr/local/lib/python2.7/dist-packages/zuul/connection/gerrit.py", line 287, in query
out, err = self._ssh(cmd)
File "/usr/local/lib/python2.7/dist-packages/zuul/connection/gerrit.py", line 383, in _ssh
raise Exception("Gerrit error executing %s" % command)
Exception: Gerrit error executing gerrit query --format json --all-approvals --comments --commit-message --current-patch-set --dependencies --files --patch-sets --submit-records 298130
Vaclav
--------------------------------------------------------------
Intel Research and Development Ireland Limited
Registered in Ireland
Registered Office: Collinstown Industrial Park, Leixlip, County Kildare
Registered Number: 308263
This e-mail and any attachments may contain confidential material for the sole
use of the intended recipient(s). Any review or distribution by others is
strictly prohibited. If you are not the intended recipient, please contact the
sender and delete all copies.
More information about the OpenStack-Infra
mailing list