[OpenStack-Infra] multiple gerrit connections for ZUUL

Hejral, VaclavX vaclavx.hejral at intel.com
Thu Apr 7 07:17:05 UTC 2016


Hello,

I realized, issue (limitation #1 as I called it) is there really because of comments. And it throws different kind of errors into zuul logs depending on fact WHERE VERTICALLY I put the comments.

I validated my layout via yaml-lint and yamllint (thanks for tip) and it is valid yaml file (it has only long-lines reported)

Sometimes [1], when change-queue is empty (sandbox pipeline) it works. This is after I zuul stop & start zuul. Sandbox pipeline gets broken after few patchsets arrived.

Sometimes [2] it happens that it does not work even for 1st time (after fresh start of zuul and sending 1st patchset into sandbox pipeline)

Sometimes [3] I got in advance additional error.

All is happening despite the fact comments are aligned as they should (validate via yaml-lint) HORIZONTALLY.

I realized that it is because section jobs: I have in /etc/zuul/layout/layout.yaml
But even without comments, after a while, it gets broken.

Working for some while (without comments):
jobs:
  - name: ^.*$
    parameter-function: single_use_node

 - name: ^3rdparty-nfv-ci.*$
    parameter-function: single_use_node

NOT working (below):
  - name: ^.*$
    parameter-function: single_use_node

  - name: ^3rdparty-nfv-ci.*$
    parameter-function: single_use_node
    # branch: ^(?!.*stable/mitaka).*$
    # parameter-function: set_proxy

NOT working (above – working only for 1st patchset):
  - name: ^.*$
    parameter-function: single_use_node

    # branch: ^(?!.*stable/mitaka).*$
    # parameter-function: set_proxy
  - name: ^3rdparty-nfv-ci.*$
    parameter-function: single_use_node


NOT working (below with one empty line):
  - name: ^.*$
    parameter-function: single_use_node

  - name: ^3rdparty-nfv-ci.*$
    parameter-function: single_use_node

    # branch: ^(?!.*stable/mitaka).*$
    # parameter-function: set_proxy

NOT working (below and not aligned horizontally – yaml-lint blames me):
  - name: ^.*$
    parameter-function: single_use_node

  - name: ^3rdparty-nfv-ci.*$
    parameter-function: single_use_node
  # branch: ^(?!.*stable/mitaka).*$
  # parameter-function: set_proxy


[1]
2016-04-04 14:39:53,504 INFO zuul.Scheduler: Adding openstack-dev/ci-sandbox, <Change 0x7fcb20753a90 282323,1> to <Pipeline sandbox>
2016-04-04 14:39:53,504 DEBUG zuul.IndependentPipelineManager: Considering adding change <Change 0x7fcb20753a90 282323,1>
2016-04-04 14:39:53,505 ERROR zuul.Scheduler: Exception in run handler:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 962, in run
    self.process_event_queue()
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1018, in process_event_queue
    pipeline.manager.addChange(change)
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1366, in addChange
    with self.getChangeQueue(change, change_queue) as change_queue:
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1889, in getChangeQueue
    if change.project not in self.pipeline.getProjects():
  File "/usr/local/lib/python2.7/dist-packages/zuul/model.py", line 111, in getProjects
    return sorted(self.job_trees.keys(), lambda a, b: cmp(a.name, b.name))
  File "/usr/local/lib/python2.7/dist-packages/zuul/model.py", line 111, in <lambda>
    return sorted(self.job_trees.keys(), lambda a, b: cmp(a.name, b.name))
AttributeError: 'NoneType' object has no attribute 'name'


[2]
2016-04-07 07:06:28,874 INFO zuul.Scheduler: Adding openstack-dev/ci-sandbox, <Change 0x7f29902898d0 282323,1> to <Pipeline sandbox>
2016-04-07 07:06:28,875 ERROR zuul.Scheduler: Exception in run handler:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 962, in run
    self.process_event_queue()
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1018, in process_event_queue
    pipeline.manager.addChange(change)
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1366, in addChange
    with self.getChangeQueue(change, change_queue) as change_queue:
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1892, in getChangeQueue
    change_queue.addProject(change.project)
  File "/usr/local/lib/python2.7/dist-packages/zuul/model.py", line 332, in addProject
    names = [x.name for x in self.projects]
2016-04-07 07:06:31,055 INFO zuul.Scheduler: Adding openstack-dev/ci-sandbox, <Change 0x7f29902898d0 282323,1> to <Pipeline sandbox>

2016-04-07 07:40:11,027 ERROR zuul.Scheduler: Exception in run handler:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 962, in run
    self.process_event_queue()
  File "/usr/local/lib/python2.7/dist-packages/zuul/scheduler.py", line 1001, in process_event_queue
    change = pipeline.source.getChange(event, project)
  File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 133, in getChange
    refresh=refresh)
  File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 156, in _getChange
    self._updateChange(change, history)
  File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 275, in _updateChange
    dep = self._getChange(dep_num, dep_ps, history=history)
  File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 156, in _getChange
    self._updateChange(change, history)
  File "/usr/local/lib/python2.7/dist-packages/zuul/source/gerrit.py", line 219, in _updateChange
    data = self.connection.query(change.number)
  File "/usr/local/lib/python2.7/dist-packages/zuul/connection/gerrit.py", line 287, in query
    out, err = self._ssh(cmd)
  File "/usr/local/lib/python2.7/dist-packages/zuul/connection/gerrit.py", line 383, in _ssh
    raise Exception("Gerrit error executing %s" % command)
Exception: Gerrit error executing gerrit query --format json --all-approvals --comments --commit-message --current-patch-set --dependencies --files --patch-sets --submit-records 298130

Vaclav

--------------------------------------------------------------
Intel Research and Development Ireland Limited
Registered in Ireland
Registered Office: Collinstown Industrial Park, Leixlip, County Kildare
Registered Number: 308263


This e-mail and any attachments may contain confidential material for the sole
use of the intended recipient(s). Any review or distribution by others is
strictly prohibited. If you are not the intended recipient, please contact the
sender and delete all copies.


More information about the OpenStack-Infra mailing list