[OpenStack-Infra] An idea to scale Zuul

Antoine Musso hashar at free.fr
Fri Jan 10 15:12:19 UTC 2014


Le 09/01/14 07:59, James E. Blair a écrit :
> The acts of fetching and merging git patchsets (which is single
> threaded) adds some load to the server, but in particular, serving those
> git refs to 400 Jenkins nodes nearly simultaneously can also be a bit of
> a burden.  It was too much for our previous server; we've moved Zuul to
> a faster server now, but it would be nice to have a more scalable
> solution for the future.

Hello,

Seems the bottleneck is 400 or so fetches against a single host (Zuul).
Maybe you could use the Gerrit replication system to replicate the git
repositories to some mirror hosts then have Zuul push its references to
them.

Since Zuul publish the git repository to fetch from (ZUUL_URL), Zuul
could push the reference to a single mirror and give that mirror to the
job.  One thing you would need is make sure the replication is properly
working though.

cheers,

-- 
Antoine "hashar" Musso



More information about the OpenStack-Infra mailing list