<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D">Thanks Doug very much for your quick reply.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Ran your ruby check and no error in layout.yaml file.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">I also did check the syntax yaml file using zuul-server cmd:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">/usr/bin/python /usr/bin/zuul-server -c /etc/zuul/zuul.conf -l /etc/zuul/layout.yaml -t<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">The syntax is all ok. <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">The ERROR is a hint? <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">ERROR zuul.Gearman: Job <gear.Job 0x21b8f50 handle: None name: build:openstack-build-job unique: 51ea00c330c84cf9b40<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">ea38ad6c3f9e6> is not registered with Gearman<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Thanks again, any inputs is much apprecicated.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Van<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Doug Wiegley [mailto:dougw@a10networks.com]
<br>
<b>Sent:</b> Wednesday, October 01, 2014 4:59 PM<br>
<b>To:</b> Phan, Van; openstack-infra@lists.openstack.org<br>
<b>Subject:</b> Re: [OpenStack-Infra] desperate to get zuul works again, see layout setting at the end of email<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;color:black">This might not be your problem, but all of my silent zuul stoppages have been YAML syntax errors. Try running this; if it’s prints something dictionary like, the syntax is fine. If it throws
an exception, the yaml file is wrong.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;color:black"><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;color:black">echo "require 'yaml'; z=YAML.load(File.open('/etc/zuul/layout.yaml').read); print z" | ruby<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;color:black"><o:p> </o:p></span></p>
</div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="color:black">From: </span></b><span style="color:black"><Phan>, Van <<a href="mailto:tphan@paypal.com">tphan@paypal.com</a>><br>
<b>Date: </b>Wednesday, October 1, 2014 at 5:36 PM<br>
<b>To: </b>"<a href="mailto:openstack-infra@lists.openstack.org">openstack-infra@lists.openstack.org</a>" <<a href="mailto:openstack-infra@lists.openstack.org">openstack-infra@lists.openstack.org</a>><br>
<b>Subject: </b>[OpenStack-Infra] desperate to get zuul works again, see layout setting at the end of email<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;color:black"><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="color:black">Hi,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Could you please give me a hint how to fix the problem?
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">We had review/build/approve pipeline working well.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Suddenly, all review requests got zuul reported back as LOST. Restarted zuul/ Jenkins a few times and it still has GEARMAN reported ERROR…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,631 ERROR zuul.Gearman: Job <gear.Job 0x7f5100010a90 handle: None name: build:openstack-review-job unique: 701cc4fa52c54<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">462935bcaa276880b99> is not registered with Gearman<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,632 INFO zuul.Gearman: Build <gear.Job 0x7f5100010a90 handle: None name: build:openstack-review-job unique: 701cc4fa52c5<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">4462935bcaa276880b99> complete, result LOST<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">ERROR zuul.Gearman: Job <gear.Job 0x21b8f50 handle: None name: build:openstack-build-job unique: 51ea00c330c84cf9b40<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">ea38ad6c3f9e6> is not registered with Gearman<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,633 INFO zuul.Gearman: Build <gear.Job 0x21b8f50 handle: None name: build:openstack-build-job unique: 51ea00c330c84cf9b4<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">0ea38ad6c3f9e6> complete, result LOST<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Here are the errors in zuul log:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:16,240 INFO zuul.Gerrit: Updating information for 2366,1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:33,063 INFO zuul.Gerrit: Updating information for 2511,1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:34,934 INFO zuul.Scheduler: Adding C3/keystone-plugins, <Change 0x1e742d0 2511,1> to <Pipeline review><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:34,935 INFO zuul.IndependentPipelineManager: Troubleshooting addChange<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:34,935 INFO zuul.IndependentPipelineManager: Reporting start, action [<ActionReporter <zuul.reporter.gerrit.Reporter object<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">at 0x21bbe90>, {'code-review': 0}>] change <Change 0x1e742d0 2511,1><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:36,028 INFO zuul.Gerrit: Updating information for 2511,1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:36,044 INFO zuul.IndependentPipelineManager: Change <Change 0x1e742d0 2511,1> depends on changes []<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,628 INFO zuul.IndependentPipelineManager: Change <Change 0x1e742d0 2511,1> depends on changes []<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,629 INFO zuul.Gearman: Launch job openstack-review-job for change <Change 0x1e742d0 2511,1> with dependent changes []<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,631 ERROR zuul.Gearman: Job <gear.Job 0x7f5100010a90 handle: None name: build:openstack-review-job unique: 701cc4fa52c54<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">462935bcaa276880b99> is not registered with Gearman<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,632 INFO zuul.Gearman: Build <gear.Job 0x7f5100010a90 handle: None name: build:openstack-review-job unique: 701cc4fa52c5<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">4462935bcaa276880b99> complete, result LOST<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,632 INFO zuul.Gearman: Launch job openstack-build-job for change <Change 0x1e742d0 2511,1> with dependent changes []<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,633 ERROR zuul.Gearman: Job <gear.Job 0x21b8f50 handle: None name: build:openstack-build-job unique: 51ea00c330c84cf9b40<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">ea38ad6c3f9e6> is not registered with Gearman<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,633 INFO zuul.Gearman: Build <gear.Job 0x21b8f50 handle: None name: build:openstack-build-job unique: 51ea00c330c84cf9b4<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">0ea38ad6c3f9e6> complete, result LOST<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">2014-10-01 22:53:37,634 INFO zuul.IndependentPipelineManager: Reporting change <Change 0x1e742d0 2511,1>, actions: [<ActionReporter <zuul.re<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">porter.smtp.Reporter object at 0x21bbed0>, {'to':
<a href="mailto:'tphan@paypal.com">'tphan@paypal.com</a>', 'from': <a href="mailto:'cicdzuul@paypal.com">
'cicdzuul@paypal.com</a>'}>, <ActionReporter <zuul.reporter.gerrit<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">.Reporter object at 0x21bbe90>, {'code-review': -1}>]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Sample of project settings in layout.yaml:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">project-templates:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - name: openstack-template<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> review:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - 'openstack-review-job'<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - 'openstack-build-job'<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> approval:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - 'openstack-approval-job'<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">projects:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - name: C3/nova-scheduler<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> template:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - name: openstack-template<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - name: C3/keystone-plugins<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> template:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - name: openstack-template<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - name: C3/nova<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> template:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> - name: openstack-template<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Thanks very much.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Van<o:p></o:p></span></p>
</div>
</div>
</div>
</body>
</html>