<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Erik, thank you! I did this, and made some other changes based on your other email, and my errors are gone. I’m still working on isolating the specific changes that fixed the problem, but it definitely was one of your ideas. Many thanks!<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Erik Olof Gunnar Andersson <eandersson@blizzard.com>
<br>
<b>Sent:</b> Monday, February 10, 2020 9:54 AM<br>
<b>To:</b> Albert Braden <albertb@synopsys.com><br>
<b>Cc:</b> openstack-discuss@lists.openstack.org<br>
<b>Subject:</b> Re: Galera and haproxy fail; keystone error 'Lost connection to MySQL server during query'<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Database Connections are kept open for one hour. Timeouts on haproxy needs to reflect that. Set timeout to at least 60 minutes.<o:p></o:p></p>
<div>
<p class="MsoNormal">Sent from my iPhone<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal" style="margin-bottom:12.0pt">On Feb 10, 2020, at 9:04 AM, Albert Braden <<a href="mailto:Albert.Braden@synopsys.com">Albert.Braden@synopsys.com</a>> wrote:<o:p></o:p></p>
</blockquote>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Can anyone help with this galera issue?<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">If I run galera without haproxy and point everything to 1 server, it seems to work fine, but we want to load-balance it with haproxy. After setting up haproxy we had lots of errors in nova, neutron and keystone, but I got rid of those by
setting haproxy timeout values to 10 minutes. The remaining errors are in keystone. In /var/log/keystone/keystone-wsgi-public.log I see “Loaded 2 Fernet keys” every 5 minutes and this is frequently accompanied by a mysql error 'Lost connection to MySQL server
during query'<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">I tried changing various config items in haproxy, galera and keystone, but nothing seems to help. How can I fix these errors?<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Errors:<o:p></o:p></p>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/f.perl.bot/p/pbq26k__;!!Ci6f514n9QsL8ck!x4V2c3Ar0WBo_5ECE5wOFh-JHypGv45o5SAQWiCOQZPtHMKHHLMvAI92Q-YBgt797g$">https://f.perl.bot/p/pbq26k</a><o:p></o:p></p>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/f.perl.bot/p/1tnh78__;!!Ci6f514n9QsL8ck!x4V2c3Ar0WBo_5ECE5wOFh-JHypGv45o5SAQWiCOQZPtHMKHHLMvAI92Q-axKsd7Vw$">https://f.perl.bot/p/1tnh78</a><o:p></o:p></p>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/f.perl.bot/p/fuxmwo__;!!Ci6f514n9QsL8ck!x4V2c3Ar0WBo_5ECE5wOFh-JHypGv45o5SAQWiCOQZPtHMKHHLMvAI92Q-ZpWo8aJw$">https://f.perl.bot/p/fuxmwo</a><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Haproxy config:<o:p></o:p></p>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/f.perl.bot/p/gu2lil__;!!Ci6f514n9QsL8ck!x4V2c3Ar0WBo_5ECE5wOFh-JHypGv45o5SAQWiCOQZPtHMKHHLMvAI92Q-bBbKxEwg$">https://f.perl.bot/p/gu2lil</a><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Mysql timeout values:<o:p></o:p></p>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/f.perl.bot/p/i6l7tn__;!!Ci6f514n9QsL8ck!x4V2c3Ar0WBo_5ECE5wOFh-JHypGv45o5SAQWiCOQZPtHMKHHLMvAI92Q-YO341YRQ$">https://f.perl.bot/p/i6l7tn</a><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Keystone config (minus commented lines):<o:p></o:p></p>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__https:/f.perl.bot/p/o6fdht__;!!Ci6f514n9QsL8ck!x4V2c3Ar0WBo_5ECE5wOFh-JHypGv45o5SAQWiCOQZPtHMKHHLMvAI92Q-bsHPT2GA$">https://f.perl.bot/p/o6fdht</a><o:p></o:p></p>
</div>
</blockquote>
</div>
</body>
</html>