<div dir="ltr">Hi,<div><br></div><div>Btw, why we have such option set to false ? <br clear="all"><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div style="margin:0px;padding:0px 0px 20px;width:1503px;color:rgb(34,34,34);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><div style="margin:8px 0px 0px;padding:0px"><div dir="ltr"><span><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:small"><span style="color:rgb(136,136,136);vertical-align:top;line-height:18px;font-size:11pt;font-family:Arial,Helvetica,Geneva;font-weight:bold">Michal Arbet<br></span><span style="color:rgb(136,136,136);font-size:10pt;vertical-align:top;line-height:18px;font-family:Arial,Helvetica,Geneva">Openstack Engineer<br><img src="https://www.google.com/a/ultimum.io/images/logo.gif" width="200" height="81"><br>Ultimum Technologies a.s.<br>Na Poříčí 1047/26, 11000 Praha 1<br>Czech Republic<br><br><a value="+420608314961" style="color:rgb(17,85,204)">+420 604 228 897</a> <br><a href="mailto:michal.arbet@ultimum.io" style="color:rgb(17,85,204)" target="_blank">michal.arbet@ultimum.io</a><br></span><font color="#1155cc" face="Arial, Helvetica, Geneva" style="font-size:12.8px"><span style="font-size:13.3333px;line-height:18px"><u><a href="https://ultimum.io/" style="color:rgb(17,85,204)" target="_blank">https://ultimum.io</a></u></span></font><br></div><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:small"><font color="#1155cc" face="Arial, Helvetica, Geneva" style="font-size:12.8px"><span style="font-size:13.3333px;line-height:18px"><br></span></font></div><div style="font-family:Arial,Helvetica,sans-serif;font-size:small"><font color="#666666"><a href="https://www.linkedin.com/company/ultimum-technologies" style="color:rgb(17,85,204)" target="_blank">LinkedIn</a> | <a href="https://twitter.com/ultimumtech" style="color:rgb(17,85,204)" target="_blank">Twitter</a> | <a href="https://www.facebook.com/ultimumtechnologies/timeline" style="color:rgb(17,85,204)" target="_blank">Facebook</a></font></div></div></div></div></div></div></div></div></span></div></div><div><div></div><div><div></div></div></div><div></div></div></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">út 11. 4. 2023 v 14:48 odesílatel Michał Nasiadka <<a href="mailto:mnasiadka@gmail.com">mnasiadka@gmail.com</a>> napsal:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Hello,</div><div dir="auto"><br></div><div dir="auto">RabbitMQ HA has been backported into stable releases, and it’s documented here: <div><a href="https://docs.openstack.org/kolla-ansible/yoga/reference/message-queues/rabbitmq.html#high-availability" target="_blank">https://docs.openstack.org/kolla-ansible/yoga/reference/message-queues/rabbitmq.html#high-availability</a></div><div><br></div><div dir="auto">Best regards,</div><div dir="auto">Michal</div></div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">W dniu wt., 11.04.2023 o 13:32 Nguyễn Hữu Khôi <<a href="mailto:nguyenhuukhoinw@gmail.com" target="_blank">nguyenhuukhoinw@gmail.com</a>> napisał(a):<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Yes.<div dir="auto">But cluster cannot work properly without it. :(</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Apr 11, 2023, 6:18 PM Danny Webb <<a href="mailto:Danny.Webb@thehutgroup.com" target="_blank">Danny.Webb@thehutgroup.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">




<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;background-color:rgb(255,255,255);color:rgb(0,0,0)">
This commit explains why they largely removed HA queue durability:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;background-color:rgb(255,255,255);color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;background-color:rgb(255,255,255);color:rgb(0,0,0)">
<a href="https://opendev.org/openstack/kolla-ansible/commit/2764844ee2ff9393a4eebd90a9a912588af0a180" id="m_-8432821293561663759m_-2379310202300127720m_682384868973352406LPlnk807430" rel="noreferrer" style="font-family:Calibri,Arial,Helvetica,sans-serif" target="_blank">https://opendev.org/openstack/kolla-ansible/commit/2764844ee2ff9393a4eebd90a9a912588af0a180</a><br>
</div>
<div id="m_-8432821293561663759m_-2379310202300127720m_682384868973352406appendonsend"></div>
<hr style="display:inline-block;width:98%">
<div id="m_-8432821293561663759m_-2379310202300127720m_682384868973352406divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(0,0,0)"><b style="font-family:Calibri,sans-serif">From:</b> Satish Patel <<a href="mailto:satish.txt@gmail.com" rel="noreferrer" style="font-family:Calibri,sans-serif" target="_blank">satish.txt@gmail.com</a>><br>
<b style="font-family:Calibri,sans-serif">Sent:</b> 09 April 2023 04:16<br>
<b style="font-family:Calibri,sans-serif">To:</b> Nguyễn Hữu Khôi <<a href="mailto:nguyenhuukhoinw@gmail.com" rel="noreferrer" style="font-family:Calibri,sans-serif" target="_blank">nguyenhuukhoinw@gmail.com</a>><br>
<b style="font-family:Calibri,sans-serif">Cc:</b> OpenStack Discuss <<a href="mailto:openstack-discuss@lists.openstack.org" rel="noreferrer" style="font-family:Calibri,sans-serif" target="_blank">openstack-discuss@lists.openstack.org</a>><br>
<b style="font-family:Calibri,sans-serif">Subject:</b> Re: [openstack][sharing][kolla ansible]Problems when 1 of 3 controller was be down</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div>
<div style="font-size:12px;text-align:left;font-family:Helvetica,Arial,sans-serif;color:rgb(0,0,0)">
<strong style="font-family:Helvetica,Arial,sans-serif"><br>
<div style="font-family:sans-serif;background-color:rgb(244,127,83)"><span style="font-size:14pt;font-family:sans-serif"><strong style="font-family:sans-serif">CAUTION:</strong></span>
<span style="font-size:11pt;font-weight:400;font-family:sans-serif">This email originates from outside THG</span>
</div>
</strong><br>
</div>
<hr>
</div>
Are you proposing a solution or just raising an issue? 
<div><br>
</div>
<div>I did find it strange that kolla-ansible doesn't support HA queue by default. That is a disaster because when one of the nodes goes down it will make the whole rabbitMQ unacceptable. Whenever i deploy kolla i have to add HA policy to make queue HA otherwise
 you will endup in problem. </div>
</div>
<br>
<div>
<div dir="ltr">On Sat, Apr 8, 2023 at 6:40 AM Nguyễn Hữu Khôi <<a href="mailto:nguyenhuukhoinw@gmail.com" rel="noreferrer" target="_blank">nguyenhuukhoinw@gmail.com</a>> wrote:<br>
</div>
<blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">Hello everyone.
<div><br>
</div>
<div>I want to summary for who meets problems with Openstack when deploy cluster with 3 controller using Kolla Ansible</div>
<div><br>
</div>
<div>Scenario: 1 of 3 controller is down</div>
<div><br>
</div>
<div>1. Login horizon and use API such as nova, cinder will be very slow</div>
<div><br>
</div>
<div>fix by:</div>
<div><br>
</div>
<div>nano:<br>
kolla-ansible/ansible/roles/heat/templates/heat.conf.j2<br>
kolla-ansible/ansible/roles/nova/templates/nova.conf.j2<br>
kolla-ansible/ansible/roles/keystone/templates/keystone.conf.j2<br>
kolla-ansible/ansible/roles/neutron/templates/neutron.conf.j2</div>
<div>kolla-ansible/ansible/roles/cinder/templates/cinder.conf.j2</div>
<div><br>
</div>
<div>or which service need caches<br>
 </div>
<div>add as below</div>
<div><br>
</div>
<div>[cache]<br>
backend = oslo_cache.memcache_pool<br>
enabled = True<br>
memcache_servers = {{ kolla_internal_vip_address }}:{{ memcached_port }}<br>
memcache_dead_retry = 0.25<br>
memcache_socket_timeout = 900</div>
<div><br>
</div>
<div><a href="https://review.opendev.org/c/openstack/kolla-ansible/+/849487" rel="noreferrer" target="_blank">https://review.opendev.org/c/openstack/kolla-ansible/+/849487</a><br>
</div>
<div><br>
</div>
<div>but it is not the end</div>
<div><br>
</div>
<div>2. Cannot launch instance or mapping block device(stuck at this step)</div>
<div><br>
</div>
<div>nano kolla-ansible/ansible/roles/rabbitmq/templates/definitions.json.j2</div>
<div>  <br>
"policies":[<br>
    {"vhost": "/", "name": "ha-all", "pattern": "^(?!(amq\.)|(.*_fanout_)|(reply_)).*", "apply-to": "all", "definition": {"ha-mode":"all"}, "priority":0}{% if project_name == 'outward_rabbitmq' %},<br>
    {"vhost": "{{ murano_agent_rabbitmq_vhost }}", "name": "ha-all", "pattern": ".*", "apply-to": "all", "definition": {"ha-mode":"all"}, "priority":0}<br>
    {% endif %}<br>
  ]<br>
</div>
<div><br>
</div>
<div>nano /etc/kollla/global.conf</div>
<div><br>
</div>
<div>[oslo_messaging_rabbit]<br>
kombu_reconnect_delay=0.5<br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><a href="https://bugs.launchpad.net/oslo.messaging/+bug/1993149" rel="noreferrer" target="_blank">https://bugs.launchpad.net/oslo.messaging/+bug/1993149</a><br>
</div>
<div><a href="https://docs.openstack.org/large-scale/journey/configure/rabbitmq.html" rel="noreferrer" target="_blank">https://docs.openstack.org/large-scale/journey/configure/rabbitmq.html</a><br>
</div>
<div><br>
</div>
<div>I used Xena 13.4 and Yoga 14.8.1.</div>
<div><br>
</div>
<div>Above bugs are critical, but I see that it was not fixed. I am just an operator and I want to share what I encountered for new people who come to Openstack</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">
<div dir="ltr">Nguyen Huu Khoi<br>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>

</blockquote></div>
</blockquote></div></div><span>-- </span><br><div dir="ltr">Michał Nasiadka<br><a href="mailto:mnasiadka@gmail.com" target="_blank">mnasiadka@gmail.com</a></div>
</blockquote></div>