<div dir="ltr">Hi,<div><br></div><div>they just added check for service user , check the log :</div><div><br></div><div><pre style="box-sizing:border-box;font-family:SFMono-Regular,Menlo,Monaco,Consolas,"Liberation Mono","Courier New",monospace;font-size:13.125px;margin-top:0px;margin-bottom:1rem;overflow:auto;color:rgb(33,37,41)">+---------------------------------------------------------------------+
| Upgrade Check Results |
+---------------------------------------------------------------------+
| Check: Cells v2 |
| Result: Success |
| Details: None |
+---------------------------------------------------------------------+
| Check: Placement API |
| Result: Success |
| Details: None |
+---------------------------------------------------------------------+
| Check: Cinder API |
| Result: Success |
| Details: None |
+---------------------------------------------------------------------+
| Check: Policy File JSON to YAML Migration |
| Result: Success |
| Details: None |
+---------------------------------------------------------------------+
| Check: Older than N-1 computes |
| Result: Success |
| Details: None |
+---------------------------------------------------------------------+
| Check: hw_machine_type unset |
| Result: Success |
| Details: None |
+---------------------------------------------------------------------+
| Check: Service User Token Configuration |
| Result: Failure |
| Details: Service user token configuration is required for all Nova |
| services. For more details see the following: <a href="https://docs">https://docs</a> |
| .<a href="http://openstack.org/latest/nova/admin/configuration/service-">openstack.org/latest/nova/admin/configuration/service-</a> |
| user-token.html |
+---------------------------------------------------------------------+</pre><pre style="box-sizing:border-box;font-family:SFMono-Regular,Menlo,Monaco,Consolas,"Liberation Mono","Courier New",monospace;font-size:13.125px;margin-top:0px;margin-bottom:1rem;overflow:auto;color:rgb(33,37,41)"><br></pre><pre style="box-sizing:border-box;font-family:SFMono-Regular,Menlo,Monaco,Consolas,"Liberation Mono","Courier New",monospace;font-size:13.125px;margin-top:0px;margin-bottom:1rem;overflow:auto;color:rgb(33,37,41)">If we want to fix this in kolla-ansible, we should generate another config file for container which is actually running nova-upgrade status check, run container with this config,</pre><pre style="box-sizing:border-box;font-family:SFMono-Regular,Menlo,Monaco,Consolas,"Liberation Mono","Courier New",monospace;font-size:13.125px;margin-top:0px;margin-bottom:1rem;overflow:auto;color:rgb(33,37,41)">and if it will pass it's ok.</pre><pre style="box-sizing:border-box;font-family:SFMono-Regular,Menlo,Monaco,Consolas,"Liberation Mono","Courier New",monospace;font-size:13.125px;margin-top:0px;margin-bottom:1rem;overflow:auto;color:rgb(33,37,41)"><br></pre><pre style="box-sizing:border-box;font-family:SFMono-Regular,Menlo,Monaco,Consolas,"Liberation Mono","Courier New",monospace;font-size:13.125px;margin-top:0px;margin-bottom:1rem;overflow:auto;color:rgb(33,37,41)">Problem is that we are running upgrade check before config generation.</pre><pre style="box-sizing:border-box;font-family:SFMono-Regular,Menlo,Monaco,Consolas,"Liberation Mono","Courier New",monospace;font-size:13.125px;margin-top:0px;margin-bottom:1rem;overflow:auto;color:rgb(33,37,41)">If you run kolla-ansible genconfig before upgrade on host1 it will pass also...</pre><pre style="box-sizing:border-box;font-family:SFMono-Regular,Menlo,Monaco,Consolas,"Liberation Mono","Courier New",monospace;font-size:13.125px;margin-top:0px;margin-bottom:1rem;overflow:auto;color:rgb(33,37,41)"><br></pre><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div style="margin:0px;padding:0px 0px 20px;width:1503px;color:rgb(34,34,34);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><div style="margin:8px 0px 0px;padding:0px"><div dir="ltr"><span><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:small"><span style="color:rgb(136,136,136);vertical-align:top;line-height:18px;font-size:11pt;font-family:Arial,Helvetica,Geneva;font-weight:bold">Michal Arbet<br></span><span style="color:rgb(136,136,136);font-size:10pt;vertical-align:top;line-height:18px;font-family:Arial,Helvetica,Geneva">Openstack Engineer<br><img src="https://www.google.com/a/ultimum.io/images/logo.gif" width="200" height="81"><br>Ultimum Technologies a.s.<br>Na Poříčí 1047/26, 11000 Praha 1<br>Czech Republic<br><br><a value="+420608314961" style="color:rgb(17,85,204)">+420 604 228 897</a> <br><a href="mailto:michal.arbet@ultimum.io" style="color:rgb(17,85,204)" target="_blank">michal.arbet@ultimum.io</a><br></span><font color="#1155cc" face="Arial, Helvetica, Geneva" style="font-size:12.8px"><span style="font-size:13.3333px;line-height:18px"><u><a href="https://ultimum.io/" style="color:rgb(17,85,204)" target="_blank">https://ultimum.io</a></u></span></font><br></div><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:small"><font color="#1155cc" face="Arial, Helvetica, Geneva" style="font-size:12.8px"><span style="font-size:13.3333px;line-height:18px"><br></span></font></div><div style="font-family:Arial,Helvetica,sans-serif;font-size:small"><font color="#666666"><a href="https://www.linkedin.com/company/ultimum-technologies" style="color:rgb(17,85,204)" target="_blank">LinkedIn</a> | <a href="https://twitter.com/ultimumtech" style="color:rgb(17,85,204)" target="_blank">Twitter</a> | <a href="https://www.facebook.com/ultimumtechnologies/timeline" style="color:rgb(17,85,204)" target="_blank">Facebook</a></font></div></div></div></div></div></div></div></div></span></div></div><div><div></div><div><div></div></div></div><div></div></div></div></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">st 21. 6. 2023 v 16:54 odesílatel Satish Patel <<a href="mailto:satish.txt@gmail.com">satish.txt@gmail.com</a>> napsal:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Just to close this loop, after adding the following in /etc/kolla/nova-api/nova.conf fixed my issue. But still need to understand what went wrong in upgrade path<div><br></div><div><pre style="line-height:16.25px;margin-top:0px;margin-bottom:0px;padding:5px 0px;font-family:"Bitstream Vera Sans Mono",monospace;font-size:13px;color:rgb(0,0,0);background-color:rgb(240,240,240)">[service_user]
send_service_user_token = true
auth_url = <a href="http://10.30.50.10:5000" target="_blank">http://10.30.50.10:5000</a>
auth_type = password
project_domain_id = default
user_domain_id = default
project_name = service
username = nova
password = AAABBBCCCDDDEEE
cafile =
region_name = RegionOne
valid_interfaces = internal</pre></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 21, 2023 at 9:02 AM Satish Patel <<a href="mailto:satish.txt@gmail.com" target="_blank">satish.txt@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Maksim,<div><br></div><div>This is all I have in my config/ I don't have any override.</div><div><br></div><div>(venv-kolla) root@kolla-infra-1:~# ls -l /etc/kolla/config/<br>total 8<br>-rw-r--r-- 1 root root 187 Apr 30 04:11 global.conf<br>drwxr-xr-x 2 root root 4096 May 3 01:38 neutron<br></div><div><br></div><div><br></div><div>(venv-kolla) root@kolla-infra-1:~# cat /etc/kolla/config/global.conf<br>[oslo_messaging_rabbit]<br>kombu_reconnect_delay=0.5<br>rabbit_transient_queues_ttl=60<br></div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 21, 2023 at 4:15 AM Maksim Malchuk <<a href="mailto:maksim.malchuk@gmail.com" target="_blank">maksim.malchuk@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Satish,<div><br></div><div>It very strange because the fix for service token for the Nova was merged a month ago (<a href="https://review.opendev.org/q/I2189dafca070accfd8efcd4b8cc4221c6decdc9f" target="_blank">https://review.opendev.org/q/I2189dafca070accfd8efcd4b8cc4221c6decdc9f</a>)</div><div>Maybe you have custom configuration which overrides nova.conf ?</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jun 21, 2023 at 7:16 AM Satish Patel <<a href="mailto:satish.txt@gmail.com" target="_blank">satish.txt@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Folks,<br><div><br></div><div>I'am upgrading zed to antelope using kolla-ansible and encount following error </div><div><br></div><div>TASK [nova : Upgrade status check result] ************************************************************************************************************************************************************<br>fatal: [kolla-infra-1]: FAILED! => {"changed": false, "msg": ["There was an upgrade status check failure!", "See the detail at <a href="https://docs.openstack.org/nova/latest/cli/nova-status.html#nova-status-checks" target="_blank">https://docs.openstack.org/nova/latest/cli/nova-status.html#nova-status-checks</a>"]}<br>fatal: [kolla-infra-2]: FAILED! => {"changed": false, "msg": ["There was an upgrade status check failure!", "See the detail at <a href="https://docs.openstack.org/nova/latest/cli/nova-status.html#nova-status-checks" target="_blank">https://docs.openstack.org/nova/latest/cli/nova-status.html#nova-status-checks</a>"]}<br>fatal: [kolla-infra-3]: FAILED! => {"changed": false, "msg": ["There was an upgrade status check failure!", "See the detail at <a href="https://docs.openstack.org/nova/latest/cli/nova-status.html#nova-status-checks" target="_blank">https://docs.openstack.org/nova/latest/cli/nova-status.html#nova-status-checks</a>"]}<br></div><div><br></div><div><br></div><div>After running upgrade check command manually on nova-api container got following error </div><div><br></div><div>(nova-api)[root@kolla-infra-2 /]# nova-status upgrade check<br>Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.<br>+---------------------------------------------------------------------+<br>| Upgrade Check Results |<br>+---------------------------------------------------------------------+<br>| Check: Cells v2 |<br>| Result: Success |<br>| Details: None |<br>+---------------------------------------------------------------------+<br>| Check: Placement API |<br>| Result: Success |<br>| Details: None |<br>+---------------------------------------------------------------------+<br>| Check: Cinder API |<br>| Result: Success |<br>| Details: None |<br>+---------------------------------------------------------------------+<br>| Check: Policy File JSON to YAML Migration |<br>| Result: Success |<br>| Details: None |<br>+---------------------------------------------------------------------+<br>| Check: Older than N-1 computes |<br>| Result: Success |<br>| Details: None |<br>+---------------------------------------------------------------------+<br>| Check: hw_machine_type unset |<br>| Result: Success |<br>| Details: None |<br>+---------------------------------------------------------------------+<br>| Check: Service User Token Configuration |<br>| Result: Failure |<br>| Details: Service user token configuration is required for all Nova |<br>| services. For more details see the following: <a href="https://docs" target="_blank">https://docs</a> |<br>| .<a href="http://openstack.org/latest/nova/admin/configuration/service-" target="_blank">openstack.org/latest/nova/admin/configuration/service-</a> |<br>| user-token.html |<br>+---------------------------------------------------------------------+<br></div><div><br></div><div>Service user token reference to the following doc [1] . Do I need to configure token users in order to upgrade nova? </div><div><br></div><div>[1] <a href="https://docs.openstack.org/nova/latest/admin/configuration/service-user-token.html" target="_blank">https://docs.openstack.org/nova/latest/admin/configuration/service-user-token.html</a> </div><div><br></div><div><br></div></div>
</blockquote></div><br clear="all"><div><br></div><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div style="font-family:arial;font-size:small">Regards,<br></div><div style="font-family:arial;font-size:small">Maksim Malchuk</div><div style="font-family:arial;font-size:small"><br></div></div></div>
</blockquote></div>
</blockquote></div>
</blockquote></div>