<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>It finally turned out that the impacted machines deployed a proxy
configuration that is loaded in the environment. We added an
exception for 169.254.169.254 and it now works fine.</p>
<p>Regards<br>
</p>
<div class="moz-cite-prefix">Le 22/09/2023 à 13:41, Jérôme BECOT a
écrit :<br>
</div>
<blockquote type="cite"
cite="mid:6c2c4707-27e8-0459-1367-94e0b3c3274e@deveryware.com">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<p>After spending some time it seems that it is a problem in the
instances... but still I don't have a clue: it works when
running as root or sudo and doesn't with regular users ...<br>
</p>
<div class="moz-cite-prefix">Le 22/09/2023 à 12:49, Jérôme BECOT a
écrit :<br>
</div>
<blockquote type="cite"
cite="mid:1b4afce6-d860-821c-4909-546e0e8c1729@deveryware.com">
<meta http-equiv="content-type" content="text/html;
charset=UTF-8">
<p>Hello,</p>
<p>I am operating several OpenStack Ussuri clouds and we lately
have random troubles with the metadata service. We run all our
networks as provider networks. The metadata service works fine
for months some hosts can't get their metadata with a 404
error</p>
<p>I restarted nova-api, neutron-dhcp-agent and
neutron-metadata-agent on all controllers but we still
experience 404 on random nodes:</p>
<p>ssh 10.60.51.130<br>
$ ip r s<br>
...<br>
169.254.169.254 via 10.60.51.121 dev eth0<br>
$ curl -s <a class="moz-txt-link-freetext"
href="http://169.254.169.254" moz-do-not-send="true">http://169.254.169.254</a><br>
<html><br>
<head><br>
<title>404 Not Found</title><br>
</head><br>
<body><br>
<h1>404 Not Found</h1><br>
The resource could not be found.<br /><br /><br>
</body><br>
</html><br>
</p>
<div class="moz-signature">ssh 10.60.51.131<br>
$ ip r s<br>
...<br>
169.254.169.254 via 10.60.51.121 dev eth0<br>
$ curl -s <a class="moz-txt-link-freetext"
href="http://169.254.169.254" moz-do-not-send="true">http://169.254.169.254</a></div>
<div class="moz-signature">{"uuid":
"ee6e8dea-796b-4a56-bb1e-1c38f4ac9030", "meta": {"Created By":
"terraform"}...}</div>
<div class="moz-signature"><br>
</div>
<div class="moz-signature">$ grep "10.60.51.131"
/var/log/neutron/neutron-metadata-agent.log<br>
2023-09-22 12:41:10.687 21954 INFO eventlet.wsgi.server [-]
10.60.51.131,<local> "GET
/openstack/latest/meta_data.json HTTP/1.1" status: 200 len:
2729 time: 0.3817778<br>
$ grep "10.60.51.130"
/var/log/neutron/neutron-metadata-agent.log</div>
<div class="moz-signature">$ grep "10.60.51.130"
/var/log/nova/nova-api.log # on all controllers<br>
$ grep "10.60.51.131" /var/log/nova/nova-api.log # on all
controllers<br>
2023-09-22 12:41:10.682 57433 INFO nova.metadata.wsgi.server
[req-1d222a75-ccb4-49bc-8b17-2e2e81dc5f9b - - - - -]
10.60.51.131,1.2.3.4 "GET /openstack/latest/meta_data.json
HTTP/1.1" status: 200 len: 2710 time: 0.2587621<br>
</div>
<div class="moz-signature"><br>
</div>
<div class="moz-signature">Can you help me to troubleshoot this
behaviour for some hosts ?</div>
<div class="moz-signature"><br>
</div>
<div class="moz-signature">Regards</div>
<div class="moz-signature">-- <br>
<meta http-equiv="content-type" content="text/html;
charset=UTF-8">
<title></title>
<div class="moz-signature"><b><span style="color:#002060">Jérôme
B</span></b><a href="https://www.deveryware.com"
moz-do-not-send="true"><span
style="font-size:10.0pt;color:#08638F;mso-fareast-language:FR;text-decoration:none"></span></a></div>
</div>
</blockquote>
</blockquote>
<div class="moz-signature"> </div>
</body>
</html>