<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Hello,</p>
<p>I am operating several OpenStack Ussuri clouds and we lately have
random troubles with the metadata service. We run all our networks
as provider networks. The metadata service works fine for months
some hosts can't get their metadata with a 404 error</p>
<p>I restarted nova-api, neutron-dhcp-agent and
neutron-metadata-agent on all controllers but we still experience
404 on random nodes:</p>
<p>ssh 10.60.51.130<br>
$ ip r s<br>
...<br>
169.254.169.254 via 10.60.51.121 dev eth0<br>
$ curl -s <a class="moz-txt-link-freetext" href="http://169.254.169.254">http://169.254.169.254</a><br>
<html><br>
<head><br>
<title>404 Not Found</title><br>
</head><br>
<body><br>
<h1>404 Not Found</h1><br>
The resource could not be found.<br /><br /><br>
</body><br>
</html><br>
</p>
<div class="moz-signature">ssh 10.60.51.131<br>
$ ip r s<br>
...<br>
169.254.169.254 via 10.60.51.121 dev eth0<br>
$ curl -s <a class="moz-txt-link-freetext" href="http://169.254.169.254">http://169.254.169.254</a></div>
<div class="moz-signature">{"uuid":
"ee6e8dea-796b-4a56-bb1e-1c38f4ac9030", "meta": {"Created By":
"terraform"}...}</div>
<div class="moz-signature"><br>
</div>
<div class="moz-signature">$ grep "10.60.51.131"
/var/log/neutron/neutron-metadata-agent.log<br>
2023-09-22 12:41:10.687 21954 INFO eventlet.wsgi.server [-]
10.60.51.131,<local> "GET /openstack/latest/meta_data.json
HTTP/1.1" status: 200 len: 2729 time: 0.3817778<br>
$ grep "10.60.51.130" /var/log/neutron/neutron-metadata-agent.log</div>
<div class="moz-signature">$ grep "10.60.51.130"
/var/log/nova/nova-api.log # on all controllers<br>
$ grep "10.60.51.131" /var/log/nova/nova-api.log # on all
controllers<br>
2023-09-22 12:41:10.682 57433 INFO nova.metadata.wsgi.server
[req-1d222a75-ccb4-49bc-8b17-2e2e81dc5f9b - - - - -]
10.60.51.131,1.2.3.4 "GET /openstack/latest/meta_data.json
HTTP/1.1" status: 200 len: 2710 time: 0.2587621<br>
</div>
<div class="moz-signature"><br>
</div>
<div class="moz-signature">Can you help me to troubleshoot this
behaviour for some hosts ?</div>
<div class="moz-signature"><br>
</div>
<div class="moz-signature">Regards</div>
<div class="moz-signature">-- <br>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<title></title>
<div class="moz-signature"><b><span style="color:#002060">Jérôme B</span></b><a
href="https://www.deveryware.com"><span
style="font-size:10.0pt;color:#08638F;mso-fareast-language:FR;text-decoration:none"></span></a></div>
</div>
</body>
</html>