<div dir="ltr"><div id="gmail-:qo" class="gmail-Am gmail-aO9 gmail-Al editable gmail-LW-avf gmail-tS-tW gmail-tS-tY" aria-label="Message Body" role="textbox" aria-multiline="true" tabindex="1" style="direction:ltr;min-height:85px" aria-controls=":31s">Hello,<div><br></div><div>IIUC, you are running this from the guest instance, to see the metadata of this instance,</div><div>but in your working example, you get it without full URI, i.e. /opestack/latest/metadata.json.</div><div><br></div><div>Its 400, Can you please try $ curl <a href="http://169.254.169.254/openstack" target="_blank">169.254.169.254/openstack</a> once, along with ovn-metadata-agent.log check for nova-metadata-api logs as well to see what request went.<br></div><div><br></div><div>Also, can you tell how your setup is deployed? such as tripleO or killa-ansible, etc..</div><div><br></div><div><br></div><div>Regards</div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Sep 22, 2023 at 5:19 PM Jérôme BECOT <<a href="mailto:jerome.becot@deveryware.com">jerome.becot@deveryware.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<p>After spending some time it seems that it is a problem in the
instances... but still I don't have a clue: it works when running
as root or sudo and doesn't with regular users ...<br>
</p>
<div>Le 22/09/2023 à 12:49, Jérôme BECOT a
écrit :<br>
</div>
<blockquote type="cite">
<p>Hello,</p>
<p>I am operating several OpenStack Ussuri clouds and we lately
have random troubles with the metadata service. We run all our
networks as provider networks. The metadata service works fine
for months some hosts can't get their metadata with a 404 error</p>
<p>I restarted nova-api, neutron-dhcp-agent and
neutron-metadata-agent on all controllers but we still
experience 404 on random nodes:</p>
<p>ssh 10.60.51.130<br>
$ ip r s<br>
...<br>
169.254.169.254 via 10.60.51.121 dev eth0<br>
$ curl -s <a href="http://169.254.169.254" target="_blank">http://169.254.169.254</a><br>
<html><br>
<head><br>
<title>404 Not Found</title><br>
</head><br>
<body><br>
<h1>404 Not Found</h1><br>
The resource could not be found.<br /><br /><br>
</body><br>
</html><br>
</p>
<div>ssh 10.60.51.131<br>
$ ip r s<br>
...<br>
169.254.169.254 via 10.60.51.121 dev eth0<br>
$ curl -s <a href="http://169.254.169.254" target="_blank">http://169.254.169.254</a></div>
<div>{"uuid":
"ee6e8dea-796b-4a56-bb1e-1c38f4ac9030", "meta": {"Created By":
"terraform"}...}</div>
<div><br>
</div>
<div>$ grep "10.60.51.131"
/var/log/neutron/neutron-metadata-agent.log<br>
2023-09-22 12:41:10.687 21954 INFO eventlet.wsgi.server [-]
10.60.51.131,<local> "GET /openstack/latest/meta_data.json
HTTP/1.1" status: 200 len: 2729 time: 0.3817778<br>
$ grep "10.60.51.130"
/var/log/neutron/neutron-metadata-agent.log</div>
<div>$ grep "10.60.51.130"
/var/log/nova/nova-api.log # on all controllers<br>
$ grep "10.60.51.131" /var/log/nova/nova-api.log # on all
controllers<br>
2023-09-22 12:41:10.682 57433 INFO nova.metadata.wsgi.server
[req-1d222a75-ccb4-49bc-8b17-2e2e81dc5f9b - - - - -]
10.60.51.131,1.2.3.4 "GET /openstack/latest/meta_data.json
HTTP/1.1" status: 200 len: 2710 time: 0.2587621<br>
</div>
<div><br>
</div>
<div>Can you help me to troubleshoot this
behaviour for some hosts ?</div>
<div><br>
</div>
<div>Regards</div>
<div>-- <br>
<div><b><span style="color:rgb(0,32,96)">Jérôme
B</span></b><a href="https://www.deveryware.com" target="_blank"><span style="font-size:10pt;color:rgb(8,99,143);text-decoration:none"></span></a></div>
</div>
</blockquote>
<div> </div>
</div>
</blockquote></div>