<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>After spending some time it seems that it is a problem in the
      instances... but still I don't have a clue: it works when running
      as root and doesn't with other users ...<br>
    </p>
    <div class="moz-cite-prefix">Le 22/09/2023 à 12:49, Jérôme BECOT a
      écrit :<br>
    </div>
    <blockquote type="cite"
      cite="mid:1b4afce6-d860-821c-4909-546e0e8c1729@deveryware.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <p>Hello,</p>
      <p>I am operating several OpenStack Ussuri clouds and we lately
        have random troubles with the metadata service. We run all our
        networks as provider networks. The metadata service works fine
        for months some hosts can't get their metadata with a 404 error</p>
      <p>I restarted nova-api, neutron-dhcp-agent and
        neutron-metadata-agent on all controllers but we still
        experience 404 on random nodes:</p>
      <p>ssh 10.60.51.130<br>
        $ ip r s<br>
        ...<br>
        169.254.169.254 via 10.60.51.121 dev eth0<br>
        $ curl -s <a class="moz-txt-link-freetext"
          href="http://169.254.169.254" moz-do-not-send="true">http://169.254.169.254</a><br>
        <html><br>
         <head><br>
          <title>404 Not Found</title><br>
         </head><br>
         <body><br>
          <h1>404 Not Found</h1><br>
          The resource could not be found.<br /><br /><br>
         </body><br>
        </html><br>
      </p>
      <div class="moz-signature">ssh 10.60.51.131<br>
        $ ip r s<br>
        ...<br>
        169.254.169.254 via 10.60.51.121 dev eth0<br>
        $ curl -s <a class="moz-txt-link-freetext"
          href="http://169.254.169.254" moz-do-not-send="true">http://169.254.169.254</a></div>
      <div class="moz-signature">{"uuid":
        "ee6e8dea-796b-4a56-bb1e-1c38f4ac9030", "meta": {"Created By":
        "terraform"}...}</div>
      <div class="moz-signature"><br>
      </div>
      <div class="moz-signature">$ grep "10.60.51.131"
        /var/log/neutron/neutron-metadata-agent.log<br>
        2023-09-22 12:41:10.687 21954 INFO eventlet.wsgi.server [-]
        10.60.51.131,<local> "GET /openstack/latest/meta_data.json
        HTTP/1.1" status: 200  len: 2729 time: 0.3817778<br>
        $ grep "10.60.51.130"
        /var/log/neutron/neutron-metadata-agent.log</div>
      <div class="moz-signature">$ grep "10.60.51.130"
        /var/log/nova/nova-api.log # on all controllers<br>
        $ grep "10.60.51.131" /var/log/nova/nova-api.log # on all
        controllers<br>
        2023-09-22 12:41:10.682 57433 INFO nova.metadata.wsgi.server
        [req-1d222a75-ccb4-49bc-8b17-2e2e81dc5f9b - - - - -]
        10.60.51.131,1.2.3.4 "GET /openstack/latest/meta_data.json
        HTTP/1.1" status: 200 len: 2710 time: 0.2587621<br>
      </div>
      <div class="moz-signature"><br>
      </div>
      <div class="moz-signature">Can you help me to troubleshoot this
        behaviour for some hosts ?</div>
      <div class="moz-signature"><br>
      </div>
      <div class="moz-signature">Regards</div>
      <div class="moz-signature">-- <br>
        <meta http-equiv="content-type" content="text/html;
          charset=UTF-8">
        <title></title>
        <div class="moz-signature"><b><span style="color:#002060">Jérôme
              B</span></b><a href="https://www.deveryware.com"
            moz-do-not-send="true"><span
style="font-size:10.0pt;color:#08638F;mso-fareast-language:FR;text-decoration:none"></span></a></div>
      </div>
    </blockquote>
    <div class="moz-signature">-- <br>
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <title></title>
      <div class="moz-signature"><b><span style="color:#002060">Jérôme
            BECOT</span></b> <span style="color:#002060"></span><br>
        <span style="color:#002060">Ingénieur DevOps Infrastructure </span><br>
        <br>
        <span style="color:#002060">Téléphone fixe: </span> <span
          style="color:#002060;mso-fareast-language:FR">01 82 28 37 06</span><br>
        <span style="color:#002060">Mobile : +33 757 173 193</span><br>
        <span style="color:#002060">Deveryware - 43 rue Taitbout - 75009
          PARIS</span><br>
        <a moz-do-not-send="true" href="https://www.deveryware.com"> <span
            style="color:#002060"><span tyle="color:#002060">
              https://www.deveryware.com</span></span></a></div>
      <div class="moz-signature"> <span
          style="color:#002060;mso-fareast-language:FR"></span><br>
        <img moz-do-not-send="false"
          src="cid:part1.KFFYh9kl.YtWFOJJz@deveryware.com"
          alt="Deveryware_Logo" width="402" height="107"><br>
        <a href="https://www.deveryware.com"> <span
style="font-size:10.0pt;color:#08638F;mso-fareast-language:FR;text-decoration:none"></span></a></div>
    </div>
  </body>
</html>