<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>Hi Pierre,</p>
    <p>thanks for the quick reply and pointing me in the right
      direction. I used a central local docker registry in the past. Is
      this still the latest documentation:</p>
    <p><a class="moz-txt-link-freetext" href="https://docs.openstack.org/kolla-ansible/latest/user/multinode.html">https://docs.openstack.org/kolla-ansible/latest/user/multinode.html</a><br>
    </p>
    <p>I stopped using it, because I always came across problems where
      it was no longer possible to pull any container images. Just today
      I had this issue without using a local registry: <br>
    </p>
    <p>TASK [service-images-pull : common | Pull images]
***********************************************************************************************************************************************************************************************************************************************************************************************************************************************************<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
      FAILED - RETRYING: common | Pull images (1 retries left).<br>
      FAILED - RETRYING: common | Pull images (1 retries left).<br>
      FAILED - RETRYING: common | Pull images (1 retries left).<br>
      FAILED - RETRYING: common | Pull images (1 retries left).<br>
      FAILED - RETRYING: common | Pull images (1 retries left).<br>
      failed: [gedaopl09] (item=fluentd) => {"ansible_loop_var":
      "item", "attempts": 3, "changed": true, "item": {"key": "fluentd",
      "value": {"container_name": "fluentd", "dimensions": {},
      "enabled": true, "environment": {"KOLLA_CONFIG_STRATEGY":
      "COPY_ALWAYS"}, "group": "fluentd", "image":
      "quay.io/openstack.kolla/fluentd:yoga-centos-stream8", "volumes":
      ["/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro",
      "/etc/localtime:/etc/localtime:ro", "",
      "kolla_logs:/var/log/kolla/",
      "fluentd_<a class="moz-txt-link-freetext" href="data:/var/lib/fluentd/data/">data:/var/lib/fluentd/data/</a>"]}}, "msg": "'Traceback (most
      recent call last):\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 268, in _raise_for_status\\n   
      response.raise_for_status()\\n  File
      \"/usr/lib/python3.6/site-packages/requests/models.py\", line 940,
      in raise_for_status\\n    raise HTTPError(http_error_msg,
      response=self)\\nrequests.exceptions.HTTPError: 404 Client Error:
      Not Found for url:
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd\\n\\nDuring
      handling of the above exception, another exception
      occurred:\\n\\nTraceback (most recent call last):\\n  File
\"/tmp/ansible_kolla_docker_payload_w20pu6xy/ansible_kolla_docker_payload.zip/ansible/modules/kolla_docker.py\",
      line 381, in main\\n  File
\"/tmp/ansible_kolla_docker_payload_w20pu6xy/ansible_kolla_docker_payload.zip/ansible/module_utils/kolla_docker_worker.py\",
      line 451, in pull_image\\n    repository=image, tag=tag,
      stream=True\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/image.py\",
      line 430, in pull\\n    self._raise_for_status(response)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 270, in _raise_for_status\\n    raise
      create_api_error_from_http_exception(e)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/errors.py\", line
      31, in create_api_error_from_http_exception\\n    raise cls(e,
      response=response,
      explanation=explanation)\\ndocker.errors.NotFound: 404 Client
      Error for
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd:
      Not Found (\"manifest for
      quay.io/openstack.kolla/fluentd:yoga-centos-stream8 not found:
      manifest unknown: manifest unknown\")\\n'"}<br>
      failed: [gedaopl11] (item=fluentd) => {"ansible_loop_var":
      "item", "attempts": 3, "changed": true, "item": {"key": "fluentd",
      "value": {"container_name": "fluentd", "dimensions": {},
      "enabled": true, "environment": {"KOLLA_CONFIG_STRATEGY":
      "COPY_ALWAYS"}, "group": "fluentd", "image":
      "quay.io/openstack.kolla/fluentd:yoga-centos-stream8", "volumes":
      ["/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro",
      "/etc/localtime:/etc/localtime:ro", "",
      "kolla_logs:/var/log/kolla/",
      "fluentd_<a class="moz-txt-link-freetext" href="data:/var/lib/fluentd/data/">data:/var/lib/fluentd/data/</a>"]}}, "msg": "'Traceback (most
      recent call last):\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 268, in _raise_for_status\\n   
      response.raise_for_status()\\n  File
      \"/usr/lib/python3.6/site-packages/requests/models.py\", line 940,
      in raise_for_status\\n    raise HTTPError(http_error_msg,
      response=self)\\nrequests.exceptions.HTTPError: 404 Client Error:
      Not Found for url:
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd\\n\\nDuring
      handling of the above exception, another exception
      occurred:\\n\\nTraceback (most recent call last):\\n  File
\"/tmp/ansible_kolla_docker_payload_xgz79c_7/ansible_kolla_docker_payload.zip/ansible/modules/kolla_docker.py\",
      line 381, in main\\n  File
\"/tmp/ansible_kolla_docker_payload_xgz79c_7/ansible_kolla_docker_payload.zip/ansible/module_utils/kolla_docker_worker.py\",
      line 451, in pull_image\\n    repository=image, tag=tag,
      stream=True\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/image.py\",
      line 430, in pull\\n    self._raise_for_status(response)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 270, in _raise_for_status\\n    raise
      create_api_error_from_http_exception(e)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/errors.py\", line
      31, in create_api_error_from_http_exception\\n    raise cls(e,
      response=response,
      explanation=explanation)\\ndocker.errors.NotFound: 404 Client
      Error for
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd:
      Not Found (\"manifest for
      quay.io/openstack.kolla/fluentd:yoga-centos-stream8 not found:
      manifest unknown: manifest unknown\")\\n'"}<br>
      failed: [gedaopl04] (item=fluentd) => {"ansible_loop_var":
      "item", "attempts": 3, "changed": true, "item": {"key": "fluentd",
      "value": {"container_name": "fluentd", "dimensions": {},
      "enabled": true, "environment": {"KOLLA_CONFIG_STRATEGY":
      "COPY_ALWAYS"}, "group": "fluentd", "image":
      "quay.io/openstack.kolla/fluentd:yoga-centos-stream8", "volumes":
      ["/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro",
      "/etc/localtime:/etc/localtime:ro", "",
      "kolla_logs:/var/log/kolla/",
      "fluentd_<a class="moz-txt-link-freetext" href="data:/var/lib/fluentd/data/">data:/var/lib/fluentd/data/</a>"]}}, "msg": "'Traceback (most
      recent call last):\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 268, in _raise_for_status\\n   
      response.raise_for_status()\\n  File
      \"/usr/lib/python3.6/site-packages/requests/models.py\", line 940,
      in raise_for_status\\n    raise HTTPError(http_error_msg,
      response=self)\\nrequests.exceptions.HTTPError: 404 Client Error:
      Not Found for url:
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd\\n\\nDuring
      handling of the above exception, another exception
      occurred:\\n\\nTraceback (most recent call last):\\n  File
\"/tmp/ansible_kolla_docker_payload_1petvtop/ansible_kolla_docker_payload.zip/ansible/modules/kolla_docker.py\",
      line 381, in main\\n  File
\"/tmp/ansible_kolla_docker_payload_1petvtop/ansible_kolla_docker_payload.zip/ansible/module_utils/kolla_docker_worker.py\",
      line 451, in pull_image\\n    repository=image, tag=tag,
      stream=True\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/image.py\",
      line 430, in pull\\n    self._raise_for_status(response)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 270, in _raise_for_status\\n    raise
      create_api_error_from_http_exception(e)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/errors.py\", line
      31, in create_api_error_from_http_exception\\n    raise cls(e,
      response=response,
      explanation=explanation)\\ndocker.errors.NotFound: 404 Client
      Error for
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd:
      Not Found (\"manifest for
      quay.io/openstack.kolla/fluentd:yoga-centos-stream8 not found:
      manifest unknown: manifest unknown\")\\n'"}<br>
      failed: [gedaopl07] (item=fluentd) => {"ansible_loop_var":
      "item", "attempts": 3, "changed": true, "item": {"key": "fluentd",
      "value": {"container_name": "fluentd", "dimensions": {},
      "enabled": true, "environment": {"KOLLA_CONFIG_STRATEGY":
      "COPY_ALWAYS"}, "group": "fluentd", "image":
      "quay.io/openstack.kolla/fluentd:yoga-centos-stream8", "volumes":
      ["/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro",
      "/etc/localtime:/etc/localtime:ro", "",
      "kolla_logs:/var/log/kolla/",
      "fluentd_<a class="moz-txt-link-freetext" href="data:/var/lib/fluentd/data/">data:/var/lib/fluentd/data/</a>"]}}, "msg": "'Traceback (most
      recent call last):\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 268, in _raise_for_status\\n   
      response.raise_for_status()\\n  File
      \"/usr/lib/python3.6/site-packages/requests/models.py\", line 940,
      in raise_for_status\\n    raise HTTPError(http_error_msg,
      response=self)\\nrequests.exceptions.HTTPError: 404 Client Error:
      Not Found for url:
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd\\n\\nDuring
      handling of the above exception, another exception
      occurred:\\n\\nTraceback (most recent call last):\\n  File
\"/tmp/ansible_kolla_docker_payload_uzj0wg5e/ansible_kolla_docker_payload.zip/ansible/modules/kolla_docker.py\",
      line 381, in main\\n  File
\"/tmp/ansible_kolla_docker_payload_uzj0wg5e/ansible_kolla_docker_payload.zip/ansible/module_utils/kolla_docker_worker.py\",
      line 451, in pull_image\\n    repository=image, tag=tag,
      stream=True\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/image.py\",
      line 430, in pull\\n    self._raise_for_status(response)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 270, in _raise_for_status\\n    raise
      create_api_error_from_http_exception(e)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/errors.py\", line
      31, in create_api_error_from_http_exception\\n    raise cls(e,
      response=response,
      explanation=explanation)\\ndocker.errors.NotFound: 404 Client
      Error for
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd:
      Not Found (\"manifest for
      quay.io/openstack.kolla/fluentd:yoga-centos-stream8 not found:
      manifest unknown: manifest unknown\")\\n'"}<br>
      failed: [gedaopl10] (item=fluentd) => {"ansible_loop_var":
      "item", "attempts": 3, "changed": true, "item": {"key": "fluentd",
      "value": {"container_name": "fluentd", "dimensions": {},
      "enabled": true, "environment": {"KOLLA_CONFIG_STRATEGY":
      "COPY_ALWAYS"}, "group": "fluentd", "image":
      "quay.io/openstack.kolla/fluentd:yoga-centos-stream8", "volumes":
      ["/etc/kolla/fluentd/:/var/lib/kolla/config_files/:ro",
      "/etc/localtime:/etc/localtime:ro", "",
      "kolla_logs:/var/log/kolla/",
      "fluentd_<a class="moz-txt-link-freetext" href="data:/var/lib/fluentd/data/">data:/var/lib/fluentd/data/</a>"]}}, "msg": "'Traceback (most
      recent call last):\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 268, in _raise_for_status\\n   
      response.raise_for_status()\\n  File
      \"/usr/lib/python3.6/site-packages/requests/models.py\", line 940,
      in raise_for_status\\n    raise HTTPError(http_error_msg,
      response=self)\\nrequests.exceptions.HTTPError: 404 Client Error:
      Not Found for url:
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd\\n\\nDuring
      handling of the above exception, another exception
      occurred:\\n\\nTraceback (most recent call last):\\n  File
\"/tmp/ansible_kolla_docker_payload_a6kiyuhn/ansible_kolla_docker_payload.zip/ansible/modules/kolla_docker.py\",
      line 381, in main\\n  File
\"/tmp/ansible_kolla_docker_payload_a6kiyuhn/ansible_kolla_docker_payload.zip/ansible/module_utils/kolla_docker_worker.py\",
      line 451, in pull_image\\n    repository=image, tag=tag,
      stream=True\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/image.py\",
      line 430, in pull\\n    self._raise_for_status(response)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/api/client.py\",
      line 270, in _raise_for_status\\n    raise
      create_api_error_from_http_exception(e)\\n  File
      \"/usr/local/lib/python3.6/site-packages/docker/errors.py\", line
      31, in create_api_error_from_http_exception\\n    raise cls(e,
      response=response,
      explanation=explanation)\\ndocker.errors.NotFound: 404 Client
      Error for
http+docker://localhost/v1.41/images/create?tag=yoga-centos-stream8&fromImage=quay.io%2Fopenstack.kolla%2Ffluentd:
      Not Found (\"manifest for
      quay.io/openstack.kolla/fluentd:yoga-centos-stream8 not found:
      manifest unknown: manifest unknown\")\\n'"}<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (3 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
      FAILED - RETRYING: common | Pull images (2 retries left).<br>
    </p>
    <p>I'm on release Yoga and for some weird reason, I found the
      suggestion to change release yoga to master in
      /etc/kolla/globals.yaml. And this works. Any ideas why?<br>
    </p>
    <div class="moz-cite-prefix">Am 02.09.2022 um 14:19 schrieb Pierre
      Riteau:<br>
    </div>
    <blockquote type="cite"
cite="mid:CA+ny2sxsT-8sidbDu3jGdD8FyDp3Qin2nvRgyh7ohn3Y843r2Q@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr">
        <div dir="ltr">Hi Oliver,
          <div><br>
          </div>
          <div>The Kolla Ansible documentation describes how to
            configure Docker to use a proxy: <a
href="https://docs.openstack.org/kolla-ansible/latest/reference/deployment-and-bootstrapping/bootstrap-servers.html#configuration"
              moz-do-not-send="true" class="moz-txt-link-freetext">https://docs.openstack.org/kolla-ansible/latest/reference/deployment-and-bootstrapping/bootstrap-servers.html#configuration</a></div>
          <div>This feature was introduced in Wallaby.</div>
          <div><br>
          </div>
          <div>Additionally, I suggest you configure a local Docker
            registry and use it to fetch container images. The same
            documentation page describes related variables.</div>
          <div><br>
          </div>
          <div>Cheers,</div>
          <div>Pierre Riteau (priteau)</div>
        </div>
        <br>
        <div class="gmail_quote">
          <div dir="ltr" class="gmail_attr">On Fri, 2 Sept 2022 at
            13:33, Oliver Weinmann <<a
              href="mailto:oliver.weinmann@me.com"
              moz-do-not-send="true" class="moz-txt-link-freetext">oliver.weinmann@me.com</a>>
            wrote:<br>
          </div>
          <blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">Hi,<br>
            <br>
            I was wondering if there is a way to set a http proxy in
            kolla-ansible <br>
            during deployment / update etc. Today I wanted to pull new
            containers <br>
            and this saturates our internet connection. What we usually
            do is have <br>
            machine that massively download stuff from the internet use
            a squid <br>
            proxy that throttles their bandwidth.<br>
            <br>
            I found the following feature request:<br>
            <br>
            <a
              href="https://bugs.launchpad.net/kolla-ansible/+bug/1829586"
              rel="noreferrer" target="_blank" moz-do-not-send="true"
              class="moz-txt-link-freetext">https://bugs.launchpad.net/kolla-ansible/+bug/1829586</a><br>
            <br>
            And it seems some work had been done, but I can't seem to
            find any info <br>
            if the change really made it into production:<br>
            <br>
            <a
              href="https://review.opendev.org/c/openstack/kolla-ansible/+/692006/"
              rel="noreferrer" target="_blank" moz-do-not-send="true"
              class="moz-txt-link-freetext">https://review.opendev.org/c/openstack/kolla-ansible/+/692006/</a><br>
            <br>
            Any help or hints are highly appreciated.<br>
            <br>
            Cheers,<br>
            <br>
            Oliver<br>
            <br>
            <br>
            <br>
          </blockquote>
        </div>
      </div>
    </blockquote>
  </body>
</html>