<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>You should set this up like the example given previously by James
      Denton, with the variables set in user-variables.yml, not in
      openstack-user-config.yml.</p>
    <p>For reference we run a CI job that tests glance+NFS and the
      configuration used in that is here
<a class="moz-txt-link-freetext" href="https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/templates/user_variables_nfs.yml.j2">https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/templates/user_variables_nfs.yml.j2</a>.
      You would be able to reproduce that using an all-in-one setup by
      adding 'nfs' to the SCENARIO environment variable.<br>
    </p>
    <p>If you enable debug on a service and want to watch the log, you
      can use journalctl -fu <unit-name>, it should not be
      necessary to specifically run it in the foreground.</p>
    <p>Hope this helps,<br>
      Jonathan.<br>
    </p>
    <div class="moz-cite-prefix">On 03/08/2022 15:35, Dave Hall wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CAPg_kBa5UiH0dR5q32oMpt6x-qkDLDZg_AXd4dAS5YaH3dUgjQ@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr">
        <div>Hello,</div>
        <div><br>
        </div>
        <div>(Any help on this would be greatly appreciated.  I've been
          chasing this for 2 weeks now...)<br>
        </div>
        <div><br>
        </div>
        <div>I posted the other day that I had solved this issue, but
          now it's back.  The primary glance-api error message is:<br>
        </div>
        <div><br>
        </div>
        <div>Error in store configuration. Adding images to store is
          disabled.</div>
        <div><br>
        </div>
        <div>So why is my store disabled?  Is there some command or
          config line that controls this?  Shouldn't the store be
          enabled by default?</div>
        <div><br>
        </div>
        <div>The relevant stanza in my openstack-user-config.yml is</div>
        <div><br>
        </div>
        <div style="margin-left:40px">image_hosts:<br>
          #  infra38:<br>
          #    ip: 172.29.236.38<br>
          #    container_vars:<br>
          #      limit_container_types: glance<br>
          #      glance_remote_client:<br>
          #        - what: "172.29.244.27:/images"<br>
          #          where: "/var/lib/glance/images"<br>
          #          type: "nfs"<br>
          #          options: "_netdev,vers=3,proto=tcp,sec=sys"<br>
          <br>
            infra38:<br>
              ip: 172.29.236.38<br>
              container_vars:<br>
                glance_default_store: file<br>
                glance_nfs_local_directory: "images"<br>
                glance_nfs_client:<br>
                  - server: "172.29.244.27"<br>
                    remote_path: "/images"<br>
                    local_path: "/var/lib/glance/images"<br>
                    type: "nfs"<br>
                    options:
          "_netdev,vers=3,proto=tcp,sec=sys,noauto,user"<br>
                    config_overrides: "{}"<br>
        </div>
        <div><br>
        </div>
        <div>The stanza that's commented out produced the same result. 
          My user_variables.yaml does not have any lines pertaining to
          glance.  Also, I've removed the stanzas for the other 2 infra
          hosts.</div>
        <div><br>
        </div>
        <div>The glance-api.conf file from the container is:</div>
        <div><br>
        </div>
        <div style="margin-left:40px">[DEFAULT]<br>
          # Disable stderr logging<br>
          use_stderr = False<br>
          debug = False<br>
          use_journal = True<br>
          fatal_deprecations = False<br>
          bind_host = 172.29.238.205<br>
          bind_port = 9292<br>
          http_keepalive = True<br>
          digest_algorithm = sha256<br>
          backlog = 4096<br>
          workers = 16<br>
          cinder_catalog_info = volumev3:cinderv3:internalURL<br>
          enable_v2_api = True<br>
          transport_url = rabbit://<a
href="http://glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.238.84:5671"
            moz-do-not-send="true">glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.238.84:5671</a>,<a
href="http://glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.238.174:5671"
            moz-do-not-send="true">glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.238.174:5671</a>,<a
href="http://glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.239.33:5671//glance?ssl=1&ssl_version=TLSv1_2&ssl_ca_file="
            moz-do-not-send="true">glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.239.33:5671//glance?ssl=1&ssl_version=TLSv1_2&ssl_ca_file=</a><br>
          scrub_time = 43200<br>
          image_cache_dir = /var/lib/glance/cache/<br>
          image_cache_stall_time = 86400<br>
          image_cache_max_size = 10737418240<br>
          # defaults to true if RBD is used as default store<br>
          show_image_direct_url = False<br>
          show_multiple_locations = True<br>
          enabled_backends = <a class="moz-txt-link-freetext" href="file:file,http:http,cinder:cinder">file:file,http:http,cinder:cinder</a><br>
          <br>
          [task]<br>
          task_executor = taskflow<br>
          <br>
          [database]<br>
          connection = mysql+pymysql://<a
href="http://glance:e6dd6f2ca946c9e6f72bb864387a@172.29.236.36/glance?charset=utf8&ssl_verify_cert=true"
            moz-do-not-send="true">glance:e6dd6f2ca946c9e6f72bb864387a@172.29.236.36/glance?charset=utf8&ssl_verify_cert=true</a><br>
          max_overflow = 50<br>
          max_pool_size = 5<br>
          pool_timeout = 30<br>
          connection_recycle_time = 600<br>
          <br>
          [keystone_authtoken]<br>
          insecure = False<br>
          auth_type = password<br>
          auth_url = <a href="http://172.29.236.36:5000/v3"
            moz-do-not-send="true" class="moz-txt-link-freetext">http://172.29.236.36:5000/v3</a><br>
          www_authenticate_uri = <a href="http://172.29.236.36:5000"
            moz-do-not-send="true" class="moz-txt-link-freetext">http://172.29.236.36:5000</a><br>
          project_domain_id = default<br>
          user_domain_id = default<br>
          project_name = service<br>
          username = glance<br>
          password = c96a36e76208ee26851c78670d34dcaff1c870<br>
          region_name = RegionOne<br>
          service_token_roles_required = False<br>
          service_token_roles = service<br>
          service_type = image<br>
          memcached_servers = <a href="http://172.29.239.168:11211"
            moz-do-not-send="true">172.29.239.168:11211</a>,<a
            href="http://172.29.239.242:11211" moz-do-not-send="true">172.29.239.242:11211</a>,<a
            href="http://172.29.236.80:11211" moz-do-not-send="true">172.29.236.80:11211</a><br>
          token_cache_time = 300<br>
          # if your memcached server is shared, use these settings to
          avoid cache poisoning<br>
          memcache_security_strategy = ENCRYPT<br>
          memcache_secret_key = 0b65b4b99155a6430e923fc9c24d9674<br>
          <br>
          [oslo_policy]<br>
          policy_file = policy.yaml<br>
          policy_default_rule = default<br>
          policy_dirs = policy.d<br>
          <br>
          [oslo_messaging_notifications]<br>
          topics = notifications<br>
          driver = messagingv2<br>
          transport_url = rabbit://<a
href="http://glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.238.84:5671"
            moz-do-not-send="true">glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.238.84:5671</a>,<a
href="http://glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.238.174:5671"
            moz-do-not-send="true">glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.238.174:5671</a>,<a
href="http://glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.239.33:5671//glance?ssl=1&ssl_version=TLSv1_2&ssl_ca_file="
            moz-do-not-send="true">glance:9e7f205ef620983a542b4f915420e50d33f774@172.29.239.33:5671//glance?ssl=1&ssl_version=TLSv1_2&ssl_ca_file=</a><br>
          <br>
          [paste_deploy]<br>
          flavor = keystone+cachemanagement<br>
          <br>
          [glance_store]<br>
          default_backend = file<br>
          <br>
          [file]<br>
          filesystem_store_datadir = /var/lib/glance/images/<br>
          <br>
          [profiler]<br>
          enabled = False<br>
          <br>
          [oslo_middleware]<br>
          enable_proxy_headers_parsing = True<br>
          <br>
          [cors]<br>
          allow_headers =
origin,content-md5,x-image-meta-checksum,x-storage-token,accept-encoding,x-auth-token,x-identity-status,x-roles,x-service-catalog,x-user-id,x-tenant-id,x-openstack-request-id<br>
          allow_methods = GET,POST,PUT,PATCH,DELETE<br>
          allowed_origin = <a
            href="https://osa-portal.cs.binghamton.edu"
            moz-do-not-send="true" class="moz-txt-link-freetext">https://osa-portal.cs.binghamton.edu</a></div>
        <div><br>
        </div>
        <div>I'd be glad to run glance-api in the foreground with debug
          (in the container, or course), but it's not obvious from the
          .service file how to do that.  I'd be glad to read source
          code, but a pointer or two would be handy.  If NFS (or Hao's
          GPFS) just aren't supported anymore please tell me.</div>
        <div><br>
        </div>
        <div>Thanks.</div>
        <div><br>
        </div>
        <div>-Dave<br>
        </div>
        <div>
          <div><br>
          </div>
          <div>
            <div dir="ltr" class="gmail_signature"
              data-smartmail="gmail_signature">
              <div dir="ltr">
                <div>--</div>
                <div>Dave Hall<br>
                  Binghamton University<br>
                  <a href="mailto:kdhall@binghamton.edu" target="_blank"
                    moz-do-not-send="true" class="moz-txt-link-freetext">kdhall@binghamton.edu</a><br>
                  <br>
                </div>
              </div>
            </div>
          </div>
        </div>
      </div>
    </blockquote>
  </body>
</html>