Seek help for glance error "Configuration for store failed. Adding images to this store is disabled"
Hi folks, I am using a glance config like this to leverage IBM gpfs backend to store image, however, when upload images openstack image create --file rhel-8.5-official.qcow2 test1, I ran into the following error. Any idea or suggestion for fixing the error? Thanks ============================== [glance_store] default_backend = filesystem enabled_backends = filesystem filesystem_store_datadir = /foundation_gpfs2/icic/images/ filesystem_store_file_perm = 0644 ============================== ========================================================================================== 2022-08-01 10:18:43.590 3663156 INFO glance_store.capabilities [req-2c007ca2-a0c4-4a31-a94d-43f0f25cb2cc 0688b01e6439ca32d698d20789d52169126fb41fb1a4ddafcebb97d854e836c9 b334d58126ee4193bc439ea0cb806aaa - default default] haojuedebug req_cap: [<BitMasks.WRITE_ACCESS: 8>] 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data [req-2c007ca2-a0c4-4a31-a94d-43f0f25cb2cc 0688b01e6439ca32d698d20789d52169126fb41fb1a4ddafcebb97d854e836c9 b334d58126ee4193bc439ea0cb806aaa - default default] Error in store configuration. Adding images to store is disabled.: glance_store.exceptions.StoreAddDisabled: Configuration for store failed. Adding images to this store is disabled. 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data Traceback (most recent call last): 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/api/v2/image_data.py", line 182, in upload 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image.set_data(data, size, backend=backend) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/domain/proxy.py", line 198, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self.base.set_data(data, size, backend=backend, set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/notifier.py", line 501, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data _send_notification(notify_error, 'image.upload', msg) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self.force_reraise() 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data six.reraise(self.type_, self.value, self.tb) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/six.py", line 703, in reraise 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data raise value 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/notifier.py", line 448, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/api/policy.py", line 204, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data return self.image.set_data(*args, **kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/quota/__init__.py", line 319, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/location.py", line 559, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self._upload_to_store(data, verifier, backend, size) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/location.py", line 486, in _upload_to_store 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data verifier=verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/backend.py", line 491, in add_to_backend_with_multihash 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image_id, data, size, hashing_algo, store, context, verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/backend.py", line 468, in store_add_to_backend_with_multihash 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image_id, data, size, hashing_algo, context=context, verifier=verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/driver.py", line 279, in add_adapter 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data metadata_dict) = store_add_fun(*args, **kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/capabilities.py", line 175, in op_checker 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data raise op_exec_map[op](**kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data glance_store.exceptions.StoreAddDisabled: Configuration for store failed. Adding images to this store is disabled. 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data ==========================================================================================
Hao, I am seeing the same error right now, but using NFS for my Image store. Perhaps the issue is not with the storage backend, but with some other part of the setup? I have not seen any instructions indicating that it might be necessary to enable the store once it is created. -Dave -- Dave Hall Binghamton University kdhall@binghamton.edu On Mon, Aug 1, 2022 at 9:04 AM Hao Jue PX Wang <wghaojue@cn.ibm.com> wrote:
Hi folks,
I am using a glance config like this to leverage IBM gpfs backend to store image, however, when upload images openstack image create --file rhel-8.5-official.qcow2 test1, I ran into the following error. Any idea or suggestion for fixing the error? Thanks
============================== [glance_store] default_backend = filesystem enabled_backends = filesystem filesystem_store_datadir = /foundation_gpfs2/icic/images/ filesystem_store_file_perm = 0644 ==============================
========================================================================================== 2022-08-01 10:18:43.590 3663156 INFO glance_store.capabilities [req-2c007ca2-a0c4-4a31-a94d-43f0f25cb2cc 0688b01e6439ca32d698d20789d52169126fb41fb1a4ddafcebb97d854e836c9 b334d58126ee4193bc439ea0cb806aaa - default default] haojuedebug req_cap: [<BitMasks.WRITE_ACCESS: 8>] 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data [req-2c007ca2-a0c4-4a31-a94d-43f0f25cb2cc 0688b01e6439ca32d698d20789d52169126fb41fb1a4ddafcebb97d854e836c9 b334d58126ee4193bc439ea0cb806aaa - default default] Error in store configuration. Adding images to store is disabled.: glance_store.exceptions.StoreAddDisabled: Configuration for store failed. Adding images to this store is disabled. 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data Traceback (most recent call last): 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/api/v2/image_data.py", line 182, in upload 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image.set_data(data, size, backend=backend) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/domain/proxy.py", line 198, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self.base.set_data(data, size, backend=backend, set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/notifier.py", line 501, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data _send_notification(notify_error, 'image.upload', msg) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self.force_reraise() 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data six.reraise(self.type_, self.value, self.tb) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/six.py", line 703, in reraise 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data raise value 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/notifier.py", line 448, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/api/policy.py", line 204, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data return self.image.set_data(*args, **kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/quota/__init__.py", line 319, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/location.py", line 559, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self._upload_to_store(data, verifier, backend, size) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/location.py", line 486, in _upload_to_store 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data verifier=verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/backend.py", line 491, in add_to_backend_with_multihash 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image_id, data, size, hashing_algo, store, context, verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/backend.py", line 468, in store_add_to_backend_with_multihash 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image_id, data, size, hashing_algo, context=context, verifier=verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/driver.py", line 279, in add_adapter 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data metadata_dict) = store_add_fun(*args, **kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/capabilities.py", line 175, in op_checker 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data raise op_exec_map[op](**kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data glance_store.exceptions.StoreAddDisabled: Configuration for store failed. Adding images to this store is disabled. 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data
==========================================================================================
Hi Dave, Thanks for reply! I think the path setup is fine, I was wonder how glance determines the store is disabled or not? I found req_cap's value is [<BitMasks.WRITE_ACCESS: 8>] in `if not store.is_capable(*req_cap):` of glance_store/capabilities.py. here is our gpfs sytem which is used: foundation_gpfs2 100G 67G 34G 67% /foundation_gpfs2 and here is the path which is used to store image: drwxrwxrwx. 2 glance glance system_u:object_r:glance_var_lib_t:s0 4096 Jul 29 10:36 images ________________________________ 发件人: Dave Hall <kdhall@binghamton.edu> 发送时间: 2022年8月1日 21:57 收件人: Hao Jue PX Wang <wghaojue@cn.ibm.com> 抄送: openstack-discuss@lists.openstack.org <openstack-discuss@lists.openstack.org> 主题: [EXTERNAL] Re: Seek help for glance error "Configuration for store failed. Adding images to this store is disabled" Hao, I am seeing the same error right now, but using NFS for my Image store. Perhaps the issue is not with the storage backend, but with some other part of the setup? I have not seen any instructions indicating that it might be necessary ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hao, I am seeing the same error right now, but using NFS for my Image store. Perhaps the issue is not with the storage backend, but with some other part of the setup? I have not seen any instructions indicating that it might be necessary to enable the store once it is created. -Dave -- Dave Hall Binghamton University kdhall@binghamton.edu<mailto:kdhall@binghamton.edu> On Mon, Aug 1, 2022 at 9:04 AM Hao Jue PX Wang <wghaojue@cn.ibm.com<mailto:wghaojue@cn.ibm.com>> wrote: Hi folks, I am using a glance config like this to leverage IBM gpfs backend to store image, however, when upload images openstack image create --file rhel-8.5-official.qcow2 test1, I ran into the following error. Any idea or suggestion for fixing the error? Thanks ============================== [glance_store] default_backend = filesystem enabled_backends = filesystem filesystem_store_datadir = /foundation_gpfs2/icic/images/ filesystem_store_file_perm = 0644 ============================== ========================================================================================== 2022-08-01 10:18:43.590 3663156 INFO glance_store.capabilities [req-2c007ca2-a0c4-4a31-a94d-43f0f25cb2cc 0688b01e6439ca32d698d20789d52169126fb41fb1a4ddafcebb97d854e836c9 b334d58126ee4193bc439ea0cb806aaa - default default] haojuedebug req_cap: [<BitMasks.WRITE_ACCESS: 8>] 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data [req-2c007ca2-a0c4-4a31-a94d-43f0f25cb2cc 0688b01e6439ca32d698d20789d52169126fb41fb1a4ddafcebb97d854e836c9 b334d58126ee4193bc439ea0cb806aaa - default default] Error in store configuration. Adding images to store is disabled.: glance_store.exceptions.StoreAddDisabled: Configuration for store failed. Adding images to this store is disabled. 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data Traceback (most recent call last): 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/api/v2/image_data.py", line 182, in upload 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image.set_data(data, size, backend=backend) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/domain/proxy.py", line 198, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self.base.set_data(data, size, backend=backend, set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/notifier.py", line 501, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data _send_notification(notify_error, 'image.upload', msg) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self.force_reraise() 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data six.reraise(self.type_, self.value, self.tb) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/six.py", line 703, in reraise 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data raise value 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/notifier.py", line 448, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/api/policy.py", line 204, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data return self.image.set_data(*args, **kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/quota/__init__.py", line 319, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data set_active=set_active) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/location.py", line 559, in set_data 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data self._upload_to_store(data, verifier, backend, size) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance/location.py", line 486, in _upload_to_store 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data verifier=verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/backend.py", line 491, in add_to_backend_with_multihash 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image_id, data, size, hashing_algo, store, context, verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/backend.py", line 468, in store_add_to_backend_with_multihash 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data image_id, data, size, hashing_algo, context=context, verifier=verifier) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/driver.py", line 279, in add_adapter 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data metadata_dict) = store_add_fun(*args, **kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data File "/usr/lib/python3.6/site-packages/glance_store/capabilities.py", line 175, in op_checker 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data raise op_exec_map[op](**kwargs) 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data glance_store.exceptions.StoreAddDisabled: Configuration for store failed. Adding images to this store is disabled. 2022-08-01 10:18:43.593 3663156 ERROR glance.api.v2.image_data ==========================================================================================
participants (2)
-
Dave Hall
-
Hao Jue PX Wang