<div dir="ltr"><div class="gmail_default" style="font-size:small;color:#444444">Hello Sofia,</div><div class="gmail_default" style="font-size:small;color:#444444"><br></div><div class="gmail_default" style="font-size:small;color:#444444">Below are the logs</div><div class="gmail_default" style="font-size:small;color:#444444"><br></div><div class="gmail_default" style="font-size:small;color:#444444"><br></div><div class="gmail_default" style="font-size:small;color:#444444"><br></div><div class="gmail_default" style="font-size:small;color:#444444">24/Jan/2023 06:25:10] "GET /v2/images?limit=1000&sort_key=created_at&sort_dir=desc HTTP/1.1" 200 5995 0.058022<br>2023-01-24 06:25:12.381 50 INFO glance.api.v2.image_data [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Unable to create trust: no such option collect_timing in group [keystone_authtoken] Use the existing user token.<br>2023-01-24 06:25:12.470 50 WARNING glance_store._drivers.rbd [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Since image size is zero we will be doing resize-before-write which will be slower than normal<br>2023-01-24 06:25:13.010 51 INFO eventlet.wsgi.server [req-b91e54ba-f3fa-4fad-ab7a-1ef1ad2750fb f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:13] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008496<br>2023-01-24 06:25:15.657 52 INFO eventlet.wsgi.server [req-c9fa16c8-232d-45ff-b425-55504f332597 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:15] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008760<br>2023-01-24 06:25:16.404 50 ERROR glance_store._drivers.rbd [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Failed to store image 57e5c3ee-6576-4cf7-a72a-2038c86456bc Store Exception invalid literal for int() with base 16: b'': eventlet.wsgi.ChunkReadError: invalid literal for int() with base 16: b''<br>2023-01-24 06:25:16.629 50 ERROR glance.api.v2.image_data [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Failed to upload image data due to HTTP error: webob.exc.HTTPBadRequest: invalid literal for int() with base 16: b''<br>2023-01-24 06:25:16.697 50 INFO eventlet.wsgi.server [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Traceback (most recent call last):<br> File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/wsgi.py", line 604, in handle_one_response<br> write(b''.join(towrite))<br> File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/wsgi.py", line 538, in write<br> wfile.flush()<br> File "/usr/lib/python3.8/socket.py", line 687, in write<br> return self._sock.send(b)<br> File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/greenio/base.py", line 396, in send<br> return self._send_loop(self.fd.send, data, flags)<br> File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/greenio/base.py", line 383, in _send_loop<br> return send_method(data, *args)<br>BrokenPipeError: [Errno 32] Broken pipe<br><br>2023-01-24 06:25:16.697 50 INFO eventlet.wsgi.server [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.30,10.10.13.28 - - [24/Jan/2023 06:25:16] "PUT /v2/images/57e5c3ee-6576-4cf7-a72a-2038c86456bc/file HTTP/1.1" 400 0 4.384073<br>2023-01-24 06:25:18.281 49 INFO eventlet.wsgi.server [req-dcd70adf-5dd4-4a15-abe0-f1e074030346 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:18] "GET /v2/images?limit=1000&sort_key=created_at&sort_dir=desc HTTP/1.1" 200 5995 0.067056<br>2023-01-24 06:25:20.935 52 INFO eventlet.wsgi.server [req-065021ef-2fa4-456f-bad8-22e4a06fec9a f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:20] "GET /v2/images?limit=1000&sort_key=created_at&sort_dir=desc HTTP/1.1" 200 5995 0.064581<br>2023-01-24 06:25:23.367 50 INFO eventlet.wsgi.server [-] 10.10.13.27 - - [24/Jan/2023 06:25:23] "GET / HTTP/1.1" 300 1517 0.003469<br>2023-01-24 06:25:23.583 51 INFO eventlet.wsgi.server [req-a0a51dc6-01c5-4dff-afe9-6c67a279e7fa f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:23] "GET /v2/images?limit=1000&sort_key=created_at&sort_dir=desc HTTP/1.1" 200 5995 0.072727<br>2023-01-24 06:25:26.211 49 INFO eventlet.wsgi.server [req-052bc425-90c3-4e4e-94e3-15aba795c96b f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:26] "GET /v2/images?limit=1000&sort_key=created_at&sort_dir=desc HTTP/1.1" 200 5995 0.055309<br>2023-01-24 06:25:28.039 49 INFO glance.api.v2.image_data [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Unable to create trust: no such option collect_timing in group [keystone_authtoken] Use the existing user token.<br>2023-01-24 06:25:28.168 49 WARNING glance_store._drivers.rbd [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Since image size is zero we will be doing resize-before-write which will be slower than normal<br>2023-01-24 06:25:28.887 51 INFO eventlet.wsgi.server [req-4664a441-2fa6-41fa-b985-b6290712e597 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:28] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008411<br>2023-01-24 06:25:31.541 52 INFO eventlet.wsgi.server [req-31a7d4fc-a266-40a7-9b0d-6ba1e8c0cf47 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:31] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008032<br>2023-01-24 06:25:34.168 52 INFO eventlet.wsgi.server [req-d8e4513e-9945-4f0c-9b2d-a1e191982f0b f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:34] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.009528<br>2023-01-24 06:25:36.798 52 INFO eventlet.wsgi.server [req-02c6e354-6137-4f31-9cf3-a2e9c0258938 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:36] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008272<br>2023-01-24 06:25:39.435 50 INFO eventlet.wsgi.server [req-a30d0de8-9b34-414f-81ef-9a3457cf2758 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:39] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008886<br>2023-01-24 06:25:42.059 52 INFO eventlet.wsgi.server [req-409a24f7-7d8e-4bb8-8cab-ef730cf35478 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:42] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008929<br>2023-01-24 06:25:44.709 52 INFO eventlet.wsgi.server [req-ebee0818-8afe-488e-a9f2-52bcdfb65983 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:44] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008267<br>2023-01-24 06:25:47.346 52 INFO eventlet.wsgi.server [req-71ad7a1a-acee-40f1-a3ed-70fe64428644 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:47] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008255<br>2023-01-24 06:25:50.005 50 INFO eventlet.wsgi.server [req-a69f1a44-7689-494c-9e84-c434a1ea9838 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:50] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008565<br>2023-01-24 06:25:52.631 50 INFO eventlet.wsgi.server [req-08c7e2db-c60e-4cfe-ab0e-78269924f60d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:52] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008409<br>2023-01-24 06:25:53.521 48 INFO eventlet.wsgi.server [-] 10.10.13.27 - - [24/Jan/2023 06:25:53] "GET / HTTP/1.1" 300 1517 0.001898<br>2023-01-24 06:25:55.271 51 INFO eventlet.wsgi.server [req-63d5645d-c9dc-4ec4-86b6-48305b05ebe8 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:55] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.005122<br>2023-01-24 06:25:57.911 50 INFO eventlet.wsgi.server [req-67b0f1e9-89a1-4e34-8f95-132f32f9c478 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:25:57] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.009235<br>2023-01-24 06:26:00.554 48 INFO eventlet.wsgi.server [req-cc7033b2-698b-4bd5-96cf-589d864485ff f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:26:00] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008637<br>2023-01-24 06:26:03.181 50 INFO eventlet.wsgi.server [req-26a2b823-8a26-49b8-9d79-af6bf36c0e2a f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:26:03] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.007718<br>2023-01-24 06:26:05.835 50 INFO eventlet.wsgi.server [req-1be8a06e-6c3a-4966-9031-a1548b6b0f7a f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:26:05] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008469<br>2023-01-24 06:26:08.483 50 INFO eventlet.wsgi.server [req-b24990c6-319d-4837-8128-406f49d38530 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:26:08] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008319<br>2023-01-24 06:26:11.134 50 INFO eventlet.wsgi.server [req-5393b80e-5069-47ee-a1f0-ef7174c1e09b f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:26:11] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008237<br>2023-01-24 06:26:13.765 50 INFO eventlet.wsgi.server [req-fcbc3f21-ddb5-4b3f-869c-b489ace9a453 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:26:13] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008331<br>2023-01-24 06:26:16.405 52 INFO eventlet.wsgi.server [req-20d98cec-4e1e-4582-aaa2-68043927ab7f f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:26:16] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008366<br>2023-01-24 06:26:19.028 50 INFO eventlet.wsgi.server [req-2f1bc312-00b8-4e92-91ac-a3ba1f951742 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:26:19] "GET /v2/schemas/image HTTP/1.1" 200 6259 0.008365<br>2023-01-24 06:26:20.032 49 ERROR glance_store._drivers.rbd [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Failed to store image 57e5c3ee-6576-4cf7-a72a-2038c86456bc Store Exception unexpected end of file while parsing chunked data: OSError: unexpected end of file while parsing chunked data<br>2023-01-24 06:26:20.443 49 ERROR glance.api.v2.image_data [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Failed to upload image data due to internal error: OSError: unexpected end of file while parsing chunked data<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Caught error: unexpected end of file while parsing chunked data: OSError: unexpected end of file while parsing chunked data<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi Traceback (most recent call last):<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/common/wsgi.py", line 1353, in __call__<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi action_result = self.dispatch(self.controller, action,<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/common/wsgi.py", line 1397, in dispatch<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi return method(*args, **kwargs)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/common/utils.py", line 416, in wrapped<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi return func(self, req, *args, **kwargs)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/api/v2/image_data.py", line 300, in upload<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi self._restore(image_repo, image)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 227, in __exit__<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi self.force_reraise()<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 200, in force_reraise<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi raise self.value<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/api/v2/image_data.py", line 165, in upload<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi image.set_data(data, size, backend=backend)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/domain/proxy.py", line 208, in set_data<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi self.base.set_data(data, size, backend=backend, set_active=set_active)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/notifier.py", line 501, in set_data<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi _send_notification(notify_error, 'image.upload', msg)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 227, in __exit__<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi self.force_reraise()<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/oslo_utils/excutils.py", line 200, in force_reraise<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi raise self.value<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/notifier.py", line 447, in set_data<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi self.repo.set_data(data, size, backend=backend,<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/api/policy.py", line 273, in set_data<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi return self.image.set_data(*args, **kwargs)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/quota/__init__.py", line 322, in set_data<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi self.image.set_data(data, size=size, backend=backend,<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/location.py", line 567, in set_data<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi self._upload_to_store(data, verifier, backend, size)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/location.py", line 458, in _upload_to_store<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi multihash, loc_meta) = self.store_api.add_with_multihash(<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance_store/multi_backend.py", line 398, in add_with_multihash<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi return store_add_to_backend_with_multihash(<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance_store/multi_backend.py", line 480, in store_add_to_backend_with_multihash<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi (location, size, checksum, multihash, metadata) = store.add(<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance_store/driver.py", line 279, in add_adapter<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi metadata_dict) = store_add_fun(*args, **kwargs)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance_store/capabilities.py", line 176, in op_checker<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi return store_op_fun(store, *args, **kwargs)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance_store/_drivers/rbd.py", line 629, in add<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi raise exc<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance_store/_drivers/rbd.py", line 574, in add<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi for chunk in chunks:<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance_store/common/utils.py", line 73, in chunkiter<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi chunk = fp.read(chunk_size)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/common/utils.py", line 294, in read<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi result = self.data.read(i)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/common/utils.py", line 121, in readfn<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi result = fd.read(*args)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/glance/common/format_inspector.py", line 658, in read<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi chunk = self._source.read(size)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/wsgi.py", line 221, in read<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi return self._chunked_read(self.rfile, length)<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/wsgi.py", line 192, in _chunked_read<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi raise IOError("unexpected end of file while parsing chunked data")<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi OSError: unexpected end of file while parsing chunked data<br>2023-01-24 06:26:20.563 49 ERROR glance.common.wsgi<br>2023-01-24 06:26:20.570 49 INFO eventlet.wsgi.server [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] Traceback (most recent call last):<br> File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/wsgi.py", line 604, in handle_one_response<br> write(b''.join(towrite))<br> File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/wsgi.py", line 538, in write<br> wfile.flush()<br> File "/usr/lib/python3.8/socket.py", line 687, in write<br> return self._sock.send(b)<br> File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/greenio/base.py", line 396, in send<br> return self._send_loop(self.fd.send, data, flags)<br> File "/var/lib/kolla/venv/lib/python3.8/site-packages/eventlet/greenio/base.py", line 383, in _send_loop<br> return send_method(data, *args)<br>BrokenPipeError: [Errno 32] Broken pipe<br><br>2023-01-24 06:26:20.571 49 INFO eventlet.wsgi.server [req-7eebf051-b8b0-4dff-9b7e-8d5085d77b5d f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.30,10.10.13.28 - - [24/Jan/2023 06:26:20] "PUT /v2/images/57e5c3ee-6576-4cf7-a72a-2038c86456bc/file HTTP/1.1" 500 0 52.610723<br>2023-01-24 06:26:21.649 51 INFO eventlet.wsgi.server [req-9eea9898-f4e7-4cb1-b02c-019b56fa00a9 f75f32a3c1fd4cf68cdb7b76d70ee9a8 bf5353fb17604156b492d5a7f00992ff - default default] 10.10.13.27,10.10.13.28 - - [24/Jan/2023 06:26:21] "GET /v2/images?limit=1000&sort_key=created_at&sort_dir=desc HTTP/1.1" 200 4774 0.068947<br>2023-01-24 06:26:23.635 50 INFO eventlet.wsgi.server [-] 10.10.13.27 - - [24/Jan/2023 06:26:23] "GET / HTTP/1.1" 300 1517 0.001586<br>^C<br>root@controller1:/home/stack#<br></div><div class="gmail_default" style="font-size:small;color:#444444"><br></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div><font face="arial, sans-serif">Regards</font></div><div><font face="arial, sans-serif"><br></font></div><div dir="ltr"><font face="arial, sans-serif">Tony Karera</font></div><div dir="ltr"><br></div><div><br></div></div></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Jan 23, 2023 at 4:56 PM Karera Tony <<a href="mailto:tonykarera@gmail.com">tonykarera@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)">Hello Sofia,</div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)"><br></div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)">It is actually Instance snapshot not Volume snapshot.</div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)">I click on create Snapshot on the Instance options.</div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)"><br></div><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div><font face="arial, sans-serif">Regards</font></div><div><font face="arial, sans-serif"><br></font></div><div dir="ltr"><font face="arial, sans-serif">Tony Karera</font></div><div dir="ltr"><br></div><div><br></div></div></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Jan 23, 2023 at 3:59 PM Sofia Enriquez <<a href="mailto:senrique@redhat.com" target="_blank">senrique@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Hi Karera, hope this email finds you well</div><div><br></div><div>We need more information in order to reproduce this issue. <br></div><div><br></div><div>- Do you mind sharing c-vol logs of the operation to see if there's any errors?</div><div>- How do you create the snapshot? Do you mind sharing the steps to reproduce this?</div><div><br></div><div>Thanks in advance, <br></div><div>Sofia <br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Jan 23, 2023 at 1:20 PM Karera Tony <<a href="mailto:tonykarera@gmail.com" target="_blank">tonykarera@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)">Dear Team,</div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)"><br></div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)">I am using Openstack Wallaby deployed using kolla-ansible.</div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)"><br></div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)">I installed Glance with the ceph backend and all was well.</div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)">However when I create snapshots, they disappear when they are saved.</div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)"><br></div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)">Any idea on how to resolve this?</div><div class="gmail_default" style="font-size:small;color:rgb(68,68,68)"><br></div><div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div><font face="arial, sans-serif">Regards</font></div><div><font face="arial, sans-serif"><br></font></div><div dir="ltr"><font face="arial, sans-serif">Tony Karera</font></div><div dir="ltr"><br></div><div><br></div></div></div></div></div></div></div></div>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div>
<p style="font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:capitalize;font-family:RedHatText,sans-serif">
<font size="1"><span>Sofía</span> <span>Enriquez</span><span style="color:rgb(170,170,170);margin:0px"></span>
</font></p><font size="1">
</font><p style="font-weight:normal;margin:0px 0px 4px;text-transform:capitalize;font-family:RedHatText,sans-serif"><font size="1">she/her</font></p><font size="1">
</font><p style="font-weight:normal;margin:0px;text-transform:capitalize;font-family:RedHatText,sans-serif">
<font size="1"><span>Software Engineer</span></font>
</p><font size="1">
</font><p style="font-weight:normal;margin:0px 0px 4px;font-family:RedHatText,sans-serif">
<font size="1"><a style="color:rgb(0,136,206);margin:0px;text-decoration:none;font-family:RedHatText,sans-serif" href="https://www.redhat.com" target="_blank">Red Hat <span>PnT</span></a></font>
</p><font size="1"><span></span></font><p style="font-weight:normal;margin:0px;font-family:RedHatText,sans-serif"><font size="1"><span><span>IRC: @enriquetaso</span></span></font>
</p><font size="1">
</font><div style="font-weight:normal;font-size:12px;font-family:RedHatText,sans-serif;margin-bottom:8px"><font size="1">
</font><div><font size="1">
<a href="https://twitter.com/redhat" title="twitter" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/3780bd4ede961ef3cd4108b8c0e80186/web-icon-twitter.png") 0px 50%/13px no-repeat transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px" target="_blank"> <span style="margin-left:2px">@RedHat</span> </a> <a href="https://www.linkedin.com/company/red-hat" title="LinkedIn" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/8d3507e3c6b6c9ad10e301accf1a4af0/web-icon-linkedin.png") 0px 50%/12px no-repeat transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:12px;margin:0px 4px 0px 3px;padding-top:1px" target="_blank"> <span style="margin-left:4px">Red Hat</span> </a> </font><a href="https://www.facebook.com/RedHatInc" title="Facebook" style="background:url("https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/220b85e2f100025e94cb1bcd993bd51d/web-icon-facebook.png") 0px 50%/11px no-repeat transparent;text-decoration:none;color:rgb(0,0,0);display:inline-block;line-height:20px;padding-left:13px" target="_blank"><font size="1"> <span>Red Hat</span></font> </a>
</div>
</div>
<div style="margin-top:12px">
<table border="0">
<tbody><tr>
<td width="100px"><a href="https://www.redhat.com" target="_blank"> <img src="https://marketing-outfit-prod-images.s3-us-west-2.amazonaws.com/f5445ae0c9ddafd5b2f1836854d7416a/Logo-RedHat-Email.png" width="90" height="auto"></a> </td>
</tr>
</tbody></table>
</div>
</div><table border="0"><tbody><tr><td width="100px"><br></td>
</tr></tbody></table>
</div></div></div></div></div></div></div></div></div></div></div></div></div>
</blockquote></div>
</blockquote></div>