Hi Michal, We had similar issue in our kolla-ansible deployment. In our case we were not able to attach volume to the VM in 1 from 5 cases and it sometimes caused also inconsistencies in DB tables. We are also running Victoria release with Ceph backend. We found out that there were many disconnects/reconnects between nova and rabbitmq because of missing heartbeats which happened every 3 minutes. If attachment of volume happened in the time of reconnection, attachment was unsuccessful. What helped in our case was adding following lines to nova.conf: [oslo_messaging_rabbit] heartbeat_timeout_threshold = 0 In your case I would check cinder logs files for messaging errors whether you do not see regular reconnects to rabbitmq. Kamil Madac On Fri, Jun 10, 2022 at 2:08 PM Michal Arbet <michal.arbet@ultimum.io> wrote:
Hi,
Cinder is from victoria, backend is ceph, steps to reproduce ? Just delete volume. I think that it could be an error not in cinder but somehow a rabbitmq issue.
:/
Michal Arbet Openstack Engineer
Ultimum Technologies a.s. Na Poříčí 1047/26, 11000 Praha 1 Czech Republic
+420 604 228 897 michal.arbet@ultimum.io *https://ultimum.io <https://ultimum.io/>*
LinkedIn <https://www.linkedin.com/company/ultimum-technologies> | Twitter <https://twitter.com/ultimumtech> | Facebook <https://www.facebook.com/ultimumtechnologies/timeline>
út 7. 6. 2022 v 19:27 odesílatel Sofia Enriquez <senrique@redhat.com> napsal:
Hi Michal,
I do not think we have such a bug on the Launchpad platform.[1] Could you create a new bug report indicating which backend you are using, which Cinder version you have, and if the error occurs after following some steps?
Thanks in advance, Sofia
[1] https://bugs.launchpad.net/cinder
On Tue, Jun 7, 2022 at 4:28 AM Michal Arbet <michal.arbet@ultimum.io> wrote:
Hi,
I would like to ask if someone saw issue when volume failed to delete, log below : This is happening from time to time.
LOG : https://paste.opendev.org/show/b1jRCxuBFnnVzf64i9yV/
Thanks,
Michal Arbet Openstack Engineer
Ultimum Technologies a.s. Na Poříčí 1047/26, 11000 Praha 1 Czech Republic
+420 604 228 897 michal.arbet@ultimum.io *https://ultimum.io <https://ultimum.io/>*
LinkedIn <https://www.linkedin.com/company/ultimum-technologies> | Twitter <https://twitter.com/ultimumtech> | Facebook <https://www.facebook.com/ultimumtechnologies/timeline>
--
Sofía Enriquez
she/her
Software Engineer
Red Hat PnT <https://www.redhat.com>
IRC: @enriquetaso @RedHat <https://twitter.com/redhat> Red Hat <https://www.linkedin.com/company/red-hat> Red Hat <https://www.facebook.com/RedHatInc> <https://www.redhat.com>
-- Kamil Madac <https://kmadac.github.io/>