Open Stack

Hi Michal,

We had similar issue in our kolla-ansible deployment. In our case we were
not able to attach volume to the VM in 1 from 5 cases and it sometimes
caused also inconsistencies in DB tables. We are also running Victoria
release with Ceph backend.  We found out that there were many
disconnects/reconnects between nova and rabbitmq because of
missing heartbeats which happened every 3 minutes. If attachment of volume
happened in the time of reconnection, attachment was unsuccessful.  What
helped in our case was adding following lines to nova.conf:

[oslo_messaging_rabbit]
heartbeat_timeout_threshold = 0

In your case I would check cinder logs files for messaging errors whether
you do not see regular reconnects to rabbitmq.

Kamil Madac

On Fri, Jun 10, 2022 at 2:08 PM Michal Arbet <michal.arbet at ultimum.io>
wrote:

> Hi,
>
> Cinder is from victoria, backend is ceph, steps to reproduce ? Just delete
> volume.
> I think that it could be an error not in cinder but somehow a rabbitmq
> issue.
>
> :/
>
> Michal Arbet
> Openstack Engineer
>
> Ultimum Technologies a.s.
> Na Poříčí 1047/26, 11000 Praha 1
> Czech Republic
>
> +420 604 228 897
> michal.arbet at ultimum.io
> *https://ultimum.io <https://ultimum.io/>*
>
> LinkedIn <https://www.linkedin.com/company/ultimum-technologies> | Twitter
> <https://twitter.com/ultimumtech> | Facebook
> <https://www.facebook.com/ultimumtechnologies/timeline>
>
>
> út 7. 6. 2022 v 19:27 odesílatel Sofia Enriquez <senrique at redhat.com>
> napsal:
>
>> Hi Michal,
>>
>> I do not think we have such a bug on the Launchpad platform.[1]
>> Could you create a new bug report indicating which backend you are using,
>> which Cinder version you have, and if the error occurs after following some
>> steps?
>>
>> Thanks in advance,
>> Sofia
>>
>> [1] https://bugs.launchpad.net/cinder
>>
>> On Tue, Jun 7, 2022 at 4:28 AM Michal Arbet <michal.arbet at ultimum.io>
>> wrote:
>>
>>> Hi,
>>>
>>> I would like to ask if someone saw issue when volume failed to delete,
>>> log below :
>>> This is happening from time to time.
>>>
>>> LOG : https://paste.opendev.org/show/b1jRCxuBFnnVzf64i9yV/
>>>
>>> Thanks,
>>>
>>> Michal Arbet
>>> Openstack Engineer
>>>
>>> Ultimum Technologies a.s.
>>> Na Poříčí 1047/26, 11000 Praha 1
>>> Czech Republic
>>>
>>> +420 604 228 897
>>> michal.arbet at ultimum.io
>>> *https://ultimum.io <https://ultimum.io/>*
>>>
>>> LinkedIn <https://www.linkedin.com/company/ultimum-technologies> |
>>> Twitter <https://twitter.com/ultimumtech> | Facebook
>>> <https://www.facebook.com/ultimumtechnologies/timeline>
>>>
>>
>>
>> --
>>
>> Sofía Enriquez
>>
>> she/her
>>
>> Software Engineer
>>
>> Red Hat PnT <https://www.redhat.com>
>>
>> IRC: @enriquetaso
>> @RedHat <https://twitter.com/redhat>   Red Hat
>> <https://www.linkedin.com/company/red-hat>  Red Hat
>> <https://www.facebook.com/RedHatInc>
>> <https://www.redhat.com>
>>
>>

-- 
Kamil Madac <https://kmadac.github.io/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20220614/8524e9f5/attachment.htm>