[kolla][rabbitmq]: Error when ensuring rabbitmq users exists
Hello o/, After an upgrade of nodes packages, we have been facing a problem when reconfiguring RabbitMQ and Nova. In the tasks that ensures RabbitMQ users exists the output of task is: FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (5 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (4 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (3 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (2 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (1 retries left). I've already tried to redeploy rabbit and reconfigure after that, but does not work neither Anyone can help? I'm unable to perform any operation in my environment. Thanks! Winicius.
Hi, could you be more specific what you mean by "reconfiguring RabbitMQ and Nova"? What exactly did you try? I'm not very familiar with kolla so hopefully someone else can shed more light. But for starters it would probably help to have more information, OS version, openstack version etc. And as already mentioned, what exactly you reconfigured. Zitat von Winicius Allan <winiciusab12@gmail.com>:
Hello o/,
After an upgrade of nodes packages, we have been facing a problem when reconfiguring RabbitMQ and Nova. In the tasks that ensures RabbitMQ users exists the output of task is:
FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (5 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (4 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (3 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (2 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (1 retries left).
I've already tried to redeploy rabbit and reconfigure after that, but does not work neither
Anyone can help? I'm unable to perform any operation in my environment.
Thanks! Winicius.
Hello Eugen, thanks for the reply. I'm using kolla-ansible in Zed release, Ubuntu 22.04 in a multinode deployment. Reconfigure is basicaly a set of playbook in kolla that reads the configuration file and configure all services or specific one, if tag is passed. I ran that to reconfigure all services after packages update, to make sure everything is working fine. So in those tasks, it ensures the Nova user exists in RabbitMQ, but doesn't. I don't know if i should run something else before it. Em qui., 15 de fev. de 2024 às 11:58, Eugen Block <eblock@nde.ag> escreveu:
Hi,
could you be more specific what you mean by "reconfiguring RabbitMQ and Nova"? What exactly did you try? I'm not very familiar with kolla so hopefully someone else can shed more light. But for starters it would probably help to have more information, OS version, openstack version etc. And as already mentioned, what exactly you reconfigured.
Zitat von Winicius Allan <winiciusab12@gmail.com>:
Hello o/,
After an upgrade of nodes packages, we have been facing a problem when reconfiguring RabbitMQ and Nova. In the tasks that ensures RabbitMQ users exists the output of task is:
FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (5 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (4 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (3 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (2 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (1 retries left).
I've already tried to redeploy rabbit and reconfigure after that, but does not work neither
Anyone can help? I'm unable to perform any operation in my environment.
Thanks! Winicius.
I only have a all-in-one kolla instance at hand, but there's no user "nova", only a user "openstack". Or did you define a list of users to create in main.yml? # List of RabbitMQ users to create. Each item should contain the following # fields: # 'user' # 'password' # 'vhost' # 'tags' # Virtual hosts in this list will also be created. service_rabbitmq_users: [] How do your transport_urls look like (mask sensitive information)? What's the exact error message below the retries? There are a couple of questions out there, e. g. [1] or this bug [2]. Can you check if your version contains the fix for [2]? [1] https://lists.openstack.org/pipermail/openstack-discuss/2022-December/031486... [2] https://bugs.launchpad.net/kolla-ansible/+bug/1946506 Zitat von Winicius Allan <winiciusab12@gmail.com>:
Hello Eugen, thanks for the reply.
I'm using kolla-ansible in Zed release, Ubuntu 22.04 in a multinode deployment.
Reconfigure is basicaly a set of playbook in kolla that reads the configuration file and configure all services or specific one, if tag is passed. I ran that to reconfigure all services after packages update, to make sure everything is working fine.
So in those tasks, it ensures the Nova user exists in RabbitMQ, but doesn't. I don't know if i should run something else before it.
Em qui., 15 de fev. de 2024 às 11:58, Eugen Block <eblock@nde.ag> escreveu:
Hi,
could you be more specific what you mean by "reconfiguring RabbitMQ and Nova"? What exactly did you try? I'm not very familiar with kolla so hopefully someone else can shed more light. But for starters it would probably help to have more information, OS version, openstack version etc. And as already mentioned, what exactly you reconfigured.
Zitat von Winicius Allan <winiciusab12@gmail.com>:
Hello o/,
After an upgrade of nodes packages, we have been facing a problem when reconfiguring RabbitMQ and Nova. In the tasks that ensures RabbitMQ users exists the output of task is:
FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (5 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (4 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (3 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (2 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (1 retries left).
I've already tried to redeploy rabbit and reconfigure after that, but does not work neither
Anyone can help? I'm unable to perform any operation in my environment.
Thanks! Winicius.
Hello Oliver, thanks for your reply I'm using kolla-ansible 15.2.1 Em sex., 16 de fev. de 2024 às 09:10, Oliver Weinmann < oliver.weinmann@me.com> escreveu:
Hi,
I remember I once had this error too. Can’t fully remember what I did to fix it but I had visited this bug report:
^ https://bugs.launchpad.net/kolla-ansible/+bug/1946506 <https://bugs.launchpad.net/kolla-ansible/+bug/1946506>
What version of kolla-Ansible are you using?
Cheers, Oliver
Von meinem iPhone gesendet
Am 16.02.2024 um 12:12 schrieb Eugen Block <eblock@nde.ag>:
I only have a all-in-one kolla instance at hand, but there's no user "nova", only a user "openstack". Or did you define a list of users to create in main.yml?
# List of RabbitMQ users to create. Each item should contain the following # fields: # 'user' # 'password' # 'vhost' # 'tags' # Virtual hosts in this list will also be created. service_rabbitmq_users: []
How do your transport_urls look like (mask sensitive information)? What's the exact error message below the retries? There are a couple of questions out there, e. g. [1] or this bug [2]. Can you check if your version contains the fix for [2]?
[1] https://lists.openstack.org/pipermail/openstack-discuss/2022-December/031486... [2] https://bugs.launchpad.net/kolla-ansible/+bug/1946506
Zitat von Winicius Allan <winiciusab12@gmail.com>:
Hello Eugen, thanks for the reply.
I'm using kolla-ansible in Zed release, Ubuntu 22.04 in a
multinode deployment.
Reconfigure is basicaly a set of playbook in kolla that reads the
configuration file and configure all services or specific one, if tag is
passed. I ran that to reconfigure all services after packages update, to
make sure everything is working fine.
So in those tasks, it ensures the Nova user exists in RabbitMQ, but
doesn't. I don't know if i should run something else before it.
Em qui., 15 de fev. de 2024 às 11:58, Eugen Block <eblock@nde.ag> escreveu:
Hi,
could you be more specific what you mean by "reconfiguring RabbitMQ
and Nova"? What exactly did you try? I'm not very familiar with kolla
so hopefully someone else can shed more light. But for starters it
would probably help to have more information, OS version, openstack
version etc. And as already mentioned, what exactly you reconfigured.
Zitat von Winicius Allan <winiciusab12@gmail.com>:
Hello o/,
After an upgrade of nodes packages, we have been facing a problem when
reconfiguring RabbitMQ and Nova. In the tasks that ensures RabbitMQ users
exists the output of task is:
FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (5 retries
left).
FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (4 retries
left).
FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (3 retries
left).
FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (2 retries
left).
FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (1 retries
left).
I've already tried to redeploy rabbit and reconfigure after that, but
does
not work neither
Anyone can help? I'm unable to perform any operation in my environment.
Thanks!
Winicius.
Hello, sorry the delay No, I didn't define the users in this variable. I thought that the nova user must exist. The error of the tasks is about the version of rabbit. I'm checking the bug reports to see if I encounter something that can be useful. Em sex., 16 de fev. de 2024 às 08:02, Eugen Block <eblock@nde.ag> escreveu:
I only have a all-in-one kolla instance at hand, but there's no user "nova", only a user "openstack". Or did you define a list of users to create in main.yml?
# List of RabbitMQ users to create. Each item should contain the following # fields: # 'user' # 'password' # 'vhost' # 'tags' # Virtual hosts in this list will also be created. service_rabbitmq_users: []
How do your transport_urls look like (mask sensitive information)? What's the exact error message below the retries? There are a couple of questions out there, e. g. [1] or this bug [2]. Can you check if your version contains the fix for [2]?
[1]
https://lists.openstack.org/pipermail/openstack-discuss/2022-December/031486... [2] https://bugs.launchpad.net/kolla-ansible/+bug/1946506
Zitat von Winicius Allan <winiciusab12@gmail.com>:
Hello Eugen, thanks for the reply.
I'm using kolla-ansible in Zed release, Ubuntu 22.04 in a multinode deployment.
Reconfigure is basicaly a set of playbook in kolla that reads the configuration file and configure all services or specific one, if tag is passed. I ran that to reconfigure all services after packages update, to make sure everything is working fine.
So in those tasks, it ensures the Nova user exists in RabbitMQ, but doesn't. I don't know if i should run something else before it.
Em qui., 15 de fev. de 2024 às 11:58, Eugen Block <eblock@nde.ag> escreveu:
Hi,
could you be more specific what you mean by "reconfiguring RabbitMQ and Nova"? What exactly did you try? I'm not very familiar with kolla so hopefully someone else can shed more light. But for starters it would probably help to have more information, OS version, openstack version etc. And as already mentioned, what exactly you reconfigured.
Zitat von Winicius Allan <winiciusab12@gmail.com>:
Hello o/,
After an upgrade of nodes packages, we have been facing a problem when reconfiguring RabbitMQ and Nova. In the tasks that ensures RabbitMQ users exists the output of task is:
FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (5 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (4 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (3 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (2 retries left). FAILED - RETRYING: [xxxx]: nova | Ensure RabbitMQ users exist (1 retries left).
I've already tried to redeploy rabbit and reconfigure after that, but does not work neither
Anyone can help? I'm unable to perform any operation in my environment.
Thanks! Winicius.
participants (3)
-
Eugen Block
-
Oliver Weinmann
-
Winicius Allan