[Deploy problem] deploy openstack+monasca with kolla-ansible 8.0.0.0rc1.
Hello, I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1. I follow the steps as mentioned in https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html The setting in my computer's globals.yml as same as [Quick Start] tutorial (attached file: globals.yml is my setting). My machine environment as following: OS: Ubuntu 16.04 Kolla-ansible verions: 8.0.0.0rc1 ansible version: 2.7 When I execute [bootstrap-servers] and [prechecks], it seems ok (no fatal error or any interrupt). But when I execute [deploy], it will occur some error about rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when I set enable_rabbitmq:no). I have some detail screenshot about the errors as attached files, could you please help me to solve this problem? Thank you very much. [Attached file description]: globals.yml: my computer's setting about kolla-ansible As mentioned above, the following pictures show the errors, the rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova compute service error will occur if I set [enable_rabbitmq:no]. [image: docker-version.png] [image: kolla-ansible-version.png] [image: nova-compute-service-error.png] [image: rabbitmq_error.png]
On 01/05/2019 08:45, Ming-Che Liu wrote:
Hello,
I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1.
It doesn't look like Monasca is enabled in your globals.yml file. Are you trying to set up OpenStack services first and then enable Monasca afterwards? You can also deploy Monasca standalone if that is useful: https://docs.openstack.org/kolla-ansible/latest/reference/logging-and-monito...
I follow the steps as mentioned in https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html
The setting in my computer's globals.yml as same as [Quick Start] tutorial (attached file: globals.yml is my setting).
My machine environment as following: OS: Ubuntu 16.04 Kolla-ansible verions: 8.0.0.0rc1 ansible version: 2.7
When I execute [bootstrap-servers] and [prechecks], it seems ok (no fatal error or any interrupt).
But when I execute [deploy], it will occur some error about rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when I set enable_rabbitmq:no).
I have some detail screenshot about the errors as attached files, could you please help me to solve this problem?
Please can you post more information on why the containers are not starting. - Inspect rabbit and nova-compute logs (in /var/lib/docker/volumes/kolla_logs/_data/) - Check relevant containers are running, and if they are restarting check the output. Eg. docker logs --follow nova_compute
Thank you very much.
[Attached file description]: globals.yml: my computer's setting about kolla-ansible
As mentioned above, the following pictures show the errors, the rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova compute service error will occur if I set [enable_rabbitmq:no]. docker-version.png kolla-ansible-version.png nova-compute-service-error.png rabbitmq_error.png
Hello, Thank you for replying, my goal is to deploy [all-in-one] openstack+monasca(in the same physical machine/VM). I will check the detail error information and provide such logs for you, thank you. I also have a question about kolla-ansible 8.0.0.0rc1, when I check the new feature about kolla-ansible 8.0.0.0rc1, it seems only 8.0.0.0rc1 provide the "complete" monasca functionality, it that right(that means you can see monasca's plugin in openstack horizon, as the following picture)? Thank you very much. Regards, Shawn [image: monasca.png] Doug Szumski <doug@stackhpc.com> 於 2019年5月2日 週四 下午4:21寫道：
On 01/05/2019 08:45, Ming-Che Liu wrote:
Hello,
I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1.
It doesn't look like Monasca is enabled in your globals.yml file. Are you trying to set up OpenStack services first and then enable Monasca afterwards? You can also deploy Monasca standalone if that is useful:
https://docs.openstack.org/kolla-ansible/latest/reference/logging-and-monito...
I follow the steps as mentioned in https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html
The setting in my computer's globals.yml as same as [Quick Start] tutorial (attached file: globals.yml is my setting).
My machine environment as following: OS: Ubuntu 16.04 Kolla-ansible verions: 8.0.0.0rc1 ansible version: 2.7
When I execute [bootstrap-servers] and [prechecks], it seems ok (no fatal error or any interrupt).
But when I execute [deploy], it will occur some error about rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when I set enable_rabbitmq:no).
I have some detail screenshot about the errors as attached files, could you please help me to solve this problem?
Please can you post more information on why the containers are not starting.
- Inspect rabbit and nova-compute logs (in /var/lib/docker/volumes/kolla_logs/_data/)
- Check relevant containers are running, and if they are restarting check the output. Eg. docker logs --follow nova_compute
Thank you very much.
[Attached file description]: globals.yml: my computer's setting about kolla-ansible
As mentioned above, the following pictures show the errors, the rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova compute service error will occur if I set [enable_rabbitmq:no]. docker-version.png kolla-ansible-version.png nova-compute-service-error.png rabbitmq_error.png
On 02/05/2019 10:13, Ming-Che Liu wrote:
Hello,
Thank you for replying, my goal is to deploy [all-in-one] openstack+monasca(in the same physical machine/VM).
I will check the detail error information and provide such logs for you, thank you.
I also have a question about kolla-ansible 8.0.0.0rc1, when I check the new feature about kolla-ansible 8.0.0.0rc1, it seems only 8.0.0.0rc1 provide the "complete" monasca functionality, it that right(that means you can see monasca's plugin in openstack horizon, as the following picture)?
You are correct that Monasca is supported from the Stein release onwards. Due to a number of people asking we have created a backport to Rocky, but the patches are not merged yet. Please see this bug for a link to the patch chains: https://bugs.launchpad.net/kolla-ansible/+bug/1824982 The horizon-ui-plugin isn't currently installed in the Horizon image, but I can easily add a patch for it. Similar functionality is currently provided by the monasca-grafana fork (which provides Keystone integration), for example: Menu Overview
Thank you very much.
Regards,
Shawn
monasca.png
Doug Szumski <doug@stackhpc.com <mailto:doug@stackhpc.com>> 於 2019年5月2日 週四 下午4:21寫道：
On 01/05/2019 08:45, Ming-Che Liu wrote: > Hello, > > I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1.
It doesn't look like Monasca is enabled in your globals.yml file. Are you trying to set up OpenStack services first and then enable Monasca afterwards? You can also deploy Monasca standalone if that is useful:
https://docs.openstack.org/kolla-ansible/latest/reference/logging-and-monito...
> > I follow the steps as mentioned in > https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html > > The setting in my computer's globals.yml as same as [Quick Start] > tutorial (attached file: globals.yml is my setting). > > My machine environment as following: > OS: Ubuntu 16.04 > Kolla-ansible verions: 8.0.0.0rc1 > ansible version: 2.7 > > When I execute [bootstrap-servers] and [prechecks], it seems ok (no > fatal error or any interrupt). > > But when I execute [deploy], it will occur some error about > rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when > I set enable_rabbitmq:no). > > I have some detail screenshot about the errors as attached files, > could you please help me to solve this problem?
Please can you post more information on why the containers are not starting.
- Inspect rabbit and nova-compute logs (in /var/lib/docker/volumes/kolla_logs/_data/)
- Check relevant containers are running, and if they are restarting check the output. Eg. docker logs --follow nova_compute
> > Thank you very much. > > [Attached file description]: > globals.yml: my computer's setting about kolla-ansible > > As mentioned above, the following pictures show the errors, the > rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova > compute service error will occur if I set [enable_rabbitmq:no]. > docker-version.png > kolla-ansible-version.png > nova-compute-service-error.png > rabbitmq_error.png
On 02/05/2019 10:56, Doug Szumski wrote:
On 02/05/2019 10:13, Ming-Che Liu wrote:
Hello,
Thank you for replying, my goal is to deploy [all-in-one] openstack+monasca(in the same physical machine/VM).
I will check the detail error information and provide such logs for you, thank you.
I also have a question about kolla-ansible 8.0.0.0rc1, when I check the new feature about kolla-ansible 8.0.0.0rc1, it seems only 8.0.0.0rc1 provide the "complete" monasca functionality, it that right(that means you can see monasca's plugin in openstack horizon, as the following picture)?
You are correct that Monasca is supported from the Stein release onwards. Due to a number of people asking we have created a backport to Rocky, but the patches are not merged yet. Please see this bug for a link to the patch chains: https://bugs.launchpad.net/kolla-ansible/+bug/1824982
The horizon-ui-plugin isn't currently installed in the Horizon image, but I can easily add a patch for it.
Similar functionality is currently provided by the monasca-grafana fork (which provides Keystone integration), for example:
Apologies, the images were stripped, please see this link: https://github.com/monasca/monasca-grafana
Menu
Overview
Thank you very much.
Regards,
Shawn
monasca.png
Doug Szumski <doug@stackhpc.com <mailto:doug@stackhpc.com>> 於 2019年5月2日 週四 下午4:21寫道：
On 01/05/2019 08:45, Ming-Che Liu wrote: > Hello, > > I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1.
It doesn't look like Monasca is enabled in your globals.yml file. Are you trying to set up OpenStack services first and then enable Monasca afterwards? You can also deploy Monasca standalone if that is useful:
https://docs.openstack.org/kolla-ansible/latest/reference/logging-and-monito...
> > I follow the steps as mentioned in > https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html > > The setting in my computer's globals.yml as same as [Quick Start] > tutorial (attached file: globals.yml is my setting). > > My machine environment as following: > OS: Ubuntu 16.04 > Kolla-ansible verions: 8.0.0.0rc1 > ansible version: 2.7 > > When I execute [bootstrap-servers] and [prechecks], it seems ok (no > fatal error or any interrupt). > > But when I execute [deploy], it will occur some error about > rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when > I set enable_rabbitmq:no). > > I have some detail screenshot about the errors as attached files, > could you please help me to solve this problem?
Please can you post more information on why the containers are not starting.
- Inspect rabbit and nova-compute logs (in /var/lib/docker/volumes/kolla_logs/_data/)
- Check relevant containers are running, and if they are restarting check the output. Eg. docker logs --follow nova_compute
> > Thank you very much. > > [Attached file description]: > globals.yml: my computer's setting about kolla-ansible > > As mentioned above, the following pictures show the errors, the > rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova > compute service error will occur if I set [enable_rabbitmq:no]. > docker-version.png > kolla-ansible-version.png > nova-compute-service-error.png > rabbitmq_error.png
On Wed, 1 May 2019 at 17:10, Ming-Che Liu <gn01737625@gmail.com> wrote:
Hello,
I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1.
I follow the steps as mentioned in https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html
The setting in my computer's globals.yml as same as [Quick Start] tutorial (attached file: globals.yml is my setting).
My machine environment as following: OS: Ubuntu 16.04 Kolla-ansible verions: 8.0.0.0rc1 ansible version: 2.7
When I execute [bootstrap-servers] and [prechecks], it seems ok (no fatal error or any interrupt).
But when I execute [deploy], it will occur some error about rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when I set enable_rabbitmq:no).
I have some detail screenshot about the errors as attached files, could you please help me to solve this problem?
Thank you very much.
[Attached file description]: globals.yml: my computer's setting about kolla-ansible
As mentioned above, the following pictures show the errors, the rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova compute service error will occur if I set [enable_rabbitmq:no].
Hi Ming-Che, Since Stein, we no longer test Kolla Ansible with Ubuntu 16.04 upstream. Could you try again using Ubuntu 18.04? Regards, Mark
Hi Mark, Sure, I will do that, thanks. Regards, Ming-Che Mark Goddard <mark@stackhpc.com> 於 2019年5月3日 週五 上午1:12寫道：
On Wed, 1 May 2019 at 17:10, Ming-Che Liu <gn01737625@gmail.com> wrote:
Hello,
I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1.
I follow the steps as mentioned in https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html
The setting in my computer's globals.yml as same as [Quick Start] tutorial (attached file: globals.yml is my setting).
My machine environment as following: OS: Ubuntu 16.04 Kolla-ansible verions: 8.0.0.0rc1 ansible version: 2.7
When I execute [bootstrap-servers] and [prechecks], it seems ok (no fatal error or any interrupt).
But when I execute [deploy], it will occur some error about rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when I set enable_rabbitmq:no).
I have some detail screenshot about the errors as attached files, could you please help me to solve this problem?
Thank you very much.
[Attached file description]: globals.yml: my computer's setting about kolla-ansible
As mentioned above, the following pictures show the errors, the rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova compute service error will occur if I set [enable_rabbitmq:no].
Hi Ming-Che,
Since Stein, we no longer test Kolla Ansible with Ubuntu 16.04 upstream. Could you try again using Ubuntu 18.04?
Regards, Mark
Hi Mark, I tried to deploy openstack+monasca with kolla-ansible 8.0.0.0rc1(in the same machine), but still encounter some fatal error. The attached file:golbals.yml is my setting, machine_package_setting is machine environment setting. The error is: RUNNING HANDLER [rabbitmq : Waiting for rabbitmq to start on first node] ************************************************************ fatal: [localhost]: FAILED! => {"changed": true, "cmd": "docker exec rabbitmq rabbitmqctl wait /var/lib/rabbitmq/mnesia/rabbitmq.pid", "delta": "0:00:00.861054", "end": "2019-05-03 15:17:42.387873", "msg": "non-zero return code", "rc": 137, "start": "2019-05-03 15:17:41.526819", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} When I use command "docker inspect rabbitmq_id |grep RestartCount", I find rabbitmq will restart many times such as: kaga@agre-an21:~$ sudo docker inspect 5567f37cc78a |grep RestartCount "RestartCount": 15, Could please help to solve this problem? Thanks. Regards, Ming-Che Ming-Che Liu <gn01737625@gmail.com> 於 2019年5月3日 週五 上午9:22寫道：
Hi Mark,
Sure, I will do that, thanks.
Regards,
Ming-Che
Mark Goddard <mark@stackhpc.com> 於 2019年5月3日 週五 上午1:12寫道：
On Wed, 1 May 2019 at 17:10, Ming-Che Liu <gn01737625@gmail.com> wrote:
Hello,
I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1.
I follow the steps as mentioned in https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html
The setting in my computer's globals.yml as same as [Quick Start] tutorial (attached file: globals.yml is my setting).
My machine environment as following: OS: Ubuntu 16.04 Kolla-ansible verions: 8.0.0.0rc1 ansible version: 2.7
When I execute [bootstrap-servers] and [prechecks], it seems ok (no fatal error or any interrupt).
But when I execute [deploy], it will occur some error about rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when I set enable_rabbitmq:no).
I have some detail screenshot about the errors as attached files, could you please help me to solve this problem?
Thank you very much.
[Attached file description]: globals.yml: my computer's setting about kolla-ansible
As mentioned above, the following pictures show the errors, the rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova compute service error will occur if I set [enable_rabbitmq:no].
Hi Ming-Che,
Since Stein, we no longer test Kolla Ansible with Ubuntu 16.04 upstream. Could you try again using Ubuntu 18.04?
Regards, Mark
Apologies,this mail will attach rabbitmq log file(ues command "docker logs --follow rabbitmq") for debug. Logs in /var/lib/docker/volumes/kolla_logs/_data/rabbitmq are empty. thanks. Regards, Ming-Che Ming-Che Liu <gn01737625@gmail.com> 於 2019年5月3日 週五 下午3:26寫道：
Hi Mark,
I tried to deploy openstack+monasca with kolla-ansible 8.0.0.0rc1(in the same machine), but still encounter some fatal error.
The attached file:golbals.yml is my setting, machine_package_setting is machine environment setting.
The error is: RUNNING HANDLER [rabbitmq : Waiting for rabbitmq to start on first node] ************************************************************ fatal: [localhost]: FAILED! => {"changed": true, "cmd": "docker exec rabbitmq rabbitmqctl wait /var/lib/rabbitmq/mnesia/rabbitmq.pid", "delta": "0:00:00.861054", "end": "2019-05-03 15:17:42.387873", "msg": "non-zero return code", "rc": 137, "start": "2019-05-03 15:17:41.526819", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
When I use command "docker inspect rabbitmq_id |grep RestartCount", I find rabbitmq will restart many times
such as:
kaga@agre-an21:~$ sudo docker inspect 5567f37cc78a |grep RestartCount "RestartCount": 15,
Could please help to solve this problem? Thanks.
Regards,
Ming-Che
Ming-Che Liu <gn01737625@gmail.com> 於 2019年5月3日 週五 上午9:22寫道：
Hi Mark,
Sure, I will do that, thanks.
Regards,
Ming-Che
Mark Goddard <mark@stackhpc.com> 於 2019年5月3日 週五 上午1:12寫道：
On Wed, 1 May 2019 at 17:10, Ming-Che Liu <gn01737625@gmail.com> wrote:
Hello,
I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1.
I follow the steps as mentioned in https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html
The setting in my computer's globals.yml as same as [Quick Start] tutorial (attached file: globals.yml is my setting).
My machine environment as following: OS: Ubuntu 16.04 Kolla-ansible verions: 8.0.0.0rc1 ansible version: 2.7
When I execute [bootstrap-servers] and [prechecks], it seems ok (no fatal error or any interrupt).
But when I execute [deploy], it will occur some error about rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when I set enable_rabbitmq:no).
I have some detail screenshot about the errors as attached files, could you please help me to solve this problem?
Thank you very much.
[Attached file description]: globals.yml: my computer's setting about kolla-ansible
As mentioned above, the following pictures show the errors, the rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova compute service error will occur if I set [enable_rabbitmq:no].
Hi Ming-Che,
Since Stein, we no longer test Kolla Ansible with Ubuntu 16.04 upstream. Could you try again using Ubuntu 18.04?
Regards, Mark
On Fri, 3 May 2019 at 09:13, Ming-Che Liu <gn01737625@gmail.com> wrote:
Apologies,this mail will attach rabbitmq log file(ues command "docker logs --follow rabbitmq") for debug.
Logs in /var/lib/docker/volumes/kolla_logs/_data/rabbitmq are empty.
Hmm, there's not much to go on there. Are you now running Ubuntu 18.04? One thing that can help is running the container manually via docker run. It can take a little while to work out the right arguments to pass, but it's possible. Mark
thanks.
Regards,
Ming-Che
Ming-Che Liu <gn01737625@gmail.com> 於 2019年5月3日 週五 下午3:26寫道：
Hi Mark,
I tried to deploy openstack+monasca with kolla-ansible 8.0.0.0rc1(in the same machine), but still encounter some fatal error.
The attached file:golbals.yml is my setting, machine_package_setting is machine environment setting.
The error is: RUNNING HANDLER [rabbitmq : Waiting for rabbitmq to start on first node] ************************************************************ fatal: [localhost]: FAILED! => {"changed": true, "cmd": "docker exec rabbitmq rabbitmqctl wait /var/lib/rabbitmq/mnesia/rabbitmq.pid", "delta": "0:00:00.861054", "end": "2019-05-03 15:17:42.387873", "msg": "non-zero return code", "rc": 137, "start": "2019-05-03 15:17:41.526819", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
When I use command "docker inspect rabbitmq_id |grep RestartCount", I find rabbitmq will restart many times
such as:
kaga@agre-an21:~$ sudo docker inspect 5567f37cc78a |grep RestartCount "RestartCount": 15,
Could please help to solve this problem? Thanks.
Regards,
Ming-Che
Ming-Che Liu <gn01737625@gmail.com> 於 2019年5月3日 週五 上午9:22寫道：
Hi Mark,
Sure, I will do that, thanks.
Regards,
Ming-Che
Mark Goddard <mark@stackhpc.com> 於 2019年5月3日 週五 上午1:12寫道：
On Wed, 1 May 2019 at 17:10, Ming-Che Liu <gn01737625@gmail.com> wrote:
Hello,
I deployed openstack+monasca with kolla-ansible 8.0.0.0rc1.
I follow the steps as mentioned in https://docs.openstack.org/kolla-ansible/latest/user/quickstart.html
The setting in my computer's globals.yml as same as [Quick Start] tutorial (attached file: globals.yml is my setting).
My machine environment as following: OS: Ubuntu 16.04 Kolla-ansible verions: 8.0.0.0rc1 ansible version: 2.7
When I execute [bootstrap-servers] and [prechecks], it seems ok (no fatal error or any interrupt).
But when I execute [deploy], it will occur some error about rabbitmq(when I set enable_rabbitmq:yes) and nova compute service(when I set enable_rabbitmq:no).
I have some detail screenshot about the errors as attached files, could you please help me to solve this problem?
Thank you very much.
[Attached file description]: globals.yml: my computer's setting about kolla-ansible
As mentioned above, the following pictures show the errors, the rabbitmq error will occur if I set [enable_rabbitmq:yes], the nova compute service error will occur if I set [enable_rabbitmq:no].
Hi Ming-Che,
Since Stein, we no longer test Kolla Ansible with Ubuntu 16.04 upstream. Could you try again using Ubuntu 18.04?
Regards, Mark
participants (3)
-
Doug Szumski
-
Mark Goddard
-
Ming-Che Liu