[Triple0] [Wallaby] External Ceph Integration getting failed

Francesco Pantano fpantano at redhat.com
Thu Aug 4 13:51:45 UTC 2022


Hi,
ceph is supposed to be configured by this tripleo-ansible role [1], which
is triggered by tht on external_deploy_steps [2].
In theory adding [3] should just work, assuming you customize the ceph
cluster mon ip addresses, fsid and a few other related variables.
>From your previous email I suspect in your external-ceph.yaml you missed
the TripleO resource OS::TripleO::Services::CephExternal:
../deployment/cephadm/ceph-client.yaml
(see [3]).

Thanks,
Francesco


[1]
https://github.com/openstack/tripleo-ansible/tree/master/tripleo_ansible/roles/tripleo_ceph_client
[2]
https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/cephadm/ceph-client.yaml#L93
[3]
https://github.com/openstack/tripleo-heat-templates/blob/master/environments/external-ceph.yaml

On Thu, Aug 4, 2022 at 2:01 PM Lokendra Rathour <lokendrarathour at gmail.com>
wrote:

> Hi Team,
> I was trying to integrate External Ceph with Triple0 Wallaby, and at the
> end of deployment in step4 getting the below error:
>
> 2022-08-03 18:37:21,158 p=507732 u=stack n=ansible | 2022-08-03
> 18:37:21.157962 | 525400fe-86b8-65d9-d100-0000000080d2 |       TASK |
> Create containers from
> /var/lib/tripleo-config/container-startup-config/step_4
> 2022-08-03 18:37:21,239 p=507732 u=stack n=ansible | 2022-08-03
> 18:37:21.238718 | 69e98219-f748-4af7-a6d0-f8f73680ce9b |   INCLUDED |
> /usr/share/ansible/roles/tripleo_container_manage/tasks/create.yml |
> overcloud-controller-2
> 2022-08-03 18:37:21,273 p=507732 u=stack n=ansible | 2022-08-03
> 18:37:21.272340 | 525400fe-86b8-65d9-d100-0000000086d9 |       TASK |
> Create containers managed by Podman for
> /var/lib/tripleo-config/container-startup-config/step_4
> 2022-08-03 18:37:24,532 p=507732 u=stack n=ansible | 2022-08-03
> 18:37:24.530812 |                                      |    WARNING |
> ERROR: Can't run container nova_libvirt_init_secret
> stderr:
> 2022-08-03 18:37:24,533 p=507732 u=stack n=ansible | 2022-08-03
> 18:37:24.532811 | 525400fe-86b8-65d9-d100-0000000082ec |      FATAL |
> Create containers managed by Podman for
> /var/lib/tripleo-config/container-startup-config/step_4 |
> overcloud-novacompute-0 | error={"changed": false, "msg": "Failed
> containers: nova_libvirt_init_secret"}
> 2022-08-03 18:37:44,282 p=507732 u
>
>
> *external-ceph.conf:*
>
> parameter_defaults:
>   # Enable use of RBD backend in nova-compute
>   NovaEnableRbdBackend: True
>   # Enable use of RBD backend in cinder-volume
>   CinderEnableRbdBackend: True
>   # Backend to use for cinder-backup
>   CinderBackupBackend: ceph
>   # Backend to use for glance
>   GlanceBackend: rbd
>   # Name of the Ceph pool hosting Nova ephemeral images
>   NovaRbdPoolName: vms
>   # Name of the Ceph pool hosting Cinder volumes
>   CinderRbdPoolName: volumes
>   # Name of the Ceph pool hosting Cinder backups
>   CinderBackupRbdPoolName: backups
>   # Name of the Ceph pool hosting Glance images
>   GlanceRbdPoolName: images
>   # Name of the user to authenticate with the external Ceph cluster
>   CephClientUserName: admin
>   # The cluster FSID
>   CephClusterFSID: 'ca3080-aaaa-4d1a-b1fd-4aaaa9a9ea4c'
>   # The CephX user auth key
>   CephClientKey: 'AQDgRjhiuLMnAxAAnYwgERERFy0lzH6ufSl70A=='
>   # The list of Ceph monitors
>   CephExternalMonHost:
> 'abcd:abcd:abcd::11,abcd:abcd:abcd::12,abcd:abcd:abcd::13'
> ~
>
>
> Have tried checking and validating the ceph client details and they seem
> to be correct, further digging the container log I could see something like
> this :
>
> [root at overcloud-novacompute-0 containers]# tail -f
> nova_libvirt_init_secret.log
> tail: cannot open 'nova_libvirt_init_secret.log' for reading: No such file
> or directory
> tail: no files remaining
> [root at overcloud-novacompute-0 containers]# tail -f
> stdouts/nova_libvirt_init_secret.log
> 2022-08-04T11:48:47.689898197+05:30 stdout F
> ------------------------------------------------
> 2022-08-04T11:48:47.690002011+05:30 stdout F Initializing virsh secrets
> for: ceph:admin
> 2022-08-04T11:48:47.690590594+05:30 stdout F Error: /etc/ceph/ceph.conf
> was not found
> 2022-08-04T11:48:47.690625088+05:30 stdout F Path to
> nova_libvirt_init_secret was ceph:admin
> 2022-08-04T16:20:29.643785538+05:30 stdout F
> ------------------------------------------------
> 2022-08-04T16:20:29.643785538+05:30 stdout F Initializing virsh secrets
> for: ceph:admin
> 2022-08-04T16:20:29.644785532+05:30 stdout F Error: /etc/ceph/ceph.conf
> was not found
> 2022-08-04T16:20:29.644785532+05:30 stdout F Path to
> nova_libvirt_init_secret was ceph:admin
> ^C
> [root at overcloud-novacompute-0 containers]# tail -f
> stdouts/nova_compute_init_log.log
>
> --
> ~ Lokendra
> skype: lokendrarathour
>
>
>

-- 
Francesco Pantano
GPG KEY: F41BD75C
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.openstack.org/pipermail/openstack-discuss/attachments/20220804/3bb8510f/attachment.htm>


More information about the openstack-discuss mailing list