Hello Vlad,
the 'cluster network' (aka 'cluster_network') in ceph.conf is just a hint to OSDs which address to use for cluster traffic (as they register it in MONs). We use globals.yml 'cluster_interface' to explicitly run the OSD using the first address on the selected interface for cluster address: ceph-osd ... --cluster-addr {{ hostvars[inventory_hostname]['ansible_' + cluster_interface]['ipv4']['address'] }} ... Therefore, there is no need to set 'cluster network'. If you really want to set it (perhaps for reference), you can set it in '/etc/kolla/config/ceph.conf' (notice no ceph/ directory).
Kind regards, Radek
sob., 29 cze 2019 o 17:33 vladimir franciz blando vladimir.blando@gmail.com napisał(a):
Hi,
In my globals.yml file
cluster_interface: "bond1"
but after deployment, there's nothing on the ceph.conf file that indicates that it's using the cluster interface
# docker exec ceph_mon cat /etc/ceph/ceph.conf [global] log file = /var/log/kolla/ceph/$cluster-$name.log log to syslog = false err to syslog = false log to stderr = false err to stderr = false fsid = f8ff1404-bead-422b-9076-21583012ad30 mon initial members = 172.16.43.22, 172.16.43.11, 172.16.43.12 mon host = 172.16.43.22, 172.16.43.11, 172.16.43.12 mon addr = 172.16.43.22:6789, 172.16.43.11:6789, 172.16.43.12:6789 auth cluster required = cephx auth service required = cephx auth client required = cephx setuser match path = /var/lib/ceph/$type/$cluster-$id
[mon] mon compact on start = true mon cluster log file = /var/log/kolla/ceph/$cluster.log
I was expecting cluster network = <cluster_network_cidr>.
I even tried making a custom config (/etc/kolla/config/ceph/ceph.conf) which includes the cluster network = <cluster_network_cidr> public network = <public_network_cidr>
and run "kolla-ansible -i multinode reconfigure"
but it did nothing, was there something missing on what I did?
- Vlad
ᐧ