Hello Vlad,

the 'cluster network' (aka 'cluster_network') in ceph.conf is just a hint to OSDs which address to use for cluster traffic (as they register it in MONs).
We use globals.yml 'cluster_interface' to explicitly run the OSD using the first address on the selected interface for cluster address:
ceph-osd ... --cluster-addr {{ hostvars[inventory_hostname]['ansible_' + cluster_interface]['ipv4']['address'] }} ...
Therefore, there is no need to set 'cluster network'.
If you really want to set it (perhaps for reference), you can set it in '/etc/kolla/config/ceph.conf' (notice no ceph/ directory).

Kind regards,
Radek

sob., 29 cze 2019 o 17:33 vladimir franciz blando <vladimir.blando@gmail.com> napisał(a):
Hi,

In my globals.yml file 
---
cluster_interface: "bond1"
---

but after deployment, there's nothing on the ceph.conf file that indicates that it's using the cluster interface
---
# docker exec ceph_mon cat /etc/ceph/ceph.conf
[global]
log file = /var/log/kolla/ceph/$cluster-$name.log
log to syslog = false
err to syslog = false
log to stderr = false
err to stderr = false
fsid = f8ff1404-bead-422b-9076-21583012ad30
mon initial members = 172.16.43.22, 172.16.43.11, 172.16.43.12
mon host = 172.16.43.22, 172.16.43.11, 172.16.43.12
mon addr = 172.16.43.22:6789, 172.16.43.11:6789, 172.16.43.12:6789
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
setuser match path = /var/lib/ceph/$type/$cluster-$id

[mon]
mon compact on start = true
mon cluster log file = /var/log/kolla/ceph/$cluster.log
---
I was expecting 
cluster network = <cluster_network_cidr>.

I even tried making a custom config (/etc/kolla/config/ceph/ceph.conf) which includes the 
cluster network = <cluster_network_cidr>
public network = <public_network_cidr>

and run "kolla-ansible -i multinode reconfigure"

but it did nothing, was there something missing on what I did?


- Vlad
ᐧ