Hello,

 

I’ve been trying to get availability zones defined for volumes.

Everything works fine if I leave the zone at “nova”, all volume types work and backups/snapshots also work.

 

ie:

+------------------+----------------------------+------+---------+-------+----------------------------+

| Binary           | Host                       | Zone | Status  | State | Updated At                 |

+------------------+----------------------------+------+---------+-------+----------------------------+

| cinder-scheduler | cs-os-ctl-001              | nova | enabled | up    | 2021-02-05T17:22:51.000000 |

| cinder-scheduler | cs-os-ctl-003              | nova | enabled | up    | 2021-02-05T17:22:54.000000 |

| cinder-scheduler | cs-os-ctl-002              | nova | enabled | up    | 2021-02-05T17:22:56.000000 |

| cinder-volume    | cs-os-ctl-001@rbd-ceph-gp2 | nova | enabled | up    | 2021-02-05T17:22:56.000000 |

| cinder-volume    | cs-os-ctl-001@rbd-ceph-st1 | nova | enabled | up    | 2021-02-05T17:22:54.000000 |

| cinder-volume    | cs-os-ctl-002@rbd-ceph-gp2 | nova | enabled | up    | 2021-02-05T17:22:50.000000 |

| cinder-volume    | cs-os-ctl-003@rbd-ceph-gp2 | nova | enabled | up    | 2021-02-05T17:22:55.000000 |

| cinder-volume    | cs-os-ctl-002@rbd-ceph-st1 | nova | enabled | up    | 2021-02-05T17:22:57.000000 |

| cinder-volume    | cs-os-ctl-003@rbd-ceph-st1 | nova | enabled | up    | 2021-02-05T17:22:54.000000 |

| cinder-backup    | cs-os-ctl-002              | nova | enabled | up    | 2021-02-05T17:22:56.000000 |

| cinder-backup    | cs-os-ctl-001              | nova | enabled | up    | 2021-02-05T17:22:53.000000 |

| cinder-backup    | cs-os-ctl-003              | nova | enabled | up    | 2021-02-05T17:22:58.000000 |

+------------------+----------------------------+------+---------+-------+----------------------------+

 

However, if I apply the following changes:

 

cinder-api.conf

[DEFAULT]

default_availability_zone = not-nova

default_volume_type = ceph-gp2

allow_availability_zone_fallback=True

 

cinder-volume.conf

[rbd-ceph-gp2]

<…>

backend_availability_zone = not-nova

<…>

 

I’ll get the following

+------------------+----------------------------+----------+---------+-------+----------------------------+

| Binary           | Host                       | Zone     | Status  | State | Updated At                 |

+------------------+----------------------------+----------+---------+-------+----------------------------+

| cinder-scheduler | cs-os-ctl-001              | nova     | enabled | up    | 2021-02-05T17:22:51.000000 |

| cinder-scheduler | cs-os-ctl-003              | nova     | enabled | up    | 2021-02-05T17:22:54.000000 |

| cinder-scheduler | cs-os-ctl-002              | nova     | enabled | up    | 2021-02-05T17:22:56.000000 |

| cinder-volume    | cs-os-ctl-001@rbd-ceph-gp2 | not-nova | enabled | up    | 2021-02-05T17:22:56.000000 |

| cinder-volume    | cs-os-ctl-001@rbd-ceph-st1 | nova     | enabled | up    | 2021-02-05T17:22:54.000000 |

| cinder-volume    | cs-os-ctl-002@rbd-ceph-gp2 | not-nova | enabled | up    | 2021-02-05T17:22:50.000000 |

| cinder-volume    | cs-os-ctl-003@rbd-ceph-gp2 | not-nova | enabled | up    | 2021-02-05T17:22:55.000000 |

| cinder-volume    | cs-os-ctl-002@rbd-ceph-st1 | nova     | enabled | up    | 2021-02-05T17:22:57.000000 |

| cinder-volume    | cs-os-ctl-003@rbd-ceph-st1 | nova     | enabled | up    | 2021-02-05T17:22:54.000000 |

| cinder-backup    | cs-os-ctl-002              | nova     | enabled | up    | 2021-02-05T17:22:56.000000 |

| cinder-backup    | cs-os-ctl-001              | nova     | enabled | up    | 2021-02-05T17:22:53.000000 |

| cinder-backup    | cs-os-ctl-003              | nova     | enabled | up    | 2021-02-05T17:22:58.000000 |

+------------------+----------------------------+----------+---------+-------+----------------------------+

 

At this point, creating new volumes still work and go into the expected ceph pools.

However, backups no longer work for the cinder-volume that is not nova.

In the above example, it still works fine for volumes that that were created with type “ceph-gp2” in az “nova”.

Does not work for volumes that were created with type “ceph-st1” in az “not-nova”. It fails immediately and goes into error state with reason “Service not found for creating backup.”

I suspect I need to try to get another set of “cinder-backup” services running in the Zone “not-nova”, but cannot seem to figure out how.

 

I’ve scoured the docs on cinder.conf, and if I set default zones in cinder-backup (I’ve tried backend_availability_zone, default_availability_zone, and storage_availability_zone) I cannot seem to get backups working if the disk it’s backing up is not in az “nova”. The cinder-backup service in volume service list will always show “nova” no matter what I put there.

 

Any advice would be appreciated.

OpenStack Victoria deployed via kolla-ansible

 

Thanks!