So my theory was that this conflict happens while packages are tried
to be fetched from different sources. And it could be still the case,
as repo defenition might still be present on your hosts...

Can you provide the output of the following commands:
* apt-cache policy show python3-rbd
* apt-cache policy show python-ceph

But might be you are right, and it should be just python3-ceph, as
after all Cinder is running in py3.6 venv, so it should not need
python2 bindings indeed.

вт, 16 июл. 2024 г. в 08:03, Danish Khan <danish52.jmi@gmail.com>:
>
> Dear Dmitriy,
>
> As suggested, I have updated  ceph_pkg_source to distro but got stuck at same point:
>
> TASK [ceph_client : Install ceph packages] *********************************************************************************************************************************
> FAILED - RETRYING: Install ceph packages (5 retries left).
> FAILED - RETRYING: Install ceph packages (4 retries left).
> FAILED - RETRYING: Install ceph packages (3 retries left).
> FAILED - RETRYING: Install ceph packages (2 retries left).
> FAILED - RETRYING: Install ceph packages (1 retries left).
> fatal: [sp-uat-infra-c1]: FAILED! => {"attempts": 5, "cache_update_time": 1721109265, "cache_updated": false, "changed": false, "msg": "'/usr/bin/apt-get -y -o \"Dpkg::Options::=--force-confdef\" -o \"Dpkg::Options::=--force-confold\"      install 'python-ceph'' failed: E: Unable to correct problems, you have held broken packages.\n", "rc": 100, "stderr": "E: Unable to correct problems, you have held broken packages.\n", "stderr_lines": ["E: Unable to correct problems, you have held broken packages."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSome packages could not be installed. This may mean that you have\nrequested an impossible situation or if you are using the unstable\ndistribution that some required packages have not yet been created\nor been moved out of Incoming.\nThe following information may help to resolve the situation:\n\nThe following packages have unmet dependencies:\n python-ceph : Depends: python-cephfs (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed\n               Depends: python-rados (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed\n               Depends: python-rbd (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Some packages could not be installed. This may mean that you have", "requested an impossible situation or if you are using the unstable", "distribution that some required packages have not yet been created", "or been moved out of Incoming.", "The following information may help to resolve the situation:", "", "The following packages have unmet dependencies:", " python-ceph : Depends: python-cephfs (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed", "               Depends: python-rados (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed", "               Depends: python-rbd (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed"]}
>
> I think this is the issue with python dependency,
>
> #vi /etc/ansible/roles/ceph_client/vars/debian.yml.
> python_ceph_packages:
>   - python-ceph
>   - python3-rados
>   - python3-rbd
>
> python-ceph is not getting installed due to dependency and if I fix the dependency then other python packages python3-rados and python3-rbd are failing because they need higher version of the same dependency.
>
> I am completely stuck in a loophole here :(.
>
> Regard,
> Danish Khan
>
> On Tue, Jul 16, 2024 at 12:27 AM Dmitriy Rabotyagov <noonedeadpunk@gmail.com> wrote:
>>
>> Hey!
>>
>> Have you tried setting `ceph_pkg_source: distro`?
>> This will use distro-available repositories rather than community
>> ones, which might be already shut down.
>>
>> пн, 15 июл. 2024 г. в 17:53, Danish Khan <danish52.jmi@gmail.com>:
>> >
>> > Dear Team,
>> >
>> > I am trying to deploy an openstack-ansible train with Ceph-ansible. I am stuck in a loophole due to python dependencies.
>> >
>> > As suggested, I applied a fix for the rabbitmq version  and I am able to deploy openstack-ansible train successfully without ceph.
>> >
>> > But when I am deploying it with ceph then it is getting stuck at below:
>> >
>> > TASK [ceph_client : Install ceph packages] *********************************************************************************************************************************
>> > FAILED - RETRYING: Install ceph packages (5 retries left).
>> > FAILED - RETRYING: Install ceph packages (4 retries left).
>> > FAILED - RETRYING: Install ceph packages (3 retries left).
>> > FAILED - RETRYING: Install ceph packages (2 retries left).
>> > FAILED - RETRYING: Install ceph packages (1 retries left).
>> > fatal: [sp-uat-infra-c1]: FAILED! => {"attempts": 5, "cache_update_time": 1721053914, "cache_updated": false, "changed": false, "msg": "'/usr/bin/apt-get -y -o \"Dpkg::Options::=--force-confdef\" -o \"Dpkg::Options::=--force-confold\"      install 'ceph-common' 'python-ceph'' failed: E: Unable to correct problems, you have held broken packages.\n", "rc": 100, "stderr": "E: Unable to correct problems, you have held broken packages.\n", "stderr_lines": ["E: Unable to correct problems, you have held broken packages."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSome packages could not be installed. This may mean that you have\nrequested an impossible situation or if you are using the unstable\ndistribution that some required packages have not yet been created\nor been moved out of Incoming.\nThe following information may help to resolve the situation:\n\nThe following packages have unmet dependencies:\n python-ceph : Depends: python-cephfs (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed\n               Depends: python-rados (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed\n               Depends: python-rbd (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Some packages could not be installed. This may mean that you have", "requested an impossible situation or if you are using the unstable", "distribution that some required packages have not yet been created", "or been moved out of Incoming.", "The following information may help to resolve the situation:", "", "The following packages have unmet dependencies:", " python-ceph : Depends: python-cephfs (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed", "               Depends: python-rados (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed", "               Depends: python-rbd (>= 12.2.13-0ubuntu0.18.04.11) but it is not going to be installed"]}
>> >
>> >
>> > python-ceph is not getting install due to dependencies:
>> >
>> > #vi /etc/ansible/roles/ceph_client/vars/debian.yml.
>> > python_ceph_packages:
>> >   - python-ceph
>> >   - python3-rados
>> >   - python3-rbd
>> >
>> > I tried to update python-ceph with python3-ceph and the deployment was successful but the cinder-volume service is not coming up due to python error:
>> > #journalctl -u cinder-volume.service -f
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service [req-53d87e63-50ab-4976-b531-2b8ffdb82900 - - - - -] Error starting thread.: TypeError: expected bytes, str found
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service Traceback (most recent call last):
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service   File "/openstack/venvs/cinder-20.2.6/lib/python3.6/site-packages/oslo_service/service.py", line 810, in run_service
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service     service.start()
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service   File "/openstack/venvs/cinder-20.2.6/lib/python3.6/site-packages/cinder/service.py", line 229, in start
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service     service_id=Service.service_id)
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service   File "/openstack/venvs/cinder-20.2.6/lib/python3.6/site-packages/cinder/volume/manager.py", line 444, in init_host
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service     self._init_host(added_to_cluster, **kwargs)
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service   File "/openstack/venvs/cinder-20.2.6/lib/python3.6/site-packages/cinder/volume/manager.py", line 478, in _init_host
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service     self.driver.init_capabilities()
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service   File "/openstack/venvs/cinder-20.2.6/lib/python3.6/site-packages/cinder/volume/driver.py", line 760, in init_capabilities
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service     stats = self.get_volume_stats(True)
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service   File "/openstack/venvs/cinder-20.2.6/lib/python3.6/site-packages/cinder/volume/drivers/rbd.py", line 643, in get_volume_stats
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service     self._update_volume_stats()
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service   File "/openstack/venvs/cinder-20.2.6/lib/python3.6/site-packages/cinder/volume/drivers/rbd.py", line 620, in _update_volume_stats
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service     free_capacity, total_capacity = self._get_pool_stats()
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service   File "/openstack/venvs/cinder-20.2.6/lib/python3.6/site-packages/cinder/volume/drivers/rbd.py", line 549, in _get_pool_stats
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service     '{"prefix":"df", "format":"json"}', '')
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service   File "rados.pyx", line 1067, in rados.Rados.mon_command
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service TypeError: expected bytes, str found
>> > 2024-07-15 21:18:43.753 1277912 ERROR oslo_service.service
>> >
>> > Regards,
>> > Danish Khan
>> >
>> >
>> >
>> >