Hello,

I'm trying to extend an old small test lab Queens environment with dedicated Ceph Storage nodes.

I would like to add some disks to the storage nodes and so I customize my original

templates/ceph-config.yaml adding them under devices section:

parameter_defaults:
  CephAnsibleDisksConfig:
    osd_scenario: lvm
    osd_objectstore: bluestore
    devices:
      - /dev/sda
      - /dev/sdb
      - /dev/sdc

. . .

When I run the overcloud deploy I get this in ceph-install-workflow.log

2021-04-06 21:24:57,955 p=32618 u=mistral |  TASK [ceph-docker-common : pulling docker.io/ceph/daemon:v3.2.10-stable-3.2-luminous-centos-7-x86_64 image] ***
2021-04-06 21:24:57,955 p=32618 u=mistral |  Tuesday 06 April 2021  21:24:57 +0200 (0:00:00.153)       0:06:17.978 *********
2021-04-06 21:25:13,206 p=32618 u=mistral |  FAILED - RETRYING: pulling docker.io/ceph/daemon:v3.2.10-stable-3.2-luminous-centos-7-x86_64 image (3 retries left).

. . .

2021-04-06 21:26:03,715 p=32618 u=mistral |  FAILED - RETRYING: pulling docker.io/ceph/daemon:v3.2.10-stable-3.2-luminous-centos-7-x86_64 image (1 retries left).
2021-04-06 21:26:28,839 p=32618 u=mistral |  fatal: [172.23.0.232]: FAILED! => {"attempts": 3, "changed": false, "cmd": ["timeout", "300s", "docker", "pull", "docker.io/ceph/daemon:v3.2.10-stable-3.2-luminous-centos-7-x86_64"], "delta": "0:00:15.022274", "end": "2021-04-06 21:25:48.701980", "msg": "non-zero return code", "rc": 1, "start": "2021-04-06 21:25:33.679706", "stderr": "Get https://registry-1.docker.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)", "stderr_lines": ["Get https://registry-1.docker.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"], "stdout": "Trying to pull repository docker.io/ceph/daemon ... ", "stdout_lines": ["Trying to pull repository docker.io/ceph/daemon ... "]}

So it seems the docker images are not there any more.

My existing ceph nodes are using that image:

[heat-admin@ostack-ceph0 ~]$ sudo docker ps
CONTAINER ID        IMAGE                                                               COMMAND                  CREATED             STATUS              PORTS               NAMES
7ad4aeb3f4cb        docker.io/ceph/daemon:v3.2.10-stable-3.2-luminous-centos-7-x86_64   "/entrypoint.sh"         3 weeks ago         Up 3 weeks                              ceph-osd-0
0dc9a9889283        docker.io/ceph/daemon:v3.2.10-stable-3.2-luminous-centos-7-x86_64   "/entrypoint.sh"         3 weeks ago         Up 3 weeks                              ceph-osd-3
8d543016cce7        docker.io/tripleoqueens/centos-binary-cron:current-tripleo          "dumb-init --singl..."   11 months ago       Up 3 weeks                              logrotate_crond
[heat-admin@ostack-ceph0 ~]$

Any way or suggestion to manage this?

Thanks,

Gianluca