<div dir="ltr"><div>Hello guys,</div><div>I had the same problem, there is no more error log.</div><div><br></div><div>I resolved by turning off cinder-api, cinder-scheduler and cinder-backup then removing these queues, such as cinder, cinder-scheduler and cinder-backup..</div><div><br></div><div>I enabled debug log on rabbitmq and cinder, however, I cannot see any related logs,</div><div><br></div><div><br></div><div>2023-07-13 20:57:22.903 666 INFO cinder.backup.manager [req-019d2459-6f43-4839-8ad6-71c805dbd708 6371ebfe0fce499983b1f07e7c34bf6d 183e47a6dd14489991db5c3cf4132a2a - - -] Create backup started, backup: 2cebd275-6fc3-47ae-8c8d-3337f9227057 volume: d8446fb4-032a-44a1-b47d-f922c4a0020e.<br>2023-07-13 20:57:22.919 666 INFO cinder.backup.manager [req-019d2459-6f43-4839-8ad6-71c805dbd708 6371ebfe0fce499983b1f07e7c34bf6d 183e47a6dd14489991db5c3cf4132a2a - - -] Call Volume Manager to get_backup_device for Backup(availability_zone=None,container=None,created_at=2023-07-13T13:57:22Z,data_timestamp=2023-07-13T13:57:22Z,deleted=False,deleted_at=None,display_description='',display_name='ijoo',encryption_key_id=None,fail_reason=None,host='controller01',id=2cebd275-6fc3-47ae-8c8d-3337f9227057,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='183e47a6dd14489991db5c3cf4132a2a',restore_volume_id=None,service='cinder.backup.drivers.nfs.NFSBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6371ebfe0fce499983b1f07e7c34bf6d',volume_id=d8446fb4-032a-44a1-b47d-f922c4a0020e)<br><br></div><div><br></div><div>It is hard to reproduce this problems.</div><div><br></div><div><br></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Nguyen Huu Khoi<br></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Feb 1, 2023 at 7:08 PM Gorka Eguileor <<a href="mailto:geguileo@redhat.com">geguileo@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">On 27/01, Satish Patel wrote:<br>
> Thank you Jon/Sofia,<br>
><br>
> Biggest issue is even if I turn on debugging, it's not producing enough<br>
> logs to see what is going on. See following output.<br>
><br>
> <a href="https://paste.opendev.org/show/bh9OF9l2OrozrNMglv2Y/" rel="noreferrer" target="_blank">https://paste.opendev.org/show/bh9OF9l2OrozrNMglv2Y/</a><br>
<br>
Hi,<br>
<br>
I don't see the cinder-volume logs, which are necessary to debug this<br>
issue, because we can see in the backup logs that it is doing an RPC<br>
call to the cinder-volume service "Call Volume Manager to<br>
get_backup_device".<br>
<br>
What is the value of the "host" field of the source volume?<br>
<br>
Because if it's anything other than "kolla-infra-1.example.com@rbd-1",<br>
then the problem is that the cinder-volume service for that backend is<br>
currently down.<br>
<br>
Cheers,<br>
Gorka.<br>
<br>
><br>
> On Fri, Jan 27, 2023 at 10:50 AM Jon Bernard <<a href="mailto:jobernar@redhat.com" target="_blank">jobernar@redhat.com</a>> wrote:<br>
><br>
> > Without the logs themselves it's really hard to say. One way to proceed<br>
> > would be to file a bug [1] and the team can work with you there. You<br>
> > could also enable debugging (debug = True), reproduce the failure, and<br>
> > upload the relevant logs there as well.<br>
> ><br>
> > [1]: <a href="https://bugs.launchpad.net/cinder/+filebug" rel="noreferrer" target="_blank">https://bugs.launchpad.net/cinder/+filebug</a><br>
> ><br>
> > --<br>
> > Jon<br>
> ><br>
> > On Thu, Jan 26, 2023 at 2:20 PM Satish Patel <<a href="mailto:satish.txt@gmail.com" target="_blank">satish.txt@gmail.com</a>> wrote:<br>
> ><br>
> >> Folks,<br>
> >><br>
> >> I have configured nova and cinder with ceph storage. VMs running on ceph<br>
> >> storage but now when i am trying to create a backup of cinder volume its<br>
> >> getting stuck on creating and doing nothing. Logs also do not give any<br>
> >> indication of bad.<br>
> >><br>
> >> My cinder.conf<br>
> >><br>
> >> [DEFAULT]<br>
> >><br>
> >> enabled_backends = rbd-1<br>
> >> backup_driver = cinder.backup.drivers.ceph.CephBackupDriver<br>
> >> backup_ceph_conf = /etc/ceph/ceph.conf<br>
> >> backup_ceph_user = cinder-backup<br>
> >> backup_ceph_chunk_size = 134217728<br>
> >> backup_ceph_pool = backups<br>
> >> backup_ceph_stripe_unit = 0<br>
> >> backup_ceph_stripe_count = 0<br>
> >> restore_discard_excess_bytes = true<br>
> >> osapi_volume_listen = 10.73.0.181<br>
> >> osapi_volume_listen_port = 8776<br>
> >><br>
> >><br>
> >> Output of "openstack volume service list" showing cinder-backup service<br>
> >> is up but when i create a backup it's getting stuck in this stage and no<br>
> >> activity. I am not seeing anything getting transferred to the ceph backups<br>
> >> pool also. Any clue? or method to debug?<br>
> >><br>
> >> # openstack volume backup list --all<br>
> >><br>
> >> +--------------------------------------+------+-------------+----------+------+<br>
> >> | ID | Name | Description | Status |<br>
> >> Size |<br>
> >><br>
> >> +--------------------------------------+------+-------------+----------+------+<br>
> >> | bc844d55-8c5a-4bd3-b0e9-7c4c780c95ad | foo1 | | creating |<br>
> >> 20 |<br>
> >><br>
> >> +--------------------------------------+------+-------------+----------+------+<br>
> >><br>
> ><br>
<br>
<br>
</blockquote></div>