cinder-volume showing down
Hi team, I am using the openstack rocky version and everything was working fine,but today i am getting some errors while creating new instances and instances not creating.I checked services and it is showing down
--------+ | Binary | Host | Zone | Status | State | Updated At | +------------------+--------------+------+---------+-------+-------------------- --------+ | cinder-scheduler | controller | nova | enabled | up | 2022-06-28T05:18:38 .000000 | | cinder-volume | storage1@lvm | nova | enabled | down | 2022-06-28T05:02:20 .000000 |
---> The cinder log showing below error 2022-06-28 10:37:51.149 1629 ERROR cinder.service [-] Manager for service cinder-volume storage1@lvm is reporting problems, not sending heartbeat. Service will appear "down". Please help
Thanks & Regards Midhunlal N B
Hi Midhunlal,
On Tue, Jun 28, 2022 at 11:54 AM Midhunlal Nb midhunlaln66@gmail.com wrote:
Hi team, I am using the openstack rocky version and everything was working fine,but today i am getting some errors while creating new instances and instances not creating.I checked services and it is showing down
--------+ | Binary | Host | Zone | Status | State | Updated At | +------------------+--------------+------+---------+-------+-------------------- --------+ | cinder-scheduler | controller | nova | enabled | up | 2022-06-28T05:18:38 .000000 | | cinder-volume | storage1@lvm | nova | enabled | down | 2022-06-28T05:02:20 .000000 |
---> The cinder log showing below error 2022-06-28 10:37:51.149 1629 ERROR cinder.service [-] Manager for service cinder-volume storage1@lvm is reporting problems, not sending heartbeat. Service will appear "down". Please help
The cinder-volume service could be down for a variety of reasons depending on the backend. This error is generic for every backend and doesn't tell us anything about why the backend is down. Since it is lvm, I would suggest you to check if proper physical volumes (pvdisplay) and volume groups (vgs) are created.
Thanks & Regards Midhunlal N B
Hi Midhunlal,
You will most of the time find the actual error earlier in the log. The line you see here is just the regular update that the service is still down. If I need to troubleshoot such issues I always restart cinder-volume and take a look at the logs it produces during startup. Most of the time you can find a clue there.
Best Regards Felix Hüttner
From: Midhunlal Nb midhunlaln66@gmail.com Sent: Tuesday, June 28, 2022 8:12 AM To: openstack-discuss openstack-discuss@lists.openstack.org Subject: cinder-volume showing down
Hi team, I am using the openstack rocky version and everything was working fine,but today i am getting some errors while creating new instances and instances not creating.I checked services and it is showing down
--------+ | Binary | Host | Zone | Status | State | Updated At | +------------------+--------------+------+---------+-------+-------------------- --------+ | cinder-scheduler | controller | nova | enabled | up | 2022-06-28T05:18:38 .000000 | | cinder-volume | storage1@lvm | nova | enabled | down | 2022-06-28T05:02:20 .000000 |
---> The cinder log showing below error 2022-06-28 10:37:51.149 1629 ERROR cinder.service [-] Manager for service cinder-volume storage1@lvm is reporting problems, not sending heartbeat. Service will appear "down". Please help
Thanks & Regards Midhunlal N B
Diese E Mail enthält möglicherweise vertrauliche Inhalte und ist nur für die Verwertung durch den vorgesehenen Empfänger bestimmt. Sollten Sie nicht der vorgesehene Empfänger sein, setzen Sie den Absender bitte unverzüglich in Kenntnis und löschen diese E Mail. Hinweise zum Datenschutz finden Sie hierhttps://www.datenschutz.schwarz.
Hi, When I restart cinder-volume then it came up after few minutes again going down
On Tue, Jun 28, 2022, 12:55 PM Felix Hüttner felix.huettner@mail.schwarz wrote:
Hi Midhunlal,
You will most of the time find the actual error earlier in the log. The line you see here is just the regular update that the service is still down.
If I need to troubleshoot such issues I always restart cinder-volume and take a look at the logs it produces during startup. Most of the time you can find a clue there.
Best Regards
*Felix Hüttner*
*From:* Midhunlal Nb midhunlaln66@gmail.com *Sent:* Tuesday, June 28, 2022 8:12 AM *To:* openstack-discuss openstack-discuss@lists.openstack.org *Subject:* cinder-volume showing down
Hi team, I am using the openstack rocky version and everything was working fine,but today i am getting some errors while creating new instances and instances not creating.I checked services and it is showing down
--------+ | Binary | Host | Zone | Status | State | Updated At | +------------------+--------------+------+---------+-------+-------------------- --------+ | cinder-scheduler | controller | nova | enabled | up | 2022-06-28T05:18:38 .000000 | | cinder-volume | storage1@lvm | nova | enabled | down | 2022-06-28T05:02:20 .000000 |
---> The cinder log showing below error
2022-06-28 10:37:51.149 1629 ERROR cinder.service [-] Manager for service cinder-volume storage1@lvm is reporting problems, not sending heartbeat. Service will appear "down".
Please help
Thanks & Regards Midhunlal N B
Diese E Mail enthält möglicherweise vertrauliche Inhalte und ist nur für die Verwertung durch den vorgesehenen Empfänger bestimmt. Sollten Sie nicht der vorgesehene Empfänger sein, setzen Sie den Absender bitte unverzüglich in Kenntnis und löschen diese E Mail. Hinweise zum Datenschutz finden Sie hier https://www.datenschutz.schwarz.
If you shared more details (e.g. add some cinder logs) others might be able to help understand the issue. Have you checked disk space on the cinder-volume host? Could the LVM be full? Check syslog (and paste relevant information here) for any further hints, otherwise it's just wild guessing.
Zitat von Midhunlal Nb midhunlaln66@gmail.com:
Hi, When I restart cinder-volume then it came up after few minutes again going down
On Tue, Jun 28, 2022, 12:55 PM Felix Hüttner felix.huettner@mail.schwarz wrote:
Hi Midhunlal,
You will most of the time find the actual error earlier in the log. The line you see here is just the regular update that the service is still down.
If I need to troubleshoot such issues I always restart cinder-volume and take a look at the logs it produces during startup. Most of the time you can find a clue there.
Best Regards
*Felix Hüttner*
*From:* Midhunlal Nb midhunlaln66@gmail.com *Sent:* Tuesday, June 28, 2022 8:12 AM *To:* openstack-discuss openstack-discuss@lists.openstack.org *Subject:* cinder-volume showing down
Hi team, I am using the openstack rocky version and everything was working fine,but today i am getting some errors while creating new instances and instances not creating.I checked services and it is showing down
--------+ | Binary | Host | Zone | Status | State | Updated At | +------------------+--------------+------+---------+-------+-------------------- --------+ | cinder-scheduler | controller | nova | enabled | up | 2022-06-28T05:18:38 .000000 | | cinder-volume | storage1@lvm | nova | enabled | down | 2022-06-28T05:02:20 .000000 |
---> The cinder log showing below error
2022-06-28 10:37:51.149 1629 ERROR cinder.service [-] Manager for service cinder-volume storage1@lvm is reporting problems, not sending heartbeat. Service will appear "down".
Please help
Thanks & Regards Midhunlal N B
Diese E Mail enthält möglicherweise vertrauliche Inhalte und ist nur für die Verwertung durch den vorgesehenen Empfänger bestimmt. Sollten Sie nicht der vorgesehene Empfänger sein, setzen Sie den Absender bitte unverzüglich in Kenntnis und löschen diese E Mail. Hinweise zum Datenschutz finden Sie hier https://www.datenschutz.schwarz.
participants (4)
-
Eugen Block
-
Felix Hüttner
-
Midhunlal Nb
-
Rajat Dhasmana