<div dir="ltr"><br><br><div class="gmail_quote"><div dir="ltr">On Sun, Jul 1, 2018 at 9:02 AM Jay Bryant <<a href="mailto:jsbryant@electronicjungle.net">jsbryant@electronicjungle.net</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Kevin,<div><br></div><div>Just a note thatyou may need to look way back in the logs to find the cause as there m as y be many periodic job failures filling the logs.</div><div><br></div><div>Jay<br><br><div class="gmail_quote"><div dir="ltr">On Sun, Jul 1, 2018, 7:09 AM Ivan Kolodyazhny <<a href="mailto:e0ne@e0ne.info" target="_blank">e0ne@e0ne.info</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi Kevin,<div><br></div><div>Do you have any errors or tracebacks in /var/log/cinder/cinder-volume.log?</div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail-m_-2845406448227654699m_-7482879711859074724gmail_signature"><div dir="ltr"><div>Regards,<br>Ivan Kolodyazhny,<br><a href="http://blog.e0ne.info/" target="_blank">http://blog.e0ne.info/</a></div></div></div></div>
<br><div class="gmail_quote">On Sun, Jul 1, 2018 at 12:02 PM, Kevin Kwon <span dir="ltr"><<a href="mailto:poby1972@gmail.com" target="_blank">poby1972@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div>Dear All!</div><div><br></div><div><br></div><div>would you please let me know how can troubleshoot below case?</div><div><br></div><div>i don't know why below Storage server is down.</div><div><br></div><div>Please help to figure it out..</div><div><br></div><div><div><br></div><div>root@OpenStack-Controller:~# openstack volume service list</div><div>+------------------+-----------------------+------+---------+-------+----------------------------+</div><div>| Binary           | Host                  | Zone | Status  | State | Updated At                 |</div><div>+------------------+-----------------------+------+---------+-------+----------------------------+</div><div>| cinder-scheduler | OpenStack-Controller  | nova | enabled | up    | 2018-07-01T08:58:19.000000 |</div><div>| cinder-volume    | OpenStack-Storage@lvm | nova | enabled | down  | 2018-07-01T07:28:59.000000 |</div><div>+------------------+-----------------------+------+---------+-------+----------------------------+</div></div></div></blockquote></div></div></blockquote></div></div></blockquote><div><br></div><div>I don't know what tooling you use to deploy OpenStack, but I notice cinder-volume's backend is named "lvm." Do you know if the LVM backend is configured to use a dedicated block device on the storage node? Or might it be using a loopback device such how tooling like puppet-cinder handles things (see [1])? </div><div><br></div><div>[1] <a href="https://github.com/openstack/puppet-cinder/blob/master/manifests/setup_test_volume.pp#L22">https://github.com/openstack/puppet-cinder/blob/master/manifests/setup_test_volume.pp#L22</a></div><div><br></div><div>If the LVM  backend uses a loopback device, then remember that loopback devices are not automatically restored on reboot. A common failure scenario is the storage node reboots, and the cinder-volume LVM backend does not come up because the LVM loopback device isn't restored.</div><div><br></div><div>Alan</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div>root@OpenStack-Controller:~#</div></div><span class="gmail-m_-2845406448227654699m_-7482879711859074724HOEnZb"><font color="#888888"><div><br></div><div><br></div><div>Kevin</div><div><br></div></font></span></div>
<br>_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to     : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br></blockquote></div><br></div>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
</blockquote></div></div>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
</blockquote></div></div>