<div dir="ltr"><div class="gmail_default" style="font-family:'times new roman',serif"><div class="gmail_default">I am working from <a href="http://docs.openstack.org/icehouse/install-guide/install/yum/content/cinder-verify.html">http://docs.openstack.org/icehouse/install-guide/install/yum/content/cinder-verify.html</a> step 3. When I go to create a new volume, I get an error in the cinder list command.</div>
<div class="gmail_default"><br></div><div class="gmail_default">I checked the directory /var/log/cinder and it is empty. I found a suggestion that it had to be owned by user cinder so I tried chown cinder:cinder /var/log/cinder. No joy.</div>
<div class="gmail_default"><br></div><div class="gmail_default">I did some more checking. The daemon dies within a few seconds of starting.</div><div class="gmail_default"><br></div><div class="gmail_default">root@storage5-prod.storage5-prod:~# service openstack-cinder-volume start</div>
<div class="gmail_default">Starting openstack-cinder-volume: [ OK ]</div><div class="gmail_default">root@storage5-prod.storage5-prod:~# service openstack-cinder-volume status</div><div class="gmail_default">
openstack-cinder-volume dead but pid file exists</div><div class="gmail_default">root@storage5-prod.storage5-prod:~# </div><div><br></div></div><div class="gmail_default" style="font-family:'times new roman',serif">
<br></div><div class="gmail_default" style="font-family:'times new roman',serif">Looking in /var/log/messages, I see:</div><div class="gmail_default" style="font-family:'times new roman',serif"><br></div><div class="gmail_default" style>
<div class="gmail_default" style="font-family:'times new roman',serif">Aug 12 16:47:24 storage5-prod abrt: detected unhandled Python exception in '/usr/bin/cinder-volume'</div><div class="gmail_default" style="font-family:'times new roman',serif">
Aug 12 16:47:24 storage5-prod abrtd: New client connected</div><div class="gmail_default" style="font-family:'times new roman',serif">Aug 12 16:47:24 storage5-prod abrt-server[7029]: Saved Python crash dump of pid 7017 to /var/spool/abrt/pyhook-2014-08-12-16:47:24-7017</div>
<div class="gmail_default" style="font-family:'times new roman',serif">Aug 12 16:47:24 storage5-prod abrtd: Directory 'pyhook-2014-08-12-16:47:24-7017' creation detected</div><div class="gmail_default" style="font-family:'times new roman',serif">
Aug 12 16:47:24 storage5-prod abrtd: Package 'openstack-cinder' isn't signed with proper key</div><div class="gmail_default" style="font-family:'times new roman',serif">Aug 12 16:47:24 storage5-prod abrtd: 'post-create' on '/var/spool/abrt/pyhook-2014-08-12-16:47:24-7017' exited with 1</div>
<div class="gmail_default" style="font-family:'times new roman',serif">Aug 12 16:47:24 storage5-prod abrtd: Deleting problem directory '/var/spool/abrt/pyhook-2014-08-12-16:47:24-7017'</div><div style="font-family:'times new roman',serif">
<br></div><div style="font-family:'times new roman',serif">I wish the abrtd wouldn't delete the problem directory - that makes the problem tough to track down.</div><div style="font-family:'times new roman',serif">
<br></div><div style="font-family:'times new roman',serif">I diagnosed the problem by modifying /etc/init.d/openstack-cinder-volume:</div><div style="font-family:'times new roman',serif"><br></div><div style="font-family:'times new roman',serif">
<div>root@storage5-prod.storage5-prod:/etc/init.d# diff openstack-cinder-volume openstack-cinder-volume_ORIGINAL </div><div>43c43</div><div>< daemon --user cinder --pidfile $pidfile "$exec --config-file $distconfig --config-file $config --logfile $logfile &>>/tmp/openstack-cinder-volume.txt & echo \$! > $pidfile"</div>
<div>---</div><div>> daemon --user cinder --pidfile $pidfile "$exec --config-file $distconfig --config-file $config --logfile $logfile &>/dev/null & echo \$! > $pidfile"</div><div>root@storage5-prod.storage5-prod:/etc/init.d# </div>
<div><br></div></div><div style="font-family:'times new roman',serif">then loooked at /tmp/openstack-cinder-volume.txt and found:</div><div style="font-family:'times new roman',serif"><div>root@storage5-prod.storage5-prod:/etc/init.d# cat /tmp/openstack-cinder-volume.txt </div>
<div>/usr/lib64/python2.6/site-packages/Crypto/Util/number.py:57: PowmInsecureWarning: Not using mpz_powm_sec. You should rebuild using libgmp >= 5 to avoid timing attack vulnerability.</div><div> _warn("Not using mpz_powm_sec. You should rebuild using libgmp >= 5 to avoid timing attack vulnerability.", PowmInsecureWarning)</div>
<div>Traceback (most recent call last):</div><div> File "/usr/bin/cinder-volume", line 58, in <module></div><div> version=version.version_string())</div><div> File "/usr/lib/python2.6/site-packages/oslo/config/cfg.py", line 1638, in __call__</div>
<div> raise ConfigFilesNotFoundError(self._namespace.files_not_found)</div><div>oslo.config.cfg.ConfigFilesNotFoundError: Failed to read some config files: /etc/cinder/cinder.conf</div><div><br></div></div><div style="font-family:'times new roman',serif">
Ah hah!</div><div style="font-family:'times new roman',serif"><br></div><div style="font-family:'times new roman',serif">I solved the problem by chown cinder:cinder /etc/cinder/cinder.conf</div><div style="font-family:'times new roman',serif">
<br></div><div style="font-family:'times new roman',serif"><div>root@storage5-prod.storage5-prod:~# ls -ld /etc/cinder/</div><div>drwxr-xr-x 3 cinder cinder 4096 Aug 12 16:41 /etc/cinder/</div><div>root@storage5-prod.storage5-prod:~# ls -ld /etc/cinder/cinder.conf</div>
<div>-rw-r----- 1 root root 60893 Aug 12 15:55 /etc/cinder/cinder.conf</div><div>root@storage5-prod.storage5-prod:~# chown cinder:cinder /etc/cinder/cinder.conf</div><div>root@storage5-prod.storage5-prod:~# ls -l /etc/cinder/cinder.conf</div>
<div>-rw-r----- 1 cinder cinder 60893 Aug 12 15:55 /etc/cinder/cinder.conf</div><div>You have new mail in /var/spool/mail/root</div><div>root@storage5-prod.storage5-prod:~# </div><div><br></div></div><div style="font-family:'times new roman',serif">
<br></div><div style><div style><font face="times new roman, serif">root@storage5-prod.storage5-prod:~# service openstack-cinder-volume start</font></div><div style><font face="times new roman, serif">Starting openstack-cinder-volume: [ OK ]</font></div>
<div style><font face="times new roman, serif">root@storage5-prod.storage5-prod:~# service openstack-cinder-volume status</font></div><div style><font face="times new roman, serif">openstack-cinder-volume (pid 7370) is running...</font></div>
<div style><font face="times new roman, serif">root@storage5-prod.storage5-prod:~# service openstack-cinder-volume status</font></div><div style><font face="times new roman, serif">openstack-cinder-volume (pid 7370) is running...</font></div>
<div style><font face="times new roman, serif">root@storage5-prod.storage5-prod:~# sleep 5; service openstack-cinder-volume status</font></div><div style><font face="times new roman, serif">openstack-cinder-volume (pid 7370) is running...</font></div>
<div style><font face="times new roman, serif">root@storage5-prod.storage5-prod:~# </font></div></div><div style="font-family:'times new roman',serif"><br></div></div><div><div class="gmail_default" style="font-family:'times new roman',serif">
The bottom line is that I would like to make a suggestion: openstack is very complicated and has a lot of moving parts. Furthermore, a lot of people are using it in enterprise critical applications. Put some thought into troubleshooting techniques. In particular, don't redirect stderr to /dev/null, instead it write it somewhere.</div>
<div class="gmail_default" style="font-family:'times new roman',serif"><br></div><div class="gmail_default" style="font-family:'times new roman',serif"><br></div><div class="gmail_default" style="font-family:'times new roman',serif">
While I have your undivided attention, there is another error message coming out of stderr that you ought to think about:</div><div class="gmail_default" style="font-family:'times new roman',serif"><br></div><div class="gmail_default" style="font-family:'times new roman',serif">
/usr/lib64/python2.6/site-packages/Crypto/Util/number.py:57: PowmInsecureWarning: Not using mpz_powm_sec. You should rebuild using libgmp >= 5 to avoid timing attack vulnerability.</div><div class="gmail_default" style="font-family:'times new roman',serif">
_warn("Not using mpz_powm_sec. You should rebuild using libgmp >= 5 to avoid timing attack vulnerability.", PowmInsecureWarning)</div><div><br></div><br></div><div><div class="gmail_default" style="font-family:'times new roman',serif">
Thank you</div><div class="gmail_default" style="font-family:'times new roman',serif"><br></div><div class="gmail_default" style="font-family:'times new roman',serif"><br></div><div class="gmail_default" style="font-family:'times new roman',serif">
Jeff</div><div class="gmail_default" style="font-family:'times new roman',serif"></div><br></div><div><br></div><div><br></div>-- <br><div dir="ltr"><b>Jeff Silverman</b><div>Systems Engineer</div><div>(253) 459-2318 (c)</div>
<div><img src="https://dl.dropboxusercontent.com/u/16943296/SweetLabs-Signatures/New_2014/signature-logo.png"><br></div></div>
</div>