[Openstack] Help: /var/log full cause Keystone service stop working

Corleone Yi guoliang.yi at gmail.com
Tue Nov 15 10:28:47 UTC 2016


Hi,

I don't know if the topic was dicussed before or should be discussed here.
I installed Mirantis OS8 in my server and found that the keystone service
stop working after a period of time running.
After some study, I found this is because the /var/log is full. I tried
manually remove some logs for ceilometer and rebooted the controller
node. Then it starts to work. But the second day, the /var/log become full
again and keystone stop working again.
It is really hard to manualy clean the log. I wonder do we have good way to
clean logs? And how can we prevent keystone from stop working?
Thank you!

BR/Guoliang

root at node-34:/var/log#
root at node-34:/var/log# nova list
No handlers could be found for logger
"keystoneclient.auth.identity.generic.base"
ERROR (DiscoveryFailure): Could not determine a suitable URL for the plugin

root at node-34:/var/log# keystone user-list
/usr/lib/python2.7/dist-packages/keystoneclient/shell.py:64:
DeprecationWarning: The keystone CLI is deprecated in favor of
python-openstackclient. For a Python library, continue using
python-keystoneclient.
  'python-keystoneclient.', DeprecationWarning)
/usr/lib/python2.7/dist-packages/keystoneclient/v2_0/client.py:145:
DeprecationWarning: Constructing an instance of the
keystoneclient.v2_0.client.Client class without a session is deprecated as
of the 1.7.0 release and may be removed in the 2.0.0 release.
  'the 2.0.0 release.', DeprecationWarning)
/usr/lib/python2.7/dist-packages/keystoneclient/v2_0/client.py:147:
DeprecationWarning: Using the 'tenant_name' argument is deprecated in
version '1.7.0' and will be removed in version '2.0.0', please use the
'project_name' argument instead
  super(Client, self).__init__(**kwargs)
/usr/lib/python2.7/dist-packages/debtcollector/renames.py:43:
DeprecationWarning: Using the 'tenant_id' argument is deprecated in version
'1.7.0' and will be removed in version '2.0.0', please use the 'project_id'
argument instead
  return f(*args, **kwargs)
/usr/lib/python2.7/dist-packages/keystoneclient/httpclient.py:376:
DeprecationWarning: Constructing an HTTPClient instance without using a
session is deprecated as of the 1.7.0 release and may be removed in the
2.0.0 release.
  'the 2.0.0 release.', DeprecationWarning)
Authorization Failed: Unable to establish connection to
http://10.85.45.133:5000/tokens
root at node-34:/var/log#

root at node-34:/var/log# df
Filesystem                     1K-blocks     Used Available Use% Mounted on
udev                            65886016       12  65886004   1% /dev
tmpfs                           13179484     1396  13178088   1% /run
/dev/dm-5                       51474912  5694432  43142768  12% /
none                                   4        0         4   0%
/sys/fs/cgroup
none                                5120        0      5120   0% /run/lock
none                            65897400    60868  65836532   1% /run/shm
none                              102400        0    102400   0% /run/user
/dev/sda3                         200672    59252    131192  32% /boot
/dev/mapper/logs-log            10190136 10173752         0 100% /var/log
/dev/mapper/image-glance        96450548   439892  96010656   1%
/var/lib/glance
/dev/mapper/mysql-root          20511356  4472936  14973460  24%
/var/lib/mysql
/dev/mapper/horizon-horizontmp  11524096    33504  11490592   1%
/var/lib/horizon
/dev/mapper/mongo-mongodb       94850900 12814576  77195060  15%
/var/lib/mongo
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20161115/f4d6106b/attachment.html>


More information about the Openstack mailing list