Open Stack

Hi all,

I was alerted about 04:00UTC that ask.openstack.org was giving 500
errors.

When I logged in, the first thing was it was out of disk [1].  After a
little poking the safest way to clear some space seemed to be the
apt cache which gave some breathing room.

After this, an error similar to the following persisted

---
mod_wsgi (pid=6706): Exception occurred processing WSGI script '/srv/askbot-site/config/django.wsgi'.
 Traceback (most recent call last):
   File "/usr/askbot-env/lib/python2.7/site-packages/django/core/handlers/wsgi.py", line 255, in __call_

     response = self.get_response(request)
   File "/usr/askbot-env/lib/python2.7/site-packages/django/core/handlers/base.py", line 176, in get_res

     response = self.handle_uncaught_exception(request, resolver, sys.exc_info())
   File "/usr/askbot-env/lib/python2.7/site-packages/django/core/handlers/base.py", line 218, in handle_

     if resolver.urlconf_module is None:
   File "/usr/askbot-env/lib/python2.7/site-packages/django/core/urlresolvers.py", line 361, in urlconf_

     self._urlconf_module = import_module(self.urlconf_name)
   File "/usr/askbot-env/lib/python2.7/site-packages/django/utils/importlib.py", line 35, in import_modu

     __import__(name)
   File "/srv/askbot-site/config/urls.py", line 12, in <module>
     from askbot.views.error import internal_error as handler500
   File "/usr/askbot-env/lib/python2.7/site-packages/askbot-0.7.53-py2.7.egg/askbot/views/__init__.py", 

     from askbot.views import api_v1
 ImportError: cannot import name api_v1
---

AFAICT everything seemed OK, so my assumption was/is that something
became out of sync in the /usr/askbot-env virtualenv while the host
was out of disk.  I re-installed the askbot package with pip in the
virtualenv from /srv/askbot-site and this seems to have restored
functionality.

I restarted apache & celery

Disk is still tight on this host.  Someone who knows a little more
about the service might like to go clear out anything else that is
unnecessary.

-i

[1] http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=156