<div dir="ltr"><div>Sure, here's the stacktach_worker_config.json:<br></div><div><br></div><div><div> {</div><div> "name": "openstack",</div><div> "durable_queue": false,</div>
<div> "rabbit_host": "192.168.1.1",</div><div> "rabbit_port": 5672,</div><div> "rabbit_userid": "nova",</div><div> "rabbit_password": "passyword",</div>
<div> "rabbit_virtual_host": "/"</div><div> },</div></div><div><br></div><div>I'm not sure about the queue_name param or the topics param. I noticed you have those in your config file but I don't have them in mine. I figured since you have a minimum of the same options as me, your config would be OK. I might be running an older version of StackTach, so maybe those options are now needed.<br>
</div><div><br></div><div>Also, here are the options in my nova.conf file:</div><div><br></div><div><div>notification_topics=monitor</div><div>notification_driver=nova.openstack.common.notifier.rabbit_notifier</div></div>
<div>instance_usage_audit_period=hour<br></div><div><br></div><div>The last option is only recognized by nova-compute.</div><div><br></div><div>Hope that helps,</div><div>Joe</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">
On Wed, Aug 21, 2013 at 7:14 AM, Denis Loshakov <span dir="ltr"><<a href="mailto:dloshakov@gmail.com" target="_blank">dloshakov@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Finally got it up and running.<br>
Problem was in python and path, after second clean install from scratch everything is fine.<br>
But no luck with data anyway. In manual there is nothing about "topics", also there is custom queue "queue_name": "stacktach".<br>
Can you explain what it is about? Can you paste your stacktach_worker_config.json<br>
<br>
Thanks<div class="HOEnZb"><div class="h5"><br>
<br>
On <a href="tel:21.08.2013%2010" value="+12108201310" target="_blank">21.08.2013 10</a>:39, Denis Loshakov wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Here is list of pip install:<br>
root@stacktach:/opt/www/<u></u>stacktach$ pip install -r ./etc/pip-requires.txt<br>
Requirement already satisfied (use --upgrade to upgrade): Django>=1.4.2<br>
in /usr/local/lib/python2.7/dist-<u></u>packages (from -r<br>
./etc/pip-requires.txt (line 1))<br>
Requirement already satisfied (use --upgrade to upgrade):<br>
MySQL-python>=1.2.3 in /usr/local/lib/python2.7/dist-<u></u>packages (from -r<br>
./etc/pip-requires.txt (line 2))<br>
Requirement already satisfied (use --upgrade to upgrade):<br>
eventlet>=0.9.17 in /usr/local/lib/python2.7/dist-<u></u>packages (from -r<br>
./etc/pip-requires.txt (line 3))<br>
Requirement already satisfied (use --upgrade to upgrade): kombu>=2.4.7<br>
in /usr/local/lib/python2.7/dist-<u></u>packages (from -r<br>
./etc/pip-requires.txt (line 4))<br>
Requirement already satisfied (use --upgrade to upgrade):<br>
librabbitmq>=1.0.0 in /usr/local/lib/python2.7/dist-<u></u>packages (from -r<br>
./etc/pip-requires.txt (line 5))<br>
Requirement already satisfied (use --upgrade to upgrade):<br>
prettytable>=0.7.2 in /usr/local/lib/python2.7/dist-<u></u>packages (from -r<br>
./etc/pip-requires.txt (line 6))<br>
Requirement already satisfied (use --upgrade to upgrade): argparse in<br>
/usr/lib/python2.7 (from -r ./etc/pip-requires.txt (line 7))<br>
Requirement already satisfied (use --upgrade to upgrade): Pympler in<br>
/usr/local/lib/python2.7/dist-<u></u>packages (from -r ./etc/pip-requires.txt<br>
(line 8))<br>
Requirement already satisfied (use --upgrade to upgrade): requests in<br>
/usr/local/lib/python2.7/dist-<u></u>packages (from -r ./etc/pip-requires.txt<br>
(line 9))<br>
Requirement already satisfied (use --upgrade to upgrade): south in<br>
/usr/local/lib/python2.7/dist-<u></u>packages (from -r ./etc/pip-requires.txt<br>
(line 10))<br>
Requirement already satisfied (use --upgrade to upgrade): greenlet>=0.3<br>
in /usr/local/lib/python2.7/dist-<u></u>packages (from eventlet>=0.9.17->-r<br>
./etc/pip-requires.txt (line 3))<br>
Requirement already satisfied (use --upgrade to upgrade): anyjson>=0.3.3<br>
in /usr/local/lib/python2.7/dist-<u></u>packages (from kombu>=2.4.7->-r<br>
./etc/pip-requires.txt (line 4))<br>
Requirement already satisfied (use --upgrade to upgrade):<br>
amqp>=1.0.13,<1.1.0 in /usr/local/lib/python2.7/dist-<u></u>packages (from<br>
kombu>=2.4.7->-r ./etc/pip-requires.txt (line 4))<br>
Cleaning up...<br>
<br>
<br>
On <a href="tel:21.08.2013%2010" value="+12108201310" target="_blank">21.08.2013 10</a>:27, Denis Loshakov wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi, here is some debug info from logfile.<br>
2013-08-21 09:24:29,893 - stacktach.stacklog - ERROR - name=cloudcat,<br>
exchange=glance, exception=No module named librabbitmq. Reconnecting<br>
in 5s<br>
Traceback (most recent call last):<br>
File "/opt/www/stacktach/worker/<u></u>worker.py", line 182, in run<br>
consumer.run()<br>
File "/usr/local/lib/python2.7/<u></u>dist-packages/kombu/mixins.py"<u></u>, line<br>
164, in run<br>
errors = (self.connection.connection_<u></u>errors +<br>
File<br>
"/usr/local/lib/python2.7/<u></u>dist-packages/kombu/utils/__<u></u>init__.py", line<br>
294, in __get__<br>
value = obj.__dict__[self.__name__] = self.__get(obj)<br>
File "/usr/local/lib/python2.7/<u></u>dist-packages/kombu/<u></u>connection.py",<br>
line 822, in connection_errors<br>
return self.transport.connection_<u></u>errors<br>
File "/usr/local/lib/python2.7/<u></u>dist-packages/kombu/<u></u>connection.py",<br>
line 789, in transport<br>
self._transport = self.create_transport()<br>
File "/usr/local/lib/python2.7/<u></u>dist-packages/kombu/<u></u>connection.py",<br>
line 528, in create_transport<br>
return self.get_transport_cls()(<u></u>client=self)<br>
File "/usr/local/lib/python2.7/<u></u>dist-packages/kombu/<u></u>connection.py",<br>
line 535, in get_transport_cls<br>
transport_cls = get_transport_cls(transport_<u></u>cls)<br>
File<br>
"/usr/local/lib/python2.7/<u></u>dist-packages/kombu/transport/<u></u>__init__.py",<br>
line 105, in get_transport_cls<br>
_transport_cache[transport] = resolve_transport(transport)<br>
File<br>
"/usr/local/lib/python2.7/<u></u>dist-packages/kombu/transport/<u></u>__init__.py",<br>
line 89, in resolve_transport<br>
return symbol_by_name(transport)<br>
File<br>
"/usr/local/lib/python2.7/<u></u>dist-packages/kombu/utils/__<u></u>init__.py", line<br>
80, in symbol_by_name<br>
module = imp(module_name, package=package, **kwargs)<br>
File "/usr/lib/python2.7/importlib/<u></u>__init__.py", line 37, in<br>
import_module<br>
__import__(name)<br>
File<br>
"/usr/local/lib/python2.7/<u></u>dist-packages/kombu/transport/<u></u>librabbitmq.py",<br>
line 23, in <module><br>
raise ImportError("No module named librabbitmq")<br>
ImportError: No module named librabbitmq<br>
<br>
<br>
<br>
On 21.08.2013 8:19, Denis Loshakov wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi, thank fro quick reply.<br>
Here is output from start_workers.y process.<br>
root@stacktach:/opt/www/<u></u>stacktach$ python worker/start_workers.py<br>
Starting worker for 'cloudmouse nova'<br>
Starting worker for 'cloudmouse glance'<br>
Starting worker for 'cloudmouse keystone'<br>
<br>
Ah, there is logfile, didn't know that (my shame).<br>
There are plenty errors, I think i'll do from scratch and ley you know<br>
results.<br>
<br>
Thanks for tip.<br>
<br>
On 20.08.2013 17:11, Joe Topjian wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi Denis,<br>
<br>
Thanks for the configs. I verified them against mine and they look<br>
good.<br>
<br>
When you run start_workers.py, do you see anything printed out such as<br>
"Starting worker for openstack_devel"? This is done here:<br>
<br>
<a href="https://github.com/rackerlabs/stacktach/blob/master/worker/worker.py#L161" target="_blank">https://github.com/rackerlabs/<u></u>stacktach/blob/master/worker/<u></u>worker.py#L161</a><br>
<br>
<br>
<br>
Additionally, there should be a worker.log file where line 162 will be<br>
printed.<br>
<br>
I just want to confirm you're seeing those logs/messages because if you<br>
don't, something might be wrong with the workers themselves prior to<br>
reaching Rabbit.<br>
<br>
Thanks,<br>
Joe<br>
<br>
<br>
On Tue, Aug 20, 2013 at 4:27 AM, Denis Loshakov <<a href="mailto:dloshakov@gmail.com" target="_blank">dloshakov@gmail.com</a><br>
<mailto:<a href="mailto:dloshakov@gmail.com" target="_blank">dloshakov@gmail.com</a>>> wrote:<br>
<br>
Hello, thanks for help.<br>
<br>
First about configs:<br>
<br>
stacktach_config.sh:<br>
export STACKTACH_DB_NAME="stacktach"<br>
export STACKTACH_DB_HOST=""<br>
export STACKTACH_DB_USERNAME="__<u></u>stacktach"<br>
export STACKTACH_DB_PASSWORD="__<u></u>stacktach123"<br>
export STACKTACH_DB_PORT="3306"<br>
export STACKTACH_INSTALL_DIR="/opt/__<u></u>www/stacktach/"<br>
export<br>
<br>
STACKTACH_DEPLOYMENTS_FILE="/_<u></u>_opt/www/stacktach/etc/__<u></u>stacktach_worker_config.json"<br>
<br>
<br>
<br>
export<br>
<br>
STACKTACH_VERIFIER_CONFIG="/__<u></u>opt/www/stacktach/etc/__<u></u>stacktach_verifier_config.__<u></u>json"<br>
<br>
<br>
<br>
export DJANGO_SETTINGS_MODULE="__<u></u>settings"<br>
<br>
stacktach_worker_config.json:<br>
{"deployments": [<br>
{<br>
"name": "openstack_devel",<br>
"durable_queue": false,<br>
"rabbit_host": "10.0.2.20",<br>
"rabbit_port": 5672,<br>
"rabbit_userid": "nova",<br>
"rabbit_password": "nova",<br>
"rabbit_virtual_host": "/",<br>
"exit_on_exception": false,<br>
"queue_name": "stacktach",<br>
"topics": {<br>
"nova": ["<a href="http://monitor.info" target="_blank">monitor.info</a> <<a href="http://monitor.info" target="_blank">http://monitor.info</a>>",<br>
"monitor.error"],<br>
"glance": ["<a href="http://monitor_glance.info" target="_blank">monitor_glance.info</a><br>
<<a href="http://monitor_glance.info" target="_blank">http://monitor_glance.info</a>>", "monitor_glance.error"],<br>
"keystone": ["<a href="http://monitor_keystone.info" target="_blank">monitor_keystone.info</a><br>
<<a href="http://monitor_keystone.info" target="_blank">http://monitor_keystone.info</a>><u></u>", "monitor_keystone.error"]<br>
}<br>
}]<br>
}<br>
<br>
stacktach_verifier_config.__<u></u>json:<br>
{<br>
"tick_time": 30,<br>
"settle_time": 5,<br>
"settle_units": "minutes",<br>
"pool_size": 2,<br>
"enable_notifications": true,<br>
"rabbit": {<br>
"durable_queue": false,<br>
"host": "10.0.2.20",<br>
"port": 5672,<br>
"userid": "nova",<br>
"password": "nova",<br>
"virtual_host": "/",<br>
"topics": {<br>
"nova": ["<a href="http://notifications.info" target="_blank">notifications.info</a><br>
<<a href="http://notifications.info" target="_blank">http://notifications.info</a>>"],<br>
"glance": ["<a href="http://notifications.info" target="_blank">notifications.info</a><br>
<<a href="http://notifications.info" target="_blank">http://notifications.info</a>>"],<br>
"keystone": ["<a href="http://notifications.info" target="_blank">notifications.info</a><br>
<<a href="http://notifications.info" target="_blank">http://notifications.info</a>>"]<br>
}<br>
}<br>
}<br>
<br>
Testing connectivity with Rabbit host:<br>
root@stacktach:/opt/www/__<u></u>stacktach/etc$ telnet 10.0.2.20 5672<br>
Trying 10.0.2.20...<br>
Connected to 10.0.2.20.<br>
Escape character is '^]'.<br>
qeqw<br>
^]<br>
telnet> quit<br>
Connection closed.<br>
root@stacktach:/opt/www/__<u></u>stacktach/etc$<br>
<br>
Run simple web server:<br>
python manage.py runserver <a href="http://10.0.2.18:8000" target="_blank">10.0.2.18:8000</a> <<a href="http://10.0.2.18:8000" target="_blank">http://10.0.2.18:8000</a>><br>
<br>
Create database and populate it:<br>
python manage.py syncdb<br>
python manage.py migrate<br>
<br>
And finally run workers:<br>
python ../worker/start_workers.py<br>
<br>
I tried to sniff by port 5672 or sniff by src/dst nothing.<br>
<br>
Thats my story.<br>
<br>
On 19.08.2013 17:36, Joe Topjian wrote:<br>
<br>
Hi Denis,<br>
<br>
I have a StackTach installation from quite a while ago --<br>
probably from<br>
when the manual was relevant, so I can try to help.<br>
<br>
What issue are you running into? Can you confirm that your<br>
stacktach<br>
workers are connecting to your Rabbit server? Have you added<br>
the<br>
additional notification options to nova to have it send<br>
events to<br>
Rabbit? Can you reach the webpage without error?<br>
<br>
Thanks,<br>
Joe<br>
<br>
<br>
On Mon, Aug 19, 2013 at 7:35 AM, Denis Loshakov<br>
<<a href="mailto:dloshakov@gmail.com" target="_blank">dloshakov@gmail.com</a> <mailto:<a href="mailto:dloshakov@gmail.com" target="_blank">dloshakov@gmail.com</a>><br>
<mailto:<a href="mailto:dloshakov@gmail.com" target="_blank">dloshakov@gmail.com</a> <mailto:<a href="mailto:dloshakov@gmail.com" target="_blank">dloshakov@gmail.com</a>>>><br>
wrote:<br>
<br>
Hi, I've tried to setup StackTach<br>
<a href="https://github.com/rackerlabs/____stacktach" target="_blank">https://github.com/rackerlabs/<u></u>____stacktach</a><br>
<<a href="https://github.com/rackerlabs/__stacktach" target="_blank">https://github.com/<u></u>rackerlabs/__stacktach</a>><br>
<<a href="https://github.com/__rackerlabs/stacktach" target="_blank">https://github.com/__<u></u>rackerlabs/stacktach</a><br>
<<a href="https://github.com/rackerlabs/stacktach" target="_blank">https://github.com/<u></u>rackerlabs/stacktach</a>>>. The manual is<br>
not so<br>
fresh but I managed to setup, but stacktach doesn't go to<br>
Rabbit server.<br>
Any one have any experience with StackTach setup?<br>
<br>
Thanks.<br>
<br>
______________________________<u></u>_____________________<br>
OpenStack-operators mailing list<br>
OpenStack-operators@lists.__<a href="http://op__enstack.org" target="_blank">op<u></u>__enstack.org</a><br>
<<a href="http://openstack.org" target="_blank">http://openstack.org</a>><br>
<mailto:<a href="mailto:OpenStack-operators@" target="_blank">OpenStack-operators@</a>__<a href="http://lists.openstack.org" target="_blank"><u></u>lists.openstack.org</a><br>
<mailto:<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@<u></u>lists.openstack.org</a>>><br>
<br>
<a href="http://lists.openstack.org/____cgi-bin/mailman/listinfo/____openstack-operators" target="_blank">http://lists.openstack.org/___<u></u>_cgi-bin/mailman/listinfo/____<u></u>openstack-operators</a><br>
<br>
<br>
<br>
<br>
<<a href="http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators" target="_blank">http://lists.openstack.org/__<u></u>cgi-bin/mailman/listinfo/__<u></u>openstack-operators</a>><br>
<br>
<br>
<br>
<br>
<br>
<<a href="http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators" target="_blank">http://lists.openstack.org/__<u></u>cgi-bin/mailman/listinfo/__<u></u>openstack-operators</a><br>
<br>
<br>
<br>
<br>
<<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/<u></u>cgi-bin/mailman/listinfo/<u></u>openstack-operators</a>>><br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
--<br>
Joe Topjian<br>
Systems Architect<br>
Cybera Inc.<br>
<br>
<a href="http://www.cybera.ca" target="_blank">www.cybera.ca</a> <<a href="http://www.cybera.ca" target="_blank">http://www.cybera.ca</a>> <<a href="http://www.cybera.ca" target="_blank">http://www.cybera.ca</a>><br>
<br>
Cybera is a not-for-profit organization that works to spur and<br>
support<br>
innovation, for the economic benefit of Alberta, through the<br>
use<br>
of cyberinfrastructure.<br>
<br>
<br>
<br>
<br>
--<br>
Joe Topjian<br>
Systems Architect<br>
Cybera Inc.<br>
<br>
<a href="http://www.cybera.ca" target="_blank">www.cybera.ca</a> <<a href="http://www.cybera.ca" target="_blank">http://www.cybera.ca</a>><br>
<br>
Cybera is a not-for-profit organization that works to spur and support<br>
innovation, for the economic benefit of Alberta, through the use<br>
of cyberinfrastructure.<br>
</blockquote></blockquote></blockquote></blockquote>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr">Joe Topjian<div>Systems Architect</div><div>Cybera Inc.</div><div><br></div><div><a href="http://www.cybera.ca" target="_blank">www.cybera.ca</a></div>
<div><br></div><div><font color="#666666"><span>Cybera</span><span> is a not-for-profit organization that works to spur and support innovation, for the economic benefit of Alberta, through the use of cyberinfrastructure.</span></font></div>
</div>
</div>