[Openstack-operators] StackTach setup
Joe Topjian
joe.topjian at cybera.ca
Thu Aug 22 03:36:58 UTC 2013
Sure, here's the stacktach_worker_config.json:
{
"name": "openstack",
"durable_queue": false,
"rabbit_host": "192.168.1.1",
"rabbit_port": 5672,
"rabbit_userid": "nova",
"rabbit_password": "passyword",
"rabbit_virtual_host": "/"
},
I'm not sure about the queue_name param or the topics param. I noticed you
have those in your config file but I don't have them in mine. I figured
since you have a minimum of the same options as me, your config would be
OK. I might be running an older version of StackTach, so maybe those
options are now needed.
Also, here are the options in my nova.conf file:
notification_topics=monitor
notification_driver=nova.openstack.common.notifier.rabbit_notifier
instance_usage_audit_period=hour
The last option is only recognized by nova-compute.
Hope that helps,
Joe
On Wed, Aug 21, 2013 at 7:14 AM, Denis Loshakov <dloshakov at gmail.com> wrote:
> Finally got it up and running.
> Problem was in python and path, after second clean install from scratch
> everything is fine.
> But no luck with data anyway. In manual there is nothing about "topics",
> also there is custom queue "queue_name": "stacktach".
> Can you explain what it is about? Can you paste your
> stacktach_worker_config.json
>
> Thanks
>
>
> On 21.08.2013 10:39, Denis Loshakov wrote:
>
>> Here is list of pip install:
>> root at stacktach:/opt/www/**stacktach$ pip install -r
>> ./etc/pip-requires.txt
>> Requirement already satisfied (use --upgrade to upgrade): Django>=1.4.2
>> in /usr/local/lib/python2.7/dist-**packages (from -r
>> ./etc/pip-requires.txt (line 1))
>> Requirement already satisfied (use --upgrade to upgrade):
>> MySQL-python>=1.2.3 in /usr/local/lib/python2.7/dist-**packages (from -r
>> ./etc/pip-requires.txt (line 2))
>> Requirement already satisfied (use --upgrade to upgrade):
>> eventlet>=0.9.17 in /usr/local/lib/python2.7/dist-**packages (from -r
>> ./etc/pip-requires.txt (line 3))
>> Requirement already satisfied (use --upgrade to upgrade): kombu>=2.4.7
>> in /usr/local/lib/python2.7/dist-**packages (from -r
>> ./etc/pip-requires.txt (line 4))
>> Requirement already satisfied (use --upgrade to upgrade):
>> librabbitmq>=1.0.0 in /usr/local/lib/python2.7/dist-**packages (from -r
>> ./etc/pip-requires.txt (line 5))
>> Requirement already satisfied (use --upgrade to upgrade):
>> prettytable>=0.7.2 in /usr/local/lib/python2.7/dist-**packages (from -r
>> ./etc/pip-requires.txt (line 6))
>> Requirement already satisfied (use --upgrade to upgrade): argparse in
>> /usr/lib/python2.7 (from -r ./etc/pip-requires.txt (line 7))
>> Requirement already satisfied (use --upgrade to upgrade): Pympler in
>> /usr/local/lib/python2.7/dist-**packages (from -r ./etc/pip-requires.txt
>> (line 8))
>> Requirement already satisfied (use --upgrade to upgrade): requests in
>> /usr/local/lib/python2.7/dist-**packages (from -r ./etc/pip-requires.txt
>> (line 9))
>> Requirement already satisfied (use --upgrade to upgrade): south in
>> /usr/local/lib/python2.7/dist-**packages (from -r ./etc/pip-requires.txt
>> (line 10))
>> Requirement already satisfied (use --upgrade to upgrade): greenlet>=0.3
>> in /usr/local/lib/python2.7/dist-**packages (from eventlet>=0.9.17->-r
>> ./etc/pip-requires.txt (line 3))
>> Requirement already satisfied (use --upgrade to upgrade): anyjson>=0.3.3
>> in /usr/local/lib/python2.7/dist-**packages (from kombu>=2.4.7->-r
>> ./etc/pip-requires.txt (line 4))
>> Requirement already satisfied (use --upgrade to upgrade):
>> amqp>=1.0.13,<1.1.0 in /usr/local/lib/python2.7/dist-**packages (from
>> kombu>=2.4.7->-r ./etc/pip-requires.txt (line 4))
>> Cleaning up...
>>
>>
>> On 21.08.2013 10:27, Denis Loshakov wrote:
>>
>>> Hi, here is some debug info from logfile.
>>> 2013-08-21 09:24:29,893 - stacktach.stacklog - ERROR - name=cloudcat,
>>> exchange=glance, exception=No module named librabbitmq. Reconnecting
>>> in 5s
>>> Traceback (most recent call last):
>>> File "/opt/www/stacktach/worker/**worker.py", line 182, in run
>>> consumer.run()
>>> File "/usr/local/lib/python2.7/**dist-packages/kombu/mixins.py"**,
>>> line
>>> 164, in run
>>> errors = (self.connection.connection_**errors +
>>> File
>>> "/usr/local/lib/python2.7/**dist-packages/kombu/utils/__**init__.py",
>>> line
>>> 294, in __get__
>>> value = obj.__dict__[self.__name__] = self.__get(obj)
>>> File "/usr/local/lib/python2.7/**dist-packages/kombu/**
>>> connection.py",
>>> line 822, in connection_errors
>>> return self.transport.connection_**errors
>>> File "/usr/local/lib/python2.7/**dist-packages/kombu/**
>>> connection.py",
>>> line 789, in transport
>>> self._transport = self.create_transport()
>>> File "/usr/local/lib/python2.7/**dist-packages/kombu/**
>>> connection.py",
>>> line 528, in create_transport
>>> return self.get_transport_cls()(**client=self)
>>> File "/usr/local/lib/python2.7/**dist-packages/kombu/**
>>> connection.py",
>>> line 535, in get_transport_cls
>>> transport_cls = get_transport_cls(transport_**cls)
>>> File
>>> "/usr/local/lib/python2.7/**dist-packages/kombu/transport/**
>>> __init__.py",
>>> line 105, in get_transport_cls
>>> _transport_cache[transport] = resolve_transport(transport)
>>> File
>>> "/usr/local/lib/python2.7/**dist-packages/kombu/transport/**
>>> __init__.py",
>>> line 89, in resolve_transport
>>> return symbol_by_name(transport)
>>> File
>>> "/usr/local/lib/python2.7/**dist-packages/kombu/utils/__**init__.py",
>>> line
>>> 80, in symbol_by_name
>>> module = imp(module_name, package=package, **kwargs)
>>> File "/usr/lib/python2.7/importlib/**__init__.py", line 37, in
>>> import_module
>>> __import__(name)
>>> File
>>> "/usr/local/lib/python2.7/**dist-packages/kombu/transport/**
>>> librabbitmq.py",
>>> line 23, in <module>
>>> raise ImportError("No module named librabbitmq")
>>> ImportError: No module named librabbitmq
>>>
>>>
>>>
>>> On 21.08.2013 8:19, Denis Loshakov wrote:
>>>
>>>> Hi, thank fro quick reply.
>>>> Here is output from start_workers.y process.
>>>> root at stacktach:/opt/www/**stacktach$ python worker/start_workers.py
>>>> Starting worker for 'cloudmouse nova'
>>>> Starting worker for 'cloudmouse glance'
>>>> Starting worker for 'cloudmouse keystone'
>>>>
>>>> Ah, there is logfile, didn't know that (my shame).
>>>> There are plenty errors, I think i'll do from scratch and ley you know
>>>> results.
>>>>
>>>> Thanks for tip.
>>>>
>>>> On 20.08.2013 17:11, Joe Topjian wrote:
>>>>
>>>>> Hi Denis,
>>>>>
>>>>> Thanks for the configs. I verified them against mine and they look
>>>>> good.
>>>>>
>>>>> When you run start_workers.py, do you see anything printed out such as
>>>>> "Starting worker for openstack_devel"? This is done here:
>>>>>
>>>>> https://github.com/rackerlabs/**stacktach/blob/master/worker/**
>>>>> worker.py#L161<https://github.com/rackerlabs/stacktach/blob/master/worker/worker.py#L161>
>>>>>
>>>>>
>>>>>
>>>>> Additionally, there should be a worker.log file where line 162 will be
>>>>> printed.
>>>>>
>>>>> I just want to confirm you're seeing those logs/messages because if you
>>>>> don't, something might be wrong with the workers themselves prior to
>>>>> reaching Rabbit.
>>>>>
>>>>> Thanks,
>>>>> Joe
>>>>>
>>>>>
>>>>> On Tue, Aug 20, 2013 at 4:27 AM, Denis Loshakov <dloshakov at gmail.com
>>>>> <mailto:dloshakov at gmail.com>> wrote:
>>>>>
>>>>> Hello, thanks for help.
>>>>>
>>>>> First about configs:
>>>>>
>>>>> stacktach_config.sh:
>>>>> export STACKTACH_DB_NAME="stacktach"
>>>>> export STACKTACH_DB_HOST=""
>>>>> export STACKTACH_DB_USERNAME="__**stacktach"
>>>>> export STACKTACH_DB_PASSWORD="__**stacktach123"
>>>>> export STACKTACH_DB_PORT="3306"
>>>>> export STACKTACH_INSTALL_DIR="/opt/__**www/stacktach/"
>>>>> export
>>>>>
>>>>> STACKTACH_DEPLOYMENTS_FILE="/_**_opt/www/stacktach/etc/__**
>>>>> stacktach_worker_config.json"
>>>>>
>>>>>
>>>>>
>>>>> export
>>>>>
>>>>> STACKTACH_VERIFIER_CONFIG="/__**opt/www/stacktach/etc/__**
>>>>> stacktach_verifier_config.__**json"
>>>>>
>>>>>
>>>>>
>>>>> export DJANGO_SETTINGS_MODULE="__**settings"
>>>>>
>>>>> stacktach_worker_config.json:
>>>>> {"deployments": [
>>>>> {
>>>>> "name": "openstack_devel",
>>>>> "durable_queue": false,
>>>>> "rabbit_host": "10.0.2.20",
>>>>> "rabbit_port": 5672,
>>>>> "rabbit_userid": "nova",
>>>>> "rabbit_password": "nova",
>>>>> "rabbit_virtual_host": "/",
>>>>> "exit_on_exception": false,
>>>>> "queue_name": "stacktach",
>>>>> "topics": {
>>>>> "nova": ["monitor.info <http://monitor.info>",
>>>>> "monitor.error"],
>>>>> "glance": ["monitor_glance.info
>>>>> <http://monitor_glance.info>", "monitor_glance.error"],
>>>>> "keystone": ["monitor_keystone.info
>>>>> <http://monitor_keystone.info>**", "monitor_keystone.error"]
>>>>> }
>>>>> }]
>>>>> }
>>>>>
>>>>> stacktach_verifier_config.__**json:
>>>>> {
>>>>> "tick_time": 30,
>>>>> "settle_time": 5,
>>>>> "settle_units": "minutes",
>>>>> "pool_size": 2,
>>>>> "enable_notifications": true,
>>>>> "rabbit": {
>>>>> "durable_queue": false,
>>>>> "host": "10.0.2.20",
>>>>> "port": 5672,
>>>>> "userid": "nova",
>>>>> "password": "nova",
>>>>> "virtual_host": "/",
>>>>> "topics": {
>>>>> "nova": ["notifications.info
>>>>> <http://notifications.info>"],
>>>>> "glance": ["notifications.info
>>>>> <http://notifications.info>"],
>>>>> "keystone": ["notifications.info
>>>>> <http://notifications.info>"]
>>>>> }
>>>>> }
>>>>> }
>>>>>
>>>>> Testing connectivity with Rabbit host:
>>>>> root at stacktach:/opt/www/__**stacktach/etc$ telnet 10.0.2.20 5672
>>>>> Trying 10.0.2.20...
>>>>> Connected to 10.0.2.20.
>>>>> Escape character is '^]'.
>>>>> qeqw
>>>>> ^]
>>>>> telnet> quit
>>>>> Connection closed.
>>>>> root at stacktach:/opt/www/__**stacktach/etc$
>>>>>
>>>>> Run simple web server:
>>>>> python manage.py runserver 10.0.2.18:8000 <http://10.0.2.18:8000>
>>>>>
>>>>> Create database and populate it:
>>>>> python manage.py syncdb
>>>>> python manage.py migrate
>>>>>
>>>>> And finally run workers:
>>>>> python ../worker/start_workers.py
>>>>>
>>>>> I tried to sniff by port 5672 or sniff by src/dst nothing.
>>>>>
>>>>> Thats my story.
>>>>>
>>>>> On 19.08.2013 17:36, Joe Topjian wrote:
>>>>>
>>>>> Hi Denis,
>>>>>
>>>>> I have a StackTach installation from quite a while ago --
>>>>> probably from
>>>>> when the manual was relevant, so I can try to help.
>>>>>
>>>>> What issue are you running into? Can you confirm that your
>>>>> stacktach
>>>>> workers are connecting to your Rabbit server? Have you added
>>>>> the
>>>>> additional notification options to nova to have it send
>>>>> events to
>>>>> Rabbit? Can you reach the webpage without error?
>>>>>
>>>>> Thanks,
>>>>> Joe
>>>>>
>>>>>
>>>>> On Mon, Aug 19, 2013 at 7:35 AM, Denis Loshakov
>>>>> <dloshakov at gmail.com <mailto:dloshakov at gmail.com>
>>>>> <mailto:dloshakov at gmail.com <mailto:dloshakov at gmail.com>>>
>>>>> wrote:
>>>>>
>>>>> Hi, I've tried to setup StackTach
>>>>> https://github.com/rackerlabs/**____stacktach<https://github.com/rackerlabs/____stacktach>
>>>>> <https://github.com/**rackerlabs/__stacktach<https://github.com/rackerlabs/__stacktach>
>>>>> >
>>>>> <https://github.com/__**rackerlabs/stacktach<https://github.com/__rackerlabs/stacktach>
>>>>> <https://github.com/**rackerlabs/stacktach<https://github.com/rackerlabs/stacktach>>>.
>>>>> The manual is
>>>>> not so
>>>>> fresh but I managed to setup, but stacktach doesn't go to
>>>>> Rabbit server.
>>>>> Any one have any experience with StackTach setup?
>>>>>
>>>>> Thanks.
>>>>>
>>>>> ______________________________**_____________________
>>>>> OpenStack-operators mailing list
>>>>> OpenStack-operators at lists.__op**__enstack.org<http://op__enstack.org>
>>>>> <http://openstack.org>
>>>>> <mailto:OpenStack-operators at __**lists.openstack.org<http://lists.openstack.org>
>>>>> <mailto:OpenStack-operators@**lists.openstack.org<OpenStack-operators at lists.openstack.org>
>>>>> >>
>>>>>
>>>>> http://lists.openstack.org/___**_cgi-bin/mailman/listinfo/____**
>>>>> openstack-operators<http://lists.openstack.org/____cgi-bin/mailman/listinfo/____openstack-operators>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> <http://lists.openstack.org/__**cgi-bin/mailman/listinfo/__**
>>>>> openstack-operators<http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators>
>>>>> >
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> <http://lists.openstack.org/__**cgi-bin/mailman/listinfo/__**
>>>>> openstack-operators<http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> <http://lists.openstack.org/**cgi-bin/mailman/listinfo/**
>>>>> openstack-operators<http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators>
>>>>> >>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Joe Topjian
>>>>> Systems Architect
>>>>> Cybera Inc.
>>>>>
>>>>> www.cybera.ca <http://www.cybera.ca> <http://www.cybera.ca>
>>>>>
>>>>> Cybera is a not-for-profit organization that works to spur and
>>>>> support
>>>>> innovation, for the economic benefit of Alberta, through the
>>>>> use
>>>>> of cyberinfrastructure.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Joe Topjian
>>>>> Systems Architect
>>>>> Cybera Inc.
>>>>>
>>>>> www.cybera.ca <http://www.cybera.ca>
>>>>>
>>>>> Cybera is a not-for-profit organization that works to spur and support
>>>>> innovation, for the economic benefit of Alberta, through the use
>>>>> of cyberinfrastructure.
>>>>>
>>>>
--
Joe Topjian
Systems Architect
Cybera Inc.
www.cybera.ca
Cybera is a not-for-profit organization that works to spur and support
innovation, for the economic benefit of Alberta, through the use
of cyberinfrastructure.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20130821/a800f605/attachment.html>
More information about the OpenStack-operators
mailing list