[Openstack-operators] StackTach setup
Denis Loshakov
dloshakov at gmail.com
Thu Aug 22 13:49:25 UTC 2013
Yep I think mine version is new one, because if i remove lines about
topics and queue I get this error:
Traceback (most recent call last):
File "worker/start_workers.py", line 33, in <module>
for exchange in deployment.get('topics').keys():
AttributeError: 'NoneType' object has no attribute 'keys'
On 22.08.2013 6:36, Joe Topjian wrote:
> Sure, here's the stacktach_worker_config.json:
>
> {
> "name": "openstack",
> "durable_queue": false,
> "rabbit_host": "192.168.1.1",
> "rabbit_port": 5672,
> "rabbit_userid": "nova",
> "rabbit_password": "passyword",
> "rabbit_virtual_host": "/"
> },
>
> I'm not sure about the queue_name param or the topics param. I noticed
> you have those in your config file but I don't have them in mine. I
> figured since you have a minimum of the same options as me, your config
> would be OK. I might be running an older version of StackTach, so maybe
> those options are now needed.
>
> Also, here are the options in my nova.conf file:
>
> notification_topics=monitor
> notification_driver=nova.openstack.common.notifier.rabbit_notifier
> instance_usage_audit_period=hour
>
> The last option is only recognized by nova-compute.
>
> Hope that helps,
> Joe
>
>
> On Wed, Aug 21, 2013 at 7:14 AM, Denis Loshakov <dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>> wrote:
>
> Finally got it up and running.
> Problem was in python and path, after second clean install from
> scratch everything is fine.
> But no luck with data anyway. In manual there is nothing about
> "topics", also there is custom queue "queue_name": "stacktach".
> Can you explain what it is about? Can you paste your
> stacktach_worker_config.json
>
> Thanks
>
>
> On 21.08.2013 10 <tel:21.08.2013%2010>:39, Denis Loshakov wrote:
>
> Here is list of pip install:
> root at stacktach:/opt/www/__stacktach$ pip install -r
> ./etc/pip-requires.txt
> Requirement already satisfied (use --upgrade to upgrade):
> Django>=1.4.2
> in /usr/local/lib/python2.7/dist-__packages (from -r
> ./etc/pip-requires.txt (line 1))
> Requirement already satisfied (use --upgrade to upgrade):
> MySQL-python>=1.2.3 in /usr/local/lib/python2.7/dist-__packages
> (from -r
> ./etc/pip-requires.txt (line 2))
> Requirement already satisfied (use --upgrade to upgrade):
> eventlet>=0.9.17 in /usr/local/lib/python2.7/dist-__packages
> (from -r
> ./etc/pip-requires.txt (line 3))
> Requirement already satisfied (use --upgrade to upgrade):
> kombu>=2.4.7
> in /usr/local/lib/python2.7/dist-__packages (from -r
> ./etc/pip-requires.txt (line 4))
> Requirement already satisfied (use --upgrade to upgrade):
> librabbitmq>=1.0.0 in /usr/local/lib/python2.7/dist-__packages
> (from -r
> ./etc/pip-requires.txt (line 5))
> Requirement already satisfied (use --upgrade to upgrade):
> prettytable>=0.7.2 in /usr/local/lib/python2.7/dist-__packages
> (from -r
> ./etc/pip-requires.txt (line 6))
> Requirement already satisfied (use --upgrade to upgrade):
> argparse in
> /usr/lib/python2.7 (from -r ./etc/pip-requires.txt (line 7))
> Requirement already satisfied (use --upgrade to upgrade): Pympler in
> /usr/local/lib/python2.7/dist-__packages (from -r
> ./etc/pip-requires.txt
> (line 8))
> Requirement already satisfied (use --upgrade to upgrade):
> requests in
> /usr/local/lib/python2.7/dist-__packages (from -r
> ./etc/pip-requires.txt
> (line 9))
> Requirement already satisfied (use --upgrade to upgrade): south in
> /usr/local/lib/python2.7/dist-__packages (from -r
> ./etc/pip-requires.txt
> (line 10))
> Requirement already satisfied (use --upgrade to upgrade):
> greenlet>=0.3
> in /usr/local/lib/python2.7/dist-__packages (from
> eventlet>=0.9.17->-r
> ./etc/pip-requires.txt (line 3))
> Requirement already satisfied (use --upgrade to upgrade):
> anyjson>=0.3.3
> in /usr/local/lib/python2.7/dist-__packages (from kombu>=2.4.7->-r
> ./etc/pip-requires.txt (line 4))
> Requirement already satisfied (use --upgrade to upgrade):
> amqp>=1.0.13,<1.1.0 in /usr/local/lib/python2.7/dist-__packages
> (from
> kombu>=2.4.7->-r ./etc/pip-requires.txt (line 4))
> Cleaning up...
>
>
> On 21.08.2013 10 <tel:21.08.2013%2010>:27, Denis Loshakov wrote:
>
> Hi, here is some debug info from logfile.
> 2013-08-21 09:24:29,893 - stacktach.stacklog - ERROR -
> name=cloudcat,
> exchange=glance, exception=No module named librabbitmq.
> Reconnecting
> in 5s
> Traceback (most recent call last):
> File "/opt/www/stacktach/worker/__worker.py", line 182,
> in run
> consumer.run()
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/mixins.py"__, line
> 164, in run
> errors = (self.connection.connection___errors +
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/utils/____init__.py",
> line
> 294, in __get__
> value = obj.__dict__[self.__name__] = self.__get(obj)
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/__connection.py",
> line 822, in connection_errors
> return self.transport.connection___errors
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/__connection.py",
> line 789, in transport
> self._transport = self.create_transport()
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/__connection.py",
> line 528, in create_transport
> return self.get_transport_cls()(__client=self)
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/__connection.py",
> line 535, in get_transport_cls
> transport_cls = get_transport_cls(transport___cls)
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/transport/____init__.py",
> line 105, in get_transport_cls
> _transport_cache[transport] = resolve_transport(transport)
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/transport/____init__.py",
> line 89, in resolve_transport
> return symbol_by_name(transport)
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/utils/____init__.py",
> line
> 80, in symbol_by_name
> module = imp(module_name, package=package, **kwargs)
> File "/usr/lib/python2.7/importlib/____init__.py", line
> 37, in
> import_module
> __import__(name)
> File
> "/usr/local/lib/python2.7/__dist-packages/kombu/transport/__librabbitmq.py",
> line 23, in <module>
> raise ImportError("No module named librabbitmq")
> ImportError: No module named librabbitmq
>
>
>
> On 21.08.2013 8:19, Denis Loshakov wrote:
>
> Hi, thank fro quick reply.
> Here is output from start_workers.y process.
> root at stacktach:/opt/www/__stacktach$ python
> worker/start_workers.py
> Starting worker for 'cloudmouse nova'
> Starting worker for 'cloudmouse glance'
> Starting worker for 'cloudmouse keystone'
>
> Ah, there is logfile, didn't know that (my shame).
> There are plenty errors, I think i'll do from scratch
> and ley you know
> results.
>
> Thanks for tip.
>
> On 20.08.2013 17:11, Joe Topjian wrote:
>
> Hi Denis,
>
> Thanks for the configs. I verified them against mine
> and they look
> good.
>
> When you run start_workers.py, do you see anything
> printed out such as
> "Starting worker for openstack_devel"? This is done
> here:
>
> https://github.com/rackerlabs/__stacktach/blob/master/worker/__worker.py#L161
> <https://github.com/rackerlabs/stacktach/blob/master/worker/worker.py#L161>
>
>
>
> Additionally, there should be a worker.log file
> where line 162 will be
> printed.
>
> I just want to confirm you're seeing those
> logs/messages because if you
> don't, something might be wrong with the workers
> themselves prior to
> reaching Rabbit.
>
> Thanks,
> Joe
>
>
> On Tue, Aug 20, 2013 at 4:27 AM, Denis Loshakov
> <dloshakov at gmail.com <mailto:dloshakov at gmail.com>
> <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>>> wrote:
>
> Hello, thanks for help.
>
> First about configs:
>
> stacktach_config.sh:
> export STACKTACH_DB_NAME="stacktach"
> export STACKTACH_DB_HOST=""
> export STACKTACH_DB_USERNAME="____stacktach"
> export STACKTACH_DB_PASSWORD="____stacktach123"
> export STACKTACH_DB_PORT="3306"
> export
> STACKTACH_INSTALL_DIR="/opt/____www/stacktach/"
> export
>
> STACKTACH_DEPLOYMENTS_FILE="/____opt/www/stacktach/etc/____stacktach_worker_config.json"
>
>
>
> export
>
> STACKTACH_VERIFIER_CONFIG="/____opt/www/stacktach/etc/____stacktach_verifier_config.____json"
>
>
>
> export DJANGO_SETTINGS_MODULE="____settings"
>
> stacktach_worker_config.json:
> {"deployments": [
> {
> "name": "openstack_devel",
> "durable_queue": false,
> "rabbit_host": "10.0.2.20",
> "rabbit_port": 5672,
> "rabbit_userid": "nova",
> "rabbit_password": "nova",
> "rabbit_virtual_host": "/",
> "exit_on_exception": false,
> "queue_name": "stacktach",
> "topics": {
> "nova": ["monitor.info
> <http://monitor.info> <http://monitor.info>",
> "monitor.error"],
> "glance": ["monitor_glance.info
> <http://monitor_glance.info>
> <http://monitor_glance.info>",
> "monitor_glance.error"],
> "keystone":
> ["monitor_keystone.info <http://monitor_keystone.info>
> <http://monitor_keystone.info>__",
> "monitor_keystone.error"]
> }
> }]
> }
>
> stacktach_verifier_config.____json:
> {
> "tick_time": 30,
> "settle_time": 5,
> "settle_units": "minutes",
> "pool_size": 2,
> "enable_notifications": true,
> "rabbit": {
> "durable_queue": false,
> "host": "10.0.2.20",
> "port": 5672,
> "userid": "nova",
> "password": "nova",
> "virtual_host": "/",
> "topics": {
> "nova": ["notifications.info
> <http://notifications.info>
> <http://notifications.info>"],
> "glance": ["notifications.info
> <http://notifications.info>
> <http://notifications.info>"],
> "keystone": ["notifications.info
> <http://notifications.info>
> <http://notifications.info>"]
> }
> }
> }
>
> Testing connectivity with Rabbit host:
> root at stacktach:/opt/www/____stacktach/etc$
> telnet 10.0.2.20 5672
> Trying 10.0.2.20...
> Connected to 10.0.2.20.
> Escape character is '^]'.
> qeqw
> ^]
> telnet> quit
> Connection closed.
> root at stacktach:/opt/www/____stacktach/etc$
>
> Run simple web server:
> python manage.py runserver 10.0.2.18:8000
> <http://10.0.2.18:8000> <http://10.0.2.18:8000>
>
> Create database and populate it:
> python manage.py syncdb
> python manage.py migrate
>
> And finally run workers:
> python ../worker/start_workers.py
>
> I tried to sniff by port 5672 or sniff by
> src/dst nothing.
>
> Thats my story.
>
> On 19.08.2013 17:36, Joe Topjian wrote:
>
> Hi Denis,
>
> I have a StackTach installation from quite
> a while ago --
> probably from
> when the manual was relevant, so I can try
> to help.
>
> What issue are you running into? Can you
> confirm that your
> stacktach
> workers are connecting to your Rabbit
> server? Have you added
> the
> additional notification options to nova to
> have it send
> events to
> Rabbit? Can you reach the webpage without
> error?
>
> Thanks,
> Joe
>
>
> On Mon, Aug 19, 2013 at 7:35 AM, Denis Loshakov
> <dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>
> <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>>
> <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>
> <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>>>>
> wrote:
>
> Hi, I've tried to setup StackTach
> https://github.com/rackerlabs/______stacktach
> <https://github.com/rackerlabs/____stacktach>
>
> <https://github.com/__rackerlabs/__stacktach
> <https://github.com/rackerlabs/__stacktach>>
>
> <https://github.com/____rackerlabs/stacktach
> <https://github.com/__rackerlabs/stacktach>
> <https://github.com/__rackerlabs/stacktach
> <https://github.com/rackerlabs/stacktach>>>. The
> manual is
> not so
> fresh but I managed to setup, but
> stacktach doesn't go to
> Rabbit server.
> Any one have any experience with
> StackTach setup?
>
> Thanks.
>
>
> _____________________________________________________
> OpenStack-operators mailing list
>
> OpenStack-operators at lists.__op____enstack.org
> <http://op__enstack.org>
> <http://openstack.org>
> <mailto:OpenStack-operators@
> <mailto:OpenStack-operators@>____lists.openstack.org
> <http://lists.openstack.org>
>
> <mailto:OpenStack-operators at __lists.openstack.org
> <mailto:OpenStack-operators at lists.openstack.org>>>
>
> http://lists.openstack.org/______cgi-bin/mailman/listinfo/______openstack-operators
> <http://lists.openstack.org/____cgi-bin/mailman/listinfo/____openstack-operators>
>
>
>
>
> <http://lists.openstack.org/____cgi-bin/mailman/listinfo/____openstack-operators
> <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators>>
>
>
>
>
>
> <http://lists.openstack.org/____cgi-bin/mailman/listinfo/____openstack-operators
> <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators>
>
>
>
>
> <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators
> <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators>>>
>
>
>
>
>
>
>
> --
> Joe Topjian
> Systems Architect
> Cybera Inc.
>
> www.cybera.ca <http://www.cybera.ca>
> <http://www.cybera.ca> <http://www.cybera.ca>
>
> Cybera is a not-for-profit organization
> that works to spur and
> support
> innovation, for the economic benefit of
> Alberta, through the
> use
> of cyberinfrastructure.
>
>
>
>
> --
> Joe Topjian
> Systems Architect
> Cybera Inc.
>
> www.cybera.ca <http://www.cybera.ca>
> <http://www.cybera.ca>
>
> Cybera is a not-for-profit organization that works
> to spur and support
> innovation, for the economic benefit of Alberta,
> through the use
> of cyberinfrastructure.
>
>
>
>
> --
> Joe Topjian
> Systems Architect
> Cybera Inc.
>
> www.cybera.ca <http://www.cybera.ca>
>
> Cybera is a not-for-profit organization that works to spur and support
> innovation, for the economic benefit of Alberta, through the use
> of cyberinfrastructure.
More information about the OpenStack-operators
mailing list