[Openstack-operators] StackTach setup

Tom Fifield tom at openstack.org
Fri Aug 23 03:58:08 UTC 2013


You can find options for your subscription at: 
http://lists.openstack.org/cgi-bin/mailman/options/openstack-operators

Regards,

Tom

On 23/08/13 13:55, Pavan Gupta wrote:
> Hi,
>
>   I want to unsubscribe form this mailer List. please let me know the link.
> Pavan Gupta
>
> ------------------------------------------------------------------------
> *From:* Denis Loshakov <dloshakov at gmail.com>
> *To:* Joe Topjian <joe.topjian at cybera.ca>
> *Cc:* "openstack-operators at lists.openstack.org"
> <openstack-operators at lists.openstack.org>
> *Sent:* Thursday, August 22, 2013 7:19 PM
> *Subject:* Re: [Openstack-operators] StackTach setup
>
> Yep I think mine version is new one, because if i remove lines about
> topics and queue I get this error:
> Traceback (most recent call last):
>    File "worker/start_workers.py", line 33, in <module>
>      for exchange in deployment.get('topics').keys():
> AttributeError: 'NoneType' object has no attribute 'keys'
>
>
>
> On 22.08.2013 6:36, Joe Topjian wrote:
>  > Sure, here's the stacktach_worker_config.json:
>  >
>  >      {
>  >          "name": "openstack",
>  >          "durable_queue": false,
>  >          "rabbit_host": "192.168.1.1",
>  >          "rabbit_port": 5672,
>  >          "rabbit_userid": "nova",
>  >          "rabbit_password": "passyword",
>  >          "rabbit_virtual_host": "/"
>  >      },
>  >
>  > I'm not sure about the queue_name param or the topics param. I noticed
>  > you have those in your config file but I don't have them in mine. I
>  > figured since you have a minimum of the same options as me, your config
>  > would be OK. I might be running an older version of StackTach, so maybe
>  > those options are now needed.
>  >
>  > Also, here are the options in my nova.conf file:
>  >
>  > notification_topics=monitor
>  > notification_driver=nova.openstack.common.notifier.rabbit_notifier
>  > instance_usage_audit_period=hour
>  >
>  > The last option is only recognized by nova-compute.
>  >
>  > Hope that helps,
>  > Joe
>  >
>  >
>  > On Wed, Aug 21, 2013 at 7:14 AM, Denis Loshakov <dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>
>  > <mailto:dloshakov at gmail.com <mailto:dloshakov at gmail.com>>> wrote:
>  >
>  >    Finally got it up and running.
>  >    Problem was in python and path, after second clean install from
>  >    scratch everything is fine.
>  >    But no luck with data anyway. In manual there is nothing about
>  >    "topics", also there is custom queue "queue_name": "stacktach".
>  >    Can you explain what it is about? Can you paste your
>  >    stacktach_worker_config.json
>  >
>  >    Thanks
>  >
>  >
>  >    On 21.08.2013 10 <tel:21.08.2013%2010>:39, Denis Loshakov wrote:
>  >
>  >        Here is list of pip install:
>  > root at stacktach <mailto:root at stacktach>:/opt/www/__stacktach$ pip
> install -r
>  >        ./etc/pip-requires.txt
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        Django>=1.4.2
>  >        in /usr/local/lib/python2.7/dist-__packages (from -r
>  >        ./etc/pip-requires.txt (line 1))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        MySQL-python>=1.2.3 in /usr/local/lib/python2.7/dist-__packages
>  >        (from -r
>  >        ./etc/pip-requires.txt (line 2))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        eventlet>=0.9.17 in /usr/local/lib/python2.7/dist-__packages
>  >        (from -r
>  >        ./etc/pip-requires.txt (line 3))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        kombu>=2.4.7
>  >        in /usr/local/lib/python2.7/dist-__packages (from -r
>  >        ./etc/pip-requires.txt (line 4))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        librabbitmq>=1.0.0 in /usr/local/lib/python2.7/dist-__packages
>  >        (from -r
>  >        ./etc/pip-requires.txt (line 5))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        prettytable>=0.7.2 in /usr/local/lib/python2.7/dist-__packages
>  >        (from -r
>  >        ./etc/pip-requires.txt (line 6))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        argparse in
>  >        /usr/lib/python2.7 (from -r ./etc/pip-requires.txt (line 7))
>  >        Requirement already satisfied (use --upgrade to upgrade):
> Pympler in
>  >        /usr/local/lib/python2.7/dist-__packages (from -r
>  >        ./etc/pip-requires.txt
>  >        (line 8))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        requests in
>  >        /usr/local/lib/python2.7/dist-__packages (from -r
>  >        ./etc/pip-requires.txt
>  >        (line 9))
>  >        Requirement already satisfied (use --upgrade to upgrade): south in
>  >        /usr/local/lib/python2.7/dist-__packages (from -r
>  >        ./etc/pip-requires.txt
>  >        (line 10))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        greenlet>=0.3
>  >        in /usr/local/lib/python2.7/dist-__packages (from
>  >        eventlet>=0.9.17->-r
>  >        ./etc/pip-requires.txt (line 3))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        anyjson>=0.3.3
>  >        in /usr/local/lib/python2.7/dist-__packages (from kombu>=2.4.7->-r
>  >        ./etc/pip-requires.txt (line 4))
>  >        Requirement already satisfied (use --upgrade to upgrade):
>  >        amqp>=1.0.13,<1.1.0 in /usr/local/lib/python2.7/dist-__packages
>  >        (from
>  >        kombu>=2.4.7->-r ./etc/pip-requires.txt (line 4))
>  >        Cleaning up...
>  >
>  >
>  >        On 21.08.2013 10 <tel:21.08.2013%2010>:27, Denis Loshakov wrote:
>  >
>  >            Hi, here is some debug info from logfile.
>  >            2013-08-21 09:24:29,893 - stacktach.stacklog - ERROR -
>  >            name=cloudcat,
>  >            exchange=glance, exception=No module named librabbitmq.
>  >            Reconnecting
>  >            in 5s
>  >            Traceback (most recent call last):
>  >                File "/opt/www/stacktach/worker/__worker.py", line 182,
>  >            in run
>  >                  consumer.run()
>  >                File
>  > "/usr/local/lib/python2.7/__dist-packages/kombu/mixins.py"__, line
>  >            164, in run
>  >                  errors = (self.connection.connection___errors +
>  >                File
>  >
> "/usr/local/lib/python2.7/__dist-packages/kombu/utils/____init__.py",
>  >            line
>  >            294, in __get__
>  >                  value = obj.__dict__[self.__name__] = self.__get(obj)
>  >                File
>  >
> "/usr/local/lib/python2.7/__dist-packages/kombu/__connection.py",
>  >            line 822, in connection_errors
>  >                 return self.transport.connection___errors
>  >                File
>  >
> "/usr/local/lib/python2.7/__dist-packages/kombu/__connection.py",
>  >            line 789, in transport
>  >                  self._transport = self.create_transport()
>  >                File
>  >
> "/usr/local/lib/python2.7/__dist-packages/kombu/__connection.py",
>  >            line 528, in create_transport
>  >                  return self.get_transport_cls()(__client=self)
>  >                File
>  >   "/usr/local/lib/python2.7/__dist-packages/kombu/__connection.py",
>  >            line 535, in get_transport_cls
>  >                  transport_cls = get_transport_cls(transport___cls)
>  >                File
>  >
> "/usr/local/lib/python2.7/__dist-packages/kombu/transport/____init__.py",
>  >            line 105, in get_transport_cls
>  >                  _transport_cache[transport] =
> resolve_transport(transport)
>  >                File
>  >
> "/usr/local/lib/python2.7/__dist-packages/kombu/transport/____init__.py",
>  >            line 89, in resolve_transport
>  >                 return symbol_by_name(transport)
>  >                File
>  >
> "/usr/local/lib/python2.7/__dist-packages/kombu/utils/____init__.py",
>  >            line
>  >            80, in symbol_by_name
>  >                  module = imp(module_name, package=package, **kwargs)
>  >                File "/usr/lib/python2.7/importlib/____init__.py", line
>  >            37, in
>  >            import_module
>  >                  __import__(name)
>  >                File
>  >
> "/usr/local/lib/python2.7/__dist-packages/kombu/transport/__librabbitmq.py",
>  >            line 23, in <module>
>  >                  raise ImportError("No module named librabbitmq")
>  >            ImportError: No module named librabbitmq
>  >
>  >
>  >
>  >            On 21.08.2013 8:19, Denis Loshakov wrote:
>  >
>  >                Hi, thank fro quick reply.
>  >                Here is output from start_workers.y process.
>  > root at stacktach <mailto:root at stacktach>:/opt/www/__stacktach$ python
>  > worker/start_workers.py
>  >                Starting worker for 'cloudmouse nova'
>  >                Starting worker for 'cloudmouse glance'
>  >                Starting worker for 'cloudmouse keystone'
>  >
>  >                Ah, there is logfile, didn't know that (my shame).
>  >                There are plenty errors, I think i'll do from scratch
>  >                and ley you know
>  >                results.
>  >
>  >                Thanks for tip.
>  >
>  >                On 20.08.2013 17:11, Joe Topjian wrote:
>  >
>  >               Hi Denis,
>  >
>  >                    Thanks for the configs. I verified them against mine
>  >                    and they look
>  >                    good.
>  >
>  >                    When you run start_workers.py, do you see anything
>  >                    printed out such as
>  >                    "Starting worker for openstack_devel"? This is done
>  >                    here:
>  >
>  >
> https://github.com/rackerlabs/__stacktach/blob/master/worker/__worker.py#L161
>  >
> <https://github.com/rackerlabs/stacktach/blob/master/worker/worker.py#L161>
>  >
>  >
>  >
>  >                    Additionally, there should be a worker.log file
>  >                    where line 162 will be
>  >                    printed.
>  >
>  >                    I just want to confirm you're seeing those
>  >         logs/messages because if you
>  >                    don't, something might be wrong with the workers
>  >                    themselves prior to
>  >                    reaching Rabbit.
>  >
>  >                    Thanks,
>  >                    Joe
>  >
>  >
>  >                    On Tue, Aug 20, 2013 at 4:27 AM, Denis Loshakov
>  >                    <dloshakov at gmail.com <mailto:dloshakov at gmail.com>
> <mailto:dloshakov at gmail.com <mailto:dloshakov at gmail.com>>
>  >                    <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>
>  >                    <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>>>> wrote:
>  >
>  >                          Hello, thanks for help.
>  >
>  >                          First about configs:
>  >
>  >                          stacktach_config.sh:
>  >                          export STACKTACH_DB_NAME="stacktach"
>  >                          export STACKTACH_DB_HOST=""
>  >                          export STACKTACH_DB_USERNAME="____stacktach"
>  >                          export STACKTACH_DB_PASSWORD="____stacktach123"
>  >                          export STACKTACH_DB_PORT="3306"
>  >                          export
>  >                    STACKTACH_INSTALL_DIR="/opt/____www/stacktach/"
>  >                          export
>  >
>  >
> STACKTACH_DEPLOYMENTS_FILE="/____opt/www/stacktach/etc/____stacktach_worker_config.json"
>  >
>  >
>  >
>  >                          export
>  >
>  >
> STACKTACH_VERIFIER_CONFIG="/____opt/www/stacktach/etc/____stacktach_verifier_config.____json"
>  >
>  >
>  >
>  >                          export DJANGO_SETTINGS_MODULE="____settings"
>  >
>  >                          stacktach_worker_config.json:
>  >                          {"deployments": [
>  > {
>  >                                  "name": "openstack_devel",
>  >                                  "durable_queue": false,
>  >                                  "rabbit_host": "10.0.2.20",
>  >                                  "rabbit_port": 5672,
>  >                                  "rabbit_userid": "nova",
>  >                                  "rabbit_password": "nova",
>  >                       "rabbit_virtual_host": "/",
>  >                                  "exit_on_exception": false,
>  >                                  "queue_name": "stacktach",
>  >                                  "topics": {
>  >                                      "nova": ["monitor.info
>  >                    <http://monitor.info <http://monitor.info/>>
> <http://monitor.info <http://monitor.info/>>",
>  >                          "monitor.error"],
>  >                                      "glance": ["monitor_glance.info
>  >                    <http://monitor_glance.info
> <http://monitor_glance.info/>>
>  >                          <http://monitor_glance.info
> <http://monitor_glance.info/>>",
>  >                    "monitor_glance.error"],
>  > "keystone":
>  >                    ["monitor_keystone.info
> <http://monitor_keystone.info <http://monitor_keystone.info/>>
>  >                          <http://monitor_keystone.info
> <http://monitor_keystone.info/>>__",
>  >                    "monitor_keystone.error"]
>  >                                  }
>  >                              }]
>  >                          }
>  >
>  > stacktach_verifier_config.____json:
>  >                          {
>  >                              "tick_time": 30,
>  >                              "settle_time": 5,
>  >                              "settle_units": "minutes",
>  >                              "pool_size": 2,
>  >                              "enable_notifications": true,
>  >                              "rabbit": {
>  >                             "durable_queue": false,
>  >                                  "host": "10.0.2.20",
>  >                                  "port": 5672,
>  >                                  "userid": "nova",
>  >                                  "password": "nova",
>  >                                  "virtual_host": "/",
>  >     "topics": {
>  >                                      "nova": ["notifications.info
>  >                    <http://notifications.info
> <http://notifications.info/>>
>  >                    <http://notifications.info
> <http://notifications.info/>>"],
>  >                                      "glance": ["notifications.info
>  >                    <http://notifications.info
> <http://notifications.info/>>
>  >     <http://notifications.info <http://notifications.info/>>"],
>  >                                      "keystone": ["notifications.info
>  >                    <http://notifications.info
> <http://notifications.info/>>
>  >                          <http://notifications.info
> <http://notifications.info/>>"]
>  >                                  }
>  >                              }
>  >       }
>  >
>  >                          Testing connectivity with Rabbit host:
>  > root at stacktach <mailto:root at stacktach>:/opt/www/____stacktach/etc$
>  >                    telnet 10.0.2.20 5672
>  >                          Trying 10.0.2.20...
>  >                          Connected to 10.0.2.20.
>  >                          Escape character is '^]'.
>  >                          qeqw
>  >                       ^]
>  >                          telnet> quit
>  >                          Connection closed.
>  > root at stacktach <mailto:root at stacktach>:/opt/www/____stacktach/etc$
>  >
>  >                          Run simple web server:
>  >                          python manage.py runserver 10.0.2.18:8000
>  >                    <http://10.0.2.18:8000 <http://10.0.2.18:8000/>>
> <http://10.0.2.18:8000 <http://10.0.2.18:8000/>>
>  >
>  >                          Create database and populate it:
>  >                          python manage.py syncdb
>  >                          python manage.py migrate
>  >
>  >                          And finally run workers:
>  >                          python ../worker/start_workers.py
>  >
>  >                          I tried to sniff by port 5672 or sniff by
>  >                    src/dst nothing.
>  >
>  >                          Thats my story.
>  >
>  >                          On 19.08.2013 17:36, Joe Topjian wrote:
>  >
>  >                              Hi Denis,
>  >
>  >                              I have a StackTach installation from quite
>  >                    a while ago --
>  >                              probably from
>  >                              when the manual was relevant, so I can try
>  >                 to help.
>  >
>  >                              What issue are you running into? Can you
>  >                    confirm that your
>  >                    stacktach
>  >                              workers are connecting to your Rabbit
>  >                    server? Have you added
>  >                    the
>  >                              additional notification options to nova to
>  >     have it send
>  >                    events to
>  >                              Rabbit? Can you reach the webpage without
>  >                    error?
>  >
>  >                              Thanks,
>  >                              Joe
>  >
>  >
>  >                              On Mon, Aug 19, 2013 at 7:35 AM, Denis
> Loshakov
>  >                              <dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>
>  >                    <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>>
>  >                    <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>
>  >                    <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>>>
>  >                              <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>
>  >                    <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>>
>  >                    <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>
>  >                    <mailto:dloshakov at gmail.com
> <mailto:dloshakov at gmail.com>>>>>
>  >                    wrote:
>  >
>  >                                  Hi, I've tried to setup StackTach
>  > https://github.com/rackerlabs/______stacktach
>  >                 <https://github.com/rackerlabs/____stacktach>
>  >
>  >                    <https://github.com/__rackerlabs/__stacktach
>  >                    <https://github.com/rackerlabs/__stacktach>>
>  >
>  >                      <https://github.com/____rackerlabs/stacktach
>  >                    <https://github.com/__rackerlabs/stacktach>
>  >                              <https://github.com/__rackerlabs/stacktach
>  >                    <https://github.com/rackerlabs/stacktach>>>. The
>  >                    manual is
>  >                    not so
>  >                                  fresh but I managed to setup, but
>  >                    stacktach doesn't go to
>  >                           Rabbit server.
>  >                                  Any one have any experience with
>  >                    StackTach setup?
>  >
>  >                                  Thanks.
>  >
>  >
>  >
> _____________________________________________________
>  >                                  OpenStack-operators mailing list
>  >
>  > OpenStack-operators at lists.__op____enstack.org
> <mailto:OpenStack-operators at lists.__op____enstack.org>
>  >                    <http://op__enstack.org <http://op__enstack.org/>>
>  >                              <http://openstack.org
> <http://openstack.org/>>
>  >                                  <mailto:OpenStack-operators@
>  >                    <mailto:OpenStack-operators@>____lists.openstack.org
>  >                    <http://lists.openstack.org
> <http://lists.openstack.org/>>
>  >
>  >                    <mailto:OpenStack-operators at __lists.openstack.org
> <mailto:OpenStack-operators at __lists.openstack.org>
>  >                    <mailto:OpenStack-operators at lists.openstack.org
> <mailto:OpenStack-operators at lists.openstack.org>>>>
>  >
>  >
> http://lists.openstack.org/______cgi-bin/mailman/listinfo/______openstack-operators
>  >
> <http://lists.openstack.org/____cgi-bin/mailman/listinfo/____openstack-operators>
>  >
>  >
>  >
>  >
>  >
> <http://lists.openstack.org/____cgi-bin/mailman/listinfo/____openstack-operators
>  >
> <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators>>
>  >
>  >
>  >
>  >
>  >
>  >
> <http://lists.openstack.org/____cgi-bin/mailman/listinfo/____openstack-operators
>  >
> <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators>
>  >
>  >
>  >
>  >
>  >
> <http://lists.openstack.org/__cgi-bin/mailman/listinfo/__openstack-operators
>  >
> <http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators>>>
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >                              --
>  >                              Joe Topjian
>  >                              Systems Architect
>  >                              Cybera Inc.
>  >
>  >                    www.cybera.ca <http://www.cybera.ca
> <http://www.cybera.ca/>>
>  >                    <http://www.cybera.ca <http://www.cybera.ca/>>
> <http://www.cybera.ca <http://www.cybera.ca/>>
>  >
>  >                              Cybera is a not-for-profit organization
>  >                    that works to spur and
>  >                              support
>  >                              innovation, for the economic benefit of
>  >                    Alberta, through the
>  >                    use
>  >                              of cyberinfrastructure.
>  >
>  >
>  >
>  >
>  >                    --
>  >                    Joe Topjian
>  >                    Systems Architect
>  >                    Cybera Inc.
>  >
>  >                    www.cybera.ca <http://www.cybera.ca
> <http://www.cybera.ca/>>
>  >                    <http://www.cybera.ca <http://www.cybera.ca/>>
>  >
>  >                    Cybera is a not-for-profit organization that works
>  >                    to spur and support
>  >                    innovation, for the economic benefit of Alberta,
>  >                    through the use
>  >                    of cyberinfrastructure.
>  >
>  >
>  >
>  >
>  > --
>  > Joe Topjian
>  > Systems Architect
>  > Cybera Inc.
>  >
>  > www.cybera.ca <http://www.cybera.ca <http://www.cybera.ca/>>
>  >
>  > Cybera is a not-for-profit organization that works to spur and support
>  > innovation, for the economic benefit of Alberta, through the use
>  > of cyberinfrastructure.
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> <mailto:OpenStack-operators at lists.openstack.org>
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
>
>
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>




More information about the OpenStack-operators mailing list