December 2018 - openstack-discuss

[cinder] Is the cinder Active-Active feature OK？
by Jaze Lee 03 Jan '19

03 Jan '19

Hello, In my opinion, all rest api will get to manager of cinder volume. If the manager is using DLM, we can say cinder volume can support active-active. So, can we rewrite the comments and option's help in page https://github.com/openstack/cinder/blob/master/cinder/cmd/volume.py#L78 ? Thanks a lot. -- 谦谦君子

2 2

[neutron] Bug deputy report 17th~23rd Dec 2018
by Paweł Suder 02 Jan '19

02 Jan '19

Hello Neutrons, Following bugs/RFE/issues have been raised during last week. Some of them were already recognized, triaged, checked: >From oldest: https://bugs.launchpad.net/neutron/+bug/1808731 [RFE] Needs to restart metadata proxy with the start/restart of l3/dhcp agent - IMO need to discus how to do that. https://bugs.launchpad.net/neutron/+bug/1808916 Update mailinglist from dev to discuss - it is done. https://bugs.launchpad.net/neutron/+bug/1808917 RetryRequest shouldn't log stack trace by default, or it should be configurable by the exception - confirmed by Sławek ;) https://bugs.launchpad.net/neutron/+bug/1809037 [RFE] Add anti_affinity_group to binding:profile - RFE connected with another RFE from Nova related to NFV and (anti)affinity of resources like PFs. https://bugs.launchpad.net/neutron/+bug/1809080 reload_cfg doesn't work correctly - change in review, I tried to review, but no comments left - new contributor https://bugs.launchpad.net/neutron/+bug/1809134 - TypeError in QoS gateway_ip code in l3-agent logs - review in progress https://bugs.launchpad.net/neutron/+bug/1809238 - [l3] `port_forwarding` cannot be set before l3 `router` in service_plugins - review in progress https://bugs.launchpad.net/neutron/+bug/1809447 - performance regression from mitaka to ocata - not triaged, I am not sure how to handle it - it is a wide thing.. https://bugs.launchpad.net/neutron/+bug/1809497 - bug noticed on gates related to another bug opened last week: https://bugs.launchpad.net/neu tron/+bug/1809134 Wish you a good time this week and for the next year! :) Cheers, Paweł

2 2

[all][ptl][heat][senlin][magnum]New SIG for Autoscaling? plus Session Summary: Autoscaling Integration, improvement, and feedback
by Rico Lin 02 Jan '19

02 Jan '19

Dear all Tl;dr; I gonna use this ML to give a summary of the forum [1] and asking for feedback for the idea of new SIG. We have a plan to create a new SIG for autoscaling which to cover the common library, docs, and tests for cross-project services (Senlin, Heat, Monasca, etc.) and cross-community (OpenStack, Kubernetes, etc). And the goal is not just to have a place to keep those resources that make sure we can guarantee the availability for use cases, also to have a force to keep push the effort to integrate across services or at least make sure we don't go to a point where everyone just do their own service and don't care about any duplication. So if you have any thoughts for the new SIG (good or bad) please share it here. Here I summarize our discussion in the forum session `Autoscaling Integration, improvement, and feedback`. If you like to learn more or input your thoughts, feel free to put it in etherpad [1] or simply reply to this email. In the forum, we have been discussed the scope and possibility to integrate effort from Heat, Senlin, and also autoscaling across OpenStack to K8s. There are some long-term goals that we can start on like create a document for general Autoscaling on OpenStack, Common library for cross-project usage, or create real scenario cases to test on our CI. And the most important part is how can we help users and satisfied use cases without confuse them or making too much duplication effort across communities/projects. So here's an action we agree on, is to trigger discussion for either we need to create a new SIG for autoscaling. We need to define the scope and the goal for this new SIG before we go ahead and create one. The new SIG will cover the common library, docs, and tests for cross-project services (Senlin, Heat, Monasca, etc.) and cross-community (OpenStack, Kubernetes, etc). And the goal is not just to have a place to keep those resources that make sure we can guarantee the availability for use cases, also to have a force to keep push the effort to integrate across services or at least make sure we don't go to a point where everyone just do their own service and don't care about any duplication. For example, we can have a document about do autoscaling in OpenStack, but we need a place to put it and keep maintain it. And we can even have a place to set up CI to test all scenario for autoscaling. I think it's possible to extend the definition of this SIG, but we have to clear our goal and make sure we actually doing a good thing and make everyone's life easier. On the other hand we also need to make sure we do not duplicate the effort of other SIGs/WGs. Also The reason I add `ptl` tag for this ML is that this SIG or the concept of `autoscaling` might be very deferent to different projects. So I really wish to hear from anyone and any projects who are interested in this topic. [1] https://etherpad.openstack.org/p/autoscaling-integration-and-feedback -- May The Force of OpenStack Be With You, *Rico Lin*irc: ricolin

4 3

[nova] Granular locks in the API
by Matt Riedemann 02 Jan '19

02 Jan '19

I wanted to float something that we talked about in the public cloud SIG meeting today [1] which is the concept of making the lock API more granular to lock on a list of actions rather than globally locking all actions that can be performed on a server. The primary use case we discussed was around a pre-paid pricing model for servers. A user can pre-pay resources at a discount if let's say they are going to use them for a month at a fixed rate. However, once they do, they can't resize those servers without going through some kind of approval (billing) process to resize up. With this, the provider could lock the user from performing the resize action on the server but the user could do other things like stop/start/reboot/snapshot/etc. The pricing model sounds similar to pre-emptible instances for getting a discount but the scenario is different in that these servers couldn't be pre-empted (they are definitely more non-cloudy pets than cattle). An alternative solution for that locked resize issue is using granular policy rules such that pre-paid servers have some other kind of role attached to them so by policy you could restrict users from performing actions on those servers (but the admin could override). In reality I'm not sure how feasible that is in a public cloud with several thousand projects. The issue I see with policy controlling this is the role is attached to the project, not the resource (the server), so if you did this would users have to have separate projects for on-demand vs pre-paid resources? I believe that's what CERN and StackHPC are doing with pre-emptible instances (you have different projects with different quota models for pre-emptible resources). I believe there are probably other use cases for granular locks on servers for things like service VMs (trove creates some service VMs to run a database cluster and puts locks on those servers). Again, definitely a pet scenario but it's one I've heard before. Would people be generally in favor of this or opposed, or just meh? [1] https://etherpad.openstack.org/p/publiccloud-wg -- Thanks, Matt

4 5

queens heat db deadlock
by Ignazio Cassano 02 Jan '19

02 Jan '19

Hi All, I installed queens on centos 7. Heat seems to work fine with templates I wrote but when I create magnum cluster I often face with db deadlock in heat-engine log: 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource Traceback (most recent call last): 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource File "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 918, in _action_recorder 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource yield 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource File "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 2035, in delete 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource *action_args) 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource File "/usr/lib/python2.7/site-packages/heat/engine/scheduler.py", line 346, in wrapper 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource step = next(subtask) 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource File "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 977, in action_handler_task 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource done = check(handler_data) 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource File "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py", line 587, in check_delete_complete 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource return self._check_status_complete(self.DELETE) 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource File "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py", line 454, in _check_status_complete 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource action=action) 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource ResourceFailure: resources[0]: (pymysql.err.InternalError) (1213, u'Deadlock found when trying to get lock; try restarting transaction') (Background on this error at: http://sqlalche.me/e/2j85) 2018-12-13 11:48:46.016 89597 ERROR heat.engine.resource 2018-12-13 11:48:46.030 89597 INFO heat.engine.stack [req-9a43184f-77d8-4fad-ab9e-2b9826c10b70 - admin - default default] Stack DELETE FAILED (swarm-clustergp27-ebhsalhb4bop-swarm_primary_master-tzgkh3ncmymw): Resource DELETE failed: resources[0]: (pymysql.err.InternalError) (1213, u'Deadlock found when trying to get lock; try restarting transaction') (Background on this error at: http://sqlalche.me/e/2j85) 2018-12-13 11:48:46.844 89595 INFO heat.engine.resource [req-9a43184f-77d8-4fad-ab9e-2b9826c10b70 - admin - default default] DELETE: ResourceGroup "swarm_primary_master" [6984db3c-3ac1-4afc-901f-21b3e7f230a7] Stack "swarm-clustergp27-ebhsalhb4bop" [b43256fa-52e2-4613-ac15-63fd9340a8be] I read this issue was solved in heat version 10 but seems not. Regards Ignazio

5 14

[heat] Bug : Heat cannot create Octavia Load Balancer
by Zufar Dhiyaulhaq 01 Jan '19

01 Jan '19

I have try creating load balancer with Heat. but always get this error : Resource CREATE failed: OctaviaClientException: resources.loadbalancer: Validation failure: Missing project ID in request where one is required. (HTTP 400) (Request-ID: req-b45208e1-a200-47f9-8aad-b130c4c12272) OctaviaClientException: resources.loadbalancer: Validation failure: Missing project ID in request where one is required. (HTTP 400) (Request-ID: req-b45208e1-a200-47f9-8aad-b130c4c12272) I create 2 openstack environment : - Heat with Octavia (Octavia Heat Template : http://paste.opensuse.org/view//33592182 ) - Heat with Neutron Lbaasv2 (Neutron LBaaSv2 Heat Template : http://paste.opensuse.org/view//71741503) But always error when creating with octavia : - Octavia Log (https://imgur.com/a/EsuWvla) - LBaaS v2 (https://imgur.com/a/BqNGRPH) Are Heat code is broken to create Octavia Load Balancer? Best Regards, Zufar Dhiyaulhaq

3 2

[Heat][Octavia] Is autoscaling feature missing?
by Viktor Shulhin 01 Jan '19

01 Jan '19

Hi all, I am trying to create Heat template with autoscaling and loadbalancing. I didn't find any similar Heat template examples. Individually, loadbalancing and autoscaling work well, but loadbalancing OS::Octavia::PoolMember can be added only manually. Is there any way to use OS::Heat::AutoScalingGroup as server pool for loadbalancing? Regards, Viktor.

3 2

[Mistral]
by Deep C 30 Dec '18

30 Dec '18

Hi Team, Could anyone please help me fixing the below issue - Mistral server throws error when i execute workflows - 2018-12-31 00:49:40.025 59372 ERROR mistral.notifiers.default_notifier Exception: [9ad86428-59ca-4823-87ad-61915f61410d] Unable to publish event because st2 returned status code 500. { 2018-12-31 00:49:40.025 59372 ERROR mistral.notifiers.default_notifier "faultstring": "Internal Server Error" 2018-12-31 00:49:40.025 59372 ERROR mistral.notifiers.default_notifier } 2018-12-31 00:49:40.025 59372 ERROR mistral.notifiers.default_notifier Bug also raised for more details - https://bugs.launchpad.net/mistral/+bug/1808668 Please suggest the solution .

1 0

openstack magnum on queens: please help me
by Ignazio Cassano 30 Dec '18

30 Dec '18

Hello Everybody, I created a kubernetes cluster with mugnum under queens. After that I ran the folloquing commands: mkdir -p /root/clusters/kubecertslb/config export KUBECONFIG=/root/clusters/kubecertslb/config $(openstack coe cluster config kubecertslb --dir ~/clusters/kubecertslb) Then the command "kubectl -n kube-system get po" reports: NAME READY STATUS RESTARTS AGE coredns-5864cfd79d-76889 1/1 Running 0 18h heapster-68b976dd7-7vdlq 1/1 Running 0 18h kubernetes-dashboard-846b8b6844-cjp2f 1/1 Running 0 18h the command "kubectl cluster-info" reports: Kubernetes master is running at https://10.102.186.126:6443 Heapster is running at https://10.102.186.126:6443/api/v1/namespaces/kube-system/services/heapster… CoreDNS is running at https://10.102.186.126:6443/api/v1/namespaces/kube-system/services/kube-dns… To further debug and diagnose cluster problems, use 'kubectl cluster-info dump' I deployed nginx: kubectl run nginx --image=nginx --replicas=2 --port=80 Then the command "kubectl get po" reports: NAME READY STATUS RESTARTS AGE nginx-7587c6fdb6-chnw6 1/1 Running 0 18h nginx-7587c6fdb6-m7fr2 1/1 Running 0 18h Exposing nginx service with type NodePort works fine. Exposing with type LoadBalancer does not work: kubectl expose deployment nginx --target-port=80 --type=LoadBalancer kubectl get svc: NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE kubernetes ClusterIP 10.254.0.1 <none> 443/TCP 19h nginx LoadBalancer 10.254.97.40 <pending> 80:31568/TCP 165m No load balancer is created. Im not using octavia but standard lbaas v2. Lbaas is working fine because I tried a configuration between two ssh vm. I read somting about the magnum.conf trust section: someone suggested to enable "cluster_user_trust = True" I tried it but with this parameter the kubernetes cluster does not finish: the heat template remains in pending ang goes in timeout during the master creation. I read also something aboud kubernetes cloud provider must be "external" or "openstack" but I think it should the automatically configured by heat. Any help, please ? Thanks and Regards Ignazio

1 0

[Openstack-discuss][Horizon] Domain input in the login page disappeared
by Minjun Hong 30 Dec '18

30 Dec '18

Hi. I'm replacing existing controller node with a new server. After the setup step, I found something weird. The domain input in the horizon login page disappeared as following link https://imgur.com/Vuj7uNT I'm not sure that is normal situation but, horizon login page in the previous system always consisted of Domain, User Name and Password. So, is there anyone who has experienced this problem? Thanks. Regards

1 0

Re: [openstack-discuss][Nova][Horizon] 'Too many connections' error
by Minjun Hong 30 Dec '18

30 Dec '18

Thanks for your reply, Chris. Following your advice, I adjusted the values in 'nova.conf' file. Setting max_connections in the mysql config file to 4096, the modified values are: 1. max_pool_size in [database] section to 1000 2. max_pool_size in [api_database] section to 1000 3. max_overflow in [database] section to 1000 4. max_overflow in [api_database] section to 1000 However, the problem which some services, such as Nova or Neutron, cannot connect to mysql DB occurred again. So that, I also modified the number of workers you had mentioned as follows: 1. osapi_compute_workers in [DEFAULT] section to 128 2. metadata_workers in [DEFAULT] section to 128 3. workers in [conductor] section to 128 And then, I could not use all openstack command at all. I mean, all openstack command did not work with "An unexpected error prevented the server from fulfilling your request. (HTTP 500)" error messages. After looking into some config files of the openstack services, I found out some similar parameters with the parameters you had mentioned were in the config files. For example, in neutron.conf file, max_pool_size also exists and glance-api.conf has worker parameter, either. I'm confused for what parameters should I use. Actually, I'm not sure of functions of the parameters and I need your help more. Thanks! Regards, On Sat, Dec 29, 2018 at 2:11 PM Chris Hoge <chris(a)openstack.org> wrote: > I’ve run into something similar. By default there are a few things going > on with Nova. To begin with, Nova starts up several services multiplied > by the number of cores on your system. When you add to this that Nova > doesn't by default constrain its database connection pool and it's eager > to create new database connections, you can quickly open tens of > thousands of new connections across more than a dozen processes in a > matter of minutes when starting a complete Nova control plane. > > Thankfully, this is easy to fix by setting the max_pool_size and > max_overflow parameters, as well as constraining the number of workers > for the different processes in nova.conf. > > You’ll want to tune your mysql max-connections to match your expected > volume of connections from the control plane. > > Hope that helps. > > On Dec 28, 2018, at 8:26 AM, Minjun Hong <nickeysgo(a)gmail.com> wrote: > > Hi. > I'm currently trying to substitute the existing controller node with a new > server. > After I install the 'Minimal deployment for Queens' on the new server, I > connect all nodes. > > However, when I made an instance on Horizon, there were some error > messages, as below link: > > https://imgur.com/hSfHx4M > > And, when I typed 'openstack flavor list', the result was as follows: > >> # openstack flavor list >> Unexpected API Error. Please report this at >> http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. >> <class 'sqlalchemy.exc.OperationalError'> (HTTP 500) (Request-ID: >> req-666d4e30-081a-429f-88ae-763e62990770) > > > Moreover, I found something regarding this problem in the Nova log: > > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> [req-666d4e30-081a-429f-88ae-763e62990770 bb1e571e4d64462bac80654b153a88c3 >> 96ad10a59d114042b8f1ee82c438649a - default default] Unexpected exception in >> API method: OperationalError: (pymysql.err.OperationalError) (1040, u'Too >> many connections') > > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi Traceback (most >> recent call last): >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 788, in >> wrapped >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> f(*args, **kwargs) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/flavors.py", >> line 50, in detail >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> limited_flavors = self._get_flavors(req) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/flavors.py", >> line 117, in _get_flavors >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> limit=limit, marker=marker) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 184, >> in wrapper >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi result = >> fn(cls, context, *args, **kwargs) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/nova/objects/flavor.py", line 650, in >> get_all >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> marker=marker) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line >> 985, in wrapper >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi with >> self._transaction_scope(context): >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> self.gen.next() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line >> 1035, in _transaction_scope >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> context=context) as resource: >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> self.gen.next() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line >> 638, in _session >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> bind=self.connection, mode=self.mode) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line >> 403, in _create_session >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> self._start() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line >> 489, in _start >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> engine_args, maker_args) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line >> 513, in _setup_for_connection >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> sql_connection=sql_connection, **engine_kwargs) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/debtcollector/renames.py", line 45, in >> wrapper >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> f(*args, **kwargs) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py", line 184, >> in create_engine >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi test_conn >> = _test_connection(engine, max_retries, retry_interval) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py", line 362, >> in _test_connection >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> engine.connect() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2091, in >> connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> self._connection_cls(self, **kwargs) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 90, in >> __init__ >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi if >> connection is not None else engine.raw_connection() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2177, in >> raw_connection >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> self.pool.unique_connection, _connection) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2151, in >> _wrap_pool_connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi e, >> dialect, self) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1461, in >> _handle_dbapi_exception_noconnection >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> util.raise_from_cause(newraise, exc_info) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 203, in >> raise_from_cause >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> reraise(type(exception), exception, tb=exc_tb, cause=cause) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2147, in >> _wrap_pool_connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return fn() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 328, in >> unique_connection >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> _ConnectionFairy._checkout(self) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2151, in >> _wrap_pool_connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi e, >> dialect, self) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1461, in >> _handle_dbapi_exception_noconnection >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> util.raise_from_cause(newraise, exc_info) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 203, in >> raise_from_cause >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> reraise(type(exception), exception, tb=exc_tb, cause=cause) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2147, in >> _wrap_pool_connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return fn() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 328, in >> unique_connection >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> _ConnectionFairy._checkout(self) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 766, in >> _checkout >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi fairy = >> _ConnectionRecord.checkout(pool) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 516, in checkout >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi rec = >> pool._do_get() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 1138, in _do_get >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> self._dec_overflow() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 66, >> in __exit__ >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> compat.reraise(exc_type, exc_value, exc_tb) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 1135, in _do_get >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> self._create_connection() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 333, in >> _create_connection >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> _ConnectionRecord(self) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 461, in __init__ >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> self.__connect(first_connect_check=True) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 651, in >> __connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi connection >> = pool._invoke_creator(self) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py", line >> 105, in connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> dialect.connect(*cargs, **cparams) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 393, >> in connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> self.dbapi.connect(*cargs, **cparams) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/pymysql/__init__.py", line 90, in Connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return >> Connection(*args, **kwargs) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 699, in >> __init__ >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> self.connect() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 936, in >> connect >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> self._request_authentication() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1156, in >> _request_authentication >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> auth_packet = self._read_packet() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1018, in >> _read_packet >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> packet.check_error() >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 384, in >> check_error >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> err.raise_mysql_exception(self._data) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File >> "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 107, in >> raise_mysql_exception >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi raise >> errorclass(errno, errval) >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> OperationalError: (pymysql.err.OperationalError) (1040, u'Too many >> connections') >> 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi >> 2018-12-29 00:58:52.930 3765 INFO nova.api.openstack.wsgi >> [req-666d4e30-081a-429f-88ae-763e62990770 bb1e571e4d64462bac80654b153a88c3 >> 96ad10a59d114042b8f1ee82c438649a - default default] HTTP exception thrown: >> Unexpected API Error. Please report this at >> http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. >> <class 'sqlalchemy.exc.OperationalError'> >> 2018-12-29 00:58:52.931 3765 INFO nova.osapi_compute.wsgi.server >> [req-666d4e30-081a-429f-88ae-763e62990770 bb1e571e4d64462bac80654b153a88c3 >> 96ad10a59d114042b8f1ee82c438649a - default default] 10.150.21.195 "GET >> /v2.1/flavors/detail HTTP/1.1" status: 500 len: 638 time: 0.1569352 > > > I already did googling with 'Too many connections' but, there were only > results about 'max_connections' of the mysql config file. > I also set the value as 4096 and I think it is enough. > > Now, I do not know what to look for to resolve this problem. > Please give me any clue. > > Thanks! > Regards, > > >

1 0

Re: Openstack-ansible and HAProxy
by zud0ku 29 Dec '18

29 Dec '18

Hi, I am having same problem. Were you able to solve the situation? Please can you share any updates? Thanks in advance. -- Sent from: http://openstack.10931.n7.nabble.com/Operators-f4774.html

1 0

[tripleo] cleaning-up old reviews
by Emilien Macchi 29 Dec '18

29 Dec '18

Like once a year, we usually clean-up old reviews in Gerrit. Per policy, I've abandoned a lot of patches that were in merge conflict, or not reviewed, or WIP or not passing CI, older than 6 months. If you want to check if one of your patches were abandoned: https://review.openstack.org/#/q/status:abandoned+owner:self Please feel free to re-open it, and let me know if any trouble. I'll also spend time on our Launchpad and also remove old bugs without any activity. Thanks, -- Emilien Macchi

1 0

[I18n] No team meeting
by Frank Kloeker 29 Dec '18

29 Dec '18

Hello, due the vacation period the I18n team will also skip the next team meetings. Our next appointment will be 2019/01/10 07:00 UTC in #openstack-meeting. Enjoy the time and a Happy New Year! Frank

3 2

[Firewall][OpenStack]
by Soheil Pourbafrani 28 Dec '18

28 Dec '18

I tried to configure the firewall for OpenStack Controller and Compute node and here are the rules I added to the firewall: myZone (active) target: default icmp-block-inversion: no interfaces: enp2s0 enp7s4 sources: services: ssh dhcpv6-client ports: 80/tcp 6080/tcp 11211/tcp 9696/tcp protocols: masquerade: no forward-ports: source-ports: icmp-blocks: rich rules: rule family="ipv4" source address="192.168.0.32" accept rule family="ipv4" source address="192.168.0.31" accept The address of the Controller and the Compute nodes are 192.168.0.31 and 192.168.0.32, respectively. Using these rules I can use Horizon on the browser and the Compute node services can connect to the Controller nodes ports. The problem is when the firewall is enabled on the Controller node, instances that are running on the Controller node (I configure the Controller node as the Compute node, too) just can be pinged and all other VMs and nodes (including the Controller node) cannot connect to it (using SSH or any other connection to a specific port). - There is no firewall running on instances. - I configured an external network to connect VMs to each other - CentOS7 is running on all nodes Here are ports listening on the Controller node: Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 0.0.0.0:8775 0.0.0.0:* LISTEN 4478/python2 tcp 0 0 0.0.0.0:9191 0.0.0.0:* LISTEN 4461/python2 tcp 0 0 0.0.0.0:5000 0.0.0.0:* LISTEN 10189/httpd tcp 0 0 0.0.0.0:8776 0.0.0.0:* LISTEN 4487/python2 tcp 0 0 0.0.0.0:25672 0.0.0.0:* LISTEN 4466/beam.smp tcp 0 0 0.0.0.0:8778 0.0.0.0:* LISTEN 10189/httpd tcp 0 0 192.168.0.31:3306 0.0.0.0:* LISTEN 4860/mysqld tcp 0 0 192.168.0.31:2379 0.0.0.0:* LISTEN 4464/etcd tcp 0 0 192.168.0.31:11211 0.0.0.0:* LISTEN 4457/memcached tcp 0 0 127.0.0.1:11211 0.0.0.0:* LISTEN 4457/memcached tcp 0 0 192.168.0.31:5900 0.0.0.0:* LISTEN 16844/qemu-kvm tcp 0 0 0.0.0.0:9292 0.0.0.0:* LISTEN 4500/python2 tcp 0 0 192.168.0.31:2380 0.0.0.0:* LISTEN 4464/etcd tcp 0 0 192.168.0.31:5901 0.0.0.0:* LISTEN 16982/qemu-kvm tcp 0 0 192.168.0.31:5902 0.0.0.0:* LISTEN 17339/qemu-kvm tcp 0 0 192.168.0.31:5903 0.0.0.0:* LISTEN 17621/qemu-kvm tcp 0 0 192.168.0.31:5904 0.0.0.0:* LISTEN 17840/qemu-kvm tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 10189/httpd tcp 0 0 0.0.0.0:4369 0.0.0.0:* LISTEN 1/systemd tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 4468/sshd tcp 0 0 192.168.0.31:3260 0.0.0.0:* LISTEN - tcp 0 0 0.0.0.0:6080 0.0.0.0:* LISTEN 4458/python2 tcp 0 0 0.0.0.0:9696 0.0.0.0:* LISTEN 4473/python2 tcp 0 0 0.0.0.0:8774 0.0.0.0:* LISTEN 4478/python2 tcp6 0 0 :::5672 :::* LISTEN 4466/beam.smp tcp6 0 0 :::22 :::* LISTEN 4468/sshd So, is there any port or something to add to firewall rules for making instances reachable when the firewall is running on the Controller node?

1 0

openstack magnum kubernetes load balancer
by Ignazio Cassano 28 Dec '18

28 Dec '18

Hello All, I created a kuberneted cluster with magnum. Than I would like to create a load balancer for nginx: kubectl run nginx --image=nginx --replicas=2 --port=80 kubectl expose deployment nginx --target-port=80 --type=LoadBalancer But kubectl get service gives: kubernetes ClusterIP 10.254.0.1 <none> 443/TCP 152m nginx LoadBalancer 10.254.161.102 <pending> 80:30648/TCP 2m58s If I use NodePort instead of LoadBalancer it works. Does kubernetes requires octavia ? I am using loadbalance v2 without octavia. Regards Ignazio

1 0

[openstack-discuss][Nova][Horizon] 'Too many connections' error
by Minjun Hong 28 Dec '18

28 Dec '18

Hi. I'm currently trying to substitute the existing controller node with a new server. After I install the 'Minimal deployment for Queens' on the new server, I connect all nodes. However, when I made an instance on Horizon, there were some error messages, as below link: https://imgur.com/hSfHx4M And, when I typed 'openstack flavor list', the result was as follows: > # openstack flavor list > Unexpected API Error. Please report this at > http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. > <class 'sqlalchemy.exc.OperationalError'> (HTTP 500) (Request-ID: > req-666d4e30-081a-429f-88ae-763e62990770) Moreover, I found something regarding this problem in the Nova log: 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > [req-666d4e30-081a-429f-88ae-763e62990770 bb1e571e4d64462bac80654b153a88c3 > 96ad10a59d114042b8f1ee82c438649a - default default] Unexpected exception in > API method: OperationalError: (pymysql.err.OperationalError) (1040, u'Too > many connections') 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi Traceback (most > recent call last): > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 788, in > wrapped > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > f(*args, **kwargs) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/flavors.py", > line 50, in detail > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > limited_flavors = self._get_flavors(req) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/flavors.py", > line 117, in _get_flavors > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > limit=limit, marker=marker) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 184, > in wrapper > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi result = > fn(cls, context, *args, **kwargs) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/nova/objects/flavor.py", line 650, in > get_all > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > marker=marker) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line > 985, in wrapper > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi with > self._transaction_scope(context): > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > self.gen.next() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line > 1035, in _transaction_scope > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > context=context) as resource: > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > self.gen.next() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line > 638, in _session > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > bind=self.connection, mode=self.mode) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line > 403, in _create_session > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > self._start() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line > 489, in _start > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > engine_args, maker_args) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line > 513, in _setup_for_connection > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > sql_connection=sql_connection, **engine_kwargs) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/debtcollector/renames.py", line 45, in > wrapper > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > f(*args, **kwargs) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py", line 184, > in create_engine > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi test_conn = > _test_connection(engine, max_retries, retry_interval) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/engines.py", line 362, > in _test_connection > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > engine.connect() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2091, in > connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > self._connection_cls(self, **kwargs) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 90, in > __init__ > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi if > connection is not None else engine.raw_connection() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2177, in > raw_connection > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > self.pool.unique_connection, _connection) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2151, in > _wrap_pool_connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi e, dialect, > self) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1461, in > _handle_dbapi_exception_noconnection > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > util.raise_from_cause(newraise, exc_info) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 203, in > raise_from_cause > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > reraise(type(exception), exception, tb=exc_tb, cause=cause) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2147, in > _wrap_pool_connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return fn() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 328, in > unique_connection > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > _ConnectionFairy._checkout(self) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2151, in > _wrap_pool_connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi e, dialect, > self) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1461, in > _handle_dbapi_exception_noconnection > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > util.raise_from_cause(newraise, exc_info) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 203, in > raise_from_cause > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > reraise(type(exception), exception, tb=exc_tb, cause=cause) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 2147, in > _wrap_pool_connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return fn() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 328, in > unique_connection > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > _ConnectionFairy._checkout(self) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 766, in > _checkout > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi fairy = > _ConnectionRecord.checkout(pool) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 516, in checkout > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi rec = > pool._do_get() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 1138, in _do_get > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > self._dec_overflow() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 66, > in __exit__ > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > compat.reraise(exc_type, exc_value, exc_tb) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 1135, in _do_get > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > self._create_connection() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 333, in > _create_connection > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > _ConnectionRecord(self) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 461, in __init__ > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > self.__connect(first_connect_check=True) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 651, in > __connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi connection > = pool._invoke_creator(self) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py", line > 105, in connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > dialect.connect(*cargs, **cparams) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 393, > in connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > self.dbapi.connect(*cargs, **cparams) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/pymysql/__init__.py", line 90, in Connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi return > Connection(*args, **kwargs) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 699, in > __init__ > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > self.connect() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 936, in > connect > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > self._request_authentication() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1156, in > _request_authentication > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi auth_packet > = self._read_packet() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1018, in > _read_packet > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > packet.check_error() > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 384, in > check_error > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > err.raise_mysql_exception(self._data) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi File > "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 107, in > raise_mysql_exception > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi raise > errorclass(errno, errval) > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > OperationalError: (pymysql.err.OperationalError) (1040, u'Too many > connections') > 2018-12-29 00:58:52.928 3765 ERROR nova.api.openstack.wsgi > 2018-12-29 00:58:52.930 3765 INFO nova.api.openstack.wsgi > [req-666d4e30-081a-429f-88ae-763e62990770 bb1e571e4d64462bac80654b153a88c3 > 96ad10a59d114042b8f1ee82c438649a - default default] HTTP exception thrown: > Unexpected API Error. Please report this at > http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. > <class 'sqlalchemy.exc.OperationalError'> > 2018-12-29 00:58:52.931 3765 INFO nova.osapi_compute.wsgi.server > [req-666d4e30-081a-429f-88ae-763e62990770 bb1e571e4d64462bac80654b153a88c3 > 96ad10a59d114042b8f1ee82c438649a - default default] 10.150.21.195 "GET > /v2.1/flavors/detail HTTP/1.1" status: 500 len: 638 time: 0.1569352 I already did googling with 'Too many connections' but, there were only results about 'max_connections' of the mysql config file. I also set the value as 4096 and I think it is enough. Now, I do not know what to look for to resolve this problem. Please give me any clue. Thanks! Regards,

1 0

[tripleo] removing MongoDB
by Emilien Macchi 28 Dec '18

28 Dec '18

Hi, MongoDB hasn't been used anywhere and it's even unsupported in TripleO since Pike. I think it's time to clean it up, therefore I propose we remove it from TripleO: https://review.openstack.org/#/q/topic:tripleo/rm/mongodb+(status:open+OR+s… Feedback is welcome, Thanks -- Emilien Macchi

1 0

[Cyborg] Nominating Coco Gao for Cyborg Core Reviewer
by Zhipeng Huang 28 Dec '18

28 Dec '18

Hi folks, Coco has been participating in Cyborg project from Rocky design discussion and has been driving the DB refactoring work ever since. I would like to nominate her as a new core reviewer of the team to recognize her contribution as well as increase the bandwidth of cyborg core team. If you have any concerns by replying to this email thread within a week. Thank you very much ! -- Zhipeng (Howard) Huang Principle Engineer IT Standard & Patent/IT Product Line Huawei Technologies Co,. Ltd Email: huangzhipeng(a)huawei.com Office: Huawei Industrial Base, Longgang, Shenzhen

1 0

[Cyborg] Nominating Yumeng Bao for Cyborg Core Reviewer
by Li Liu 27 Dec '18

27 Dec '18

Hi Team, Yumeng Bao has high-quality reviews in the last couple of cycles so I would like to nominate her for Cyborg core Please respond with your +1 or -1 votes. We'll hold voting open for 7 days -- Thank you Regards Li

1 0

[openstack_FWaaS]
by Rania Adouni 27 Dec '18

27 Dec '18

hi, I am looking for instruction to set up FWaaS for openstack queens with multiple node (controller node and network node )!! i did try this : https://docs.openstack.org/neutron/queens/admin/fwaas-v1-scenario.html but nothing was working !! anu help please Best Regards, Rania Adouni

1 0

[Cyborg] Nominating Yumeng Bao for Cyborg Core Reviewer
by Li Liu 27 Dec '18

27 Dec '18

Hi Team, Yumeng Bao has high-quality reviews in the last couple of cycles so I would like to nominate her for Cyborg core Please respond with your +1 or -1 votes. We'll hold voting open for 7 days Thank you Regards Li Liu

1 0

[openstack-dev][sahara] No meeting today
by Telles Nobrega 27 Dec '18

27 Dec '18

Hi Saharans, We won't be having meeting today, we get back next week. Thanks all, -- TELLES NOBREGA SOFTWARE ENGINEER Red Hat Brasil <https://www.redhat.com/> Av. Brg. Faria Lima, 3900 - 8º andar - Itaim Bibi, São Paulo tenobreg(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> Red Hat é reconhecida entre as melhores empresas para trabalhar no Brasil pelo Great Place to Work.

1 0

[openstack-dev] [Neutron] Propose Ryan Tidwell for neutron-dynamic-routing core
by Miguel Lavalle 26 Dec '18

26 Dec '18

Hi Stackers, I want to nominate Ryan Tidwell (irc: tidwellr) as a core reviewer for neutron-dynamic-routing ( https://github.com/openstack/neutron-dynamic-routing) Ryan has a long history with everything L3 in Neutron. He started contributing code back in 2014, helping to implement subnet pools ( https://review.openstack.org/#/c/148698/) Over the years he did great work improving Neutron's IP address manager and was the driving force in the creation and implementation of the neutron-dynamic-routing project. After a hiatus of a few cycles, Ryan came back to the community and has been very active adding support for MP-BGP in neutron-dynamic-routing and the on boarding of subnets in Neutron. The quality and number of his code reviews during the Stein cycle are on par with members of the Neutron core team: http://stackalytics.com/?module=neutron-group. I will keep this nomination open as customary. Thank you. Miguel

7 7

[magnum][octavia] Error provisioning multi master cluster with magnum.
by Zufar Dhiyaulhaq 26 Dec '18

26 Dec '18

Hello, I am success create a single master cluster (docker or kubernetes) using magnum. but always fail when creating magnum. all the log is point into Octavia error. I have tested the Octavia and its working. this is error I get from the stack debug. OctaviaClientException: resources.etcd_lb.resources.loadbalancer: Validation failure: Missing project ID in request where one is required. (HTTP 400) the full log : *[root@controller3 ~]# openstack stack resource list kubernetes-cluster-multi-maste-txdrmrikn3a4+-----------------------------+--------------------------------------+--------------------------------------------------------------------------------------+-----------------+----------------------+| resource_name | physical_resource_id | resource_type | resource_status | updated_time |+-----------------------------+--------------------------------------+--------------------------------------------------------------------------------------+-----------------+----------------------+| etcd_lb | 7aa39847-3602-4673-973e-26fc12974bb9 | file:///usr/lib/python2.7/site-packages/magnum/drivers/common/templates/lb.yaml | CREATE_FAILED | 2018-12-22T20:17:00Z || kube_masters | | OS::Heat::ResourceGroup | INIT_COMPLETE | 2018-12-22T20:17:00Z || network | e8eb37ec-bde3-4f26-b337-7c5fad937212 | file:///usr/lib/python2.7/site-packages/magnum/drivers/common/templates/network.yaml | CREATE_COMPLETE | 2018-12-22T20:17:00Z || api_lb | bc59c786-9126-4d97-9edc-ee2127acc8e3 | file:///usr/lib/python2.7/site-packages/magnum/drivers/common/templates/lb.yaml | CREATE_FAILED | 2018-12-22T20:17:00Z || secgroup_kube_minion | 72278f6b-039d-402a-b4df-77d5c8c64a0b | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2018-12-22T20:17:00Z || nodes_server_group | 1cf676b0-d09c-44a7-8f4f-7c6e7363390e | OS::Nova::ServerGroup | CREATE_COMPLETE | 2018-12-22T20:17:00Z || secgroup_kube_master | 1e96573d-0972-4f05-8876-6bbb83246cb8 | OS::Neutron::SecurityGroup | CREATE_COMPLETE | 2018-12-22T20:17:00Z || kube_minions | | OS::Heat::ResourceGroup | INIT_COMPLETE | 2018-12-22T20:17:00Z || api_address_floating_switch | | Magnum::FloatingIPAddressSwitcher | INIT_COMPLETE | 2018-12-22T20:17:00Z || api_address_lb_switch | | Magnum::ApiGatewaySwitcher | INIT_COMPLETE | 2018-12-22T20:17:00Z || etcd_address_lb_switch | | Magnum::ApiGatewaySwitcher | INIT_COMPLETE | 2018-12-22T20:17:00Z |+-----------------------------+--------------------------------------+--------------------------------------------------------------------------------------+-----------------+----------------------+[root@controller3 ~]# openstack stack resource show kubernetes-cluster-multi-maste-txdrmrikn3a4 etcd_lb| resource_status_reason | OctaviaClientException: resources.etcd_lb.resources.loadbalancer: Validation failure: Missing project ID in request where one is required. (HTTP 400) (Request-ID: req-4bd9b688-8309-4a51-b6c7-4a617b49fa45) |[root@controller3 ~]# openstack stack resource show kubernetes-cluster-multi-maste-txdrmrikn3a4 api_lb | resource_status_reason | OctaviaClientException: resources.api_lb.resources.loadbalancer: Validation failure: Missing project ID in request where one is required. (HTTP 400) (Request-ID: req-d3bd4431-4b77-45de-b0ce-44b0e3e97618) |* anyone know what is happen? Best Regards, Zufar Dhiyaulhaq

1 0