[openstack-dev] [keystone][ceilometer] 'ceilometer -d meter-list' hangs in "Making authentication request to keystone"

Srikanth Vavilapalli srikanth.vavilapalli at ericsson.com
Thu Nov 24 20:51:01 UTC 2016


Hi

We have root caused the issue. It is due to longer MTU setting in the VMs and because VxLAN tunneling is used for VM to VM communication on different compute nodes, the encapsulated packets are going beyond MTUs in the underlying network and getting fragmented and causing the connection issues. So I have set the MTU in the VMs to 1400 and the TCP MSS getting adjusted accordingly and now communication is working between VM1 & VM2. 

Thanks
Srikanth

-----Original Message-----
From: Srikanth Vavilapalli [mailto:srikanth.vavilapalli at ericsson.com] 
Sent: Wednesday, November 23, 2016 9:54 PM
To: OpenStack Development Mailing List (not for usage questions) <openstack-dev at lists.openstack.org>
Subject: Re: [openstack-dev] [keystone][ceilometer] 'ceilometer -d meter-list' hangs in "Making authentication request to keystone"

We have ensured that the both UDP and TCP communication is good between VM1 and VM2. Also if you see ceilometer debug output in my initial e-mail, the first keystone REST (curl -g -i -X GET http://mysite-ceilometer-6:5000/v2.0) from VM2 to VM1 was successful, it hanged only at the second keystone REST (POST http://mysite-ceilometer-6:5000/v2.0/tokens). So communication seems like not a problem here.

ubuntu at mysite-ceilometer-7:~$ ping 10.0.4.4 PING 10.0.4.4 (10.0.4.4) 56(84) bytes of data.
64 bytes from 10.0.4.4: icmp_seq=1 ttl=64 time=3.51 ms
64 bytes from 10.0.4.4: icmp_seq=2 ttl=64 time=2.03 ms
64 bytes from 10.0.4.4: icmp_seq=3 ttl=64 time=1.37 ms ^C
--- 10.0.4.4 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.372/2.307/3.511/0.893 ms


ubuntu at mysite-ceilometer-6:~$ nc -l 1048 Hello How is the connection?
Good

ubuntu at mysite-ceilometer-7:~$ nc 10.0.4.4 1048 Hello How is the connection?
Good


-----Original Message-----
From: gordon chung [mailto:gord at live.ca]
Sent: Wednesday, November 23, 2016 8:22 PM
To: openstack-dev at lists.openstack.org
Subject: Re: [openstack-dev] [keystone][ceilometer] 'ceilometer -d meter-list' hangs in "Making authentication request to keystone"



On 23/11/16 09:16 PM, Srikanth Vavilapalli wrote:
> Yes, I agree, this issue is not related to ceilometer. We have verified that none of the keystone commands (keystone endpoint-list, keystone catalog, keystone user-list) are working in that VM2, they all stuck in getting the token-get operation (/v2.0/tokens).
>
> If I had to suspect the keystone server setup in my VM1, then the keystone client on VM3 also wouldn't work. So seems something else is going wrong here. The keystone debugs logs also not helping much here...

you could try seeing if you can access vm1 from vm2. i imagine you have some networking issues.

>
> On the last part, could you plz point us to any existing wiki pages that describe to migrate away from ceilometer-api? Thanks for ur help...

we have a guide on how to switch to Gnocchi[1]. we don't currently have a guide to switch to anything else but you can always just use either udp or http publishers and push to your required target... that our just push to oslo.messaging topic and have your service consume from it.

[1]
http://docs.openstack.org/developer/ceilometer/install/dbreco.html#moving-from-ceilometer-to-gnocchi

cheers,

--
gord

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



More information about the OpenStack-dev mailing list