[Openstack] Controller deployment fails - any advice é help appreciated

Mario Romascanu romar at mindtrek.dnsalias.net
Fri Feb 24 04:58:01 UTC 2017


Thanks for the advice - followed the network setup recipe and same error 
after deploying Openstack on the controller node

But it is indeed a bizarre connectivity issue in the external network 
infrastructure

Deployment has failed. All nodes are finished. Failed tasks: 
Task[connectivity_tests/4] Stopping the deployment process!

Failed to deploy node 'MOS_Controller (1e:c1)': Task connectivity_tests 
failed on node 4.

Looking at the logs here are the errors that I see (time is in UTC) - it 
seems to be related to an internet connectivity issue on the Controller

Logs below

However I have set the networking as per the neutron guide and  the 
issue is still unclear

[root at fuel ~]# fuel node
id | status   | name                   | cluster | ip        | 
mac               | roles      | pending_roles | online | group_id
---+----------+------------------------+---------+-----------+-------------------+------------+---------------+--------+---------
  4 | error    | MOS_Controller (1e:c1) |       1 | 10.20.0.3 | 
00:50:56:98:1e:c1 | controller |               |      1 |        1
  3 | discover | MOS_Compute (46:4a)    |         | 10.20.0.4 | 
00:50:56:98:46:4a |            |               |      1 |
[root at fuel ~]#
Logging in to the controller node

[root at fuel ~]# ssh 10.20.0.3
Warning: Permanently added '10.20.0.3' (ECDSA) to the list of known hosts.
Welcome to Ubuntu 14.04.5 LTS (GNU/Linux 3.13.0-110-generic x86_64)

  * Documentation:  https://help.ubuntu.com/
Last login: Fri Feb 24 04:23:12 2017 from 10.20.0.2
root at node-4:~#
Pings across to IP work fine

root at node-4:~# ping 192.168.198.3  <<< this is the internet exit gateway 
across the physical network infra
PING 192.168.198.3 (192.168.198.3) 56(84) bytes of data.
64 bytes from 192.168.198.3: icmp_seq=1 ttl=254 time=4.35 ms
64 bytes from 192.168.198.3: icmp_seq=2 ttl=254 time=3.18 ms
root at node-4:~# cat /etc/resolv.conf
# re-generated by cloud-init boothook only at the first boot;
search domain.tld
domain domain.tld
nameserver 10.20.0.2  <<< this is the Fuel master node

root at node-4:~# nslookup google.com
Server:         10.20.0.2
Address:        10.20.0.2#53
Non-authoritative answer:
Name:   google.com
Address: 172.217.6.14   <<< DNS resolution OK

root at node-4:~# route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use 
Iface
default         10.100.20.1     0.0.0.0         UG    0 0        0 
br-ex   <<< this is the SVI default gw on VLAN 20 (public)
10.20.0.0       *               255.255.255.0   U     0 0        0 
br-fw-admin
10.100.20.0     *               255.255.255.0   U     0 0        0 br-ex
10.100.121.0    *               255.255.255.0   U     0 0        0 br-mgmt
10.100.122.0    *               255.255.255.0   U     0 0        0 
br-storage
169.254.169.254 -               255.255.255.255 !H    0 -        0 -

root at node-4:~# ip route get 172.217.6.14
172.217.6.14 via 10.100.20.1 dev br-ex  src 10.100.20.33

root at node-4:~# ping google.com
PING google.com (172.217.6.14) 56(84) bytes of data.

And on the internet gateway there is nothing in the NAT translations

CiscoGw#sh ip nat translations | inc 10.100.20.
CiscoGw# --- nothing ---

root at node-4:~# ifconfig br-ex
br-ex     Link encap:Ethernet  HWaddr 00:50:56:98:09:29
           inet addr:10.100.20.33  Bcast:10.100.20.255 Mask:255.255.255.0

And on the intermediate L3 switch I can see the MAC and IP i.e. it goes 
to the external network infra

Cisco-SMI#sh ip arp | inc 10.100.20.
Internet  10.100.20.33            3   0050.5698.0929  ARPA Vlan20


!!! I have to dig into this strange connectivity issue





On 2/23/2017 9:33 PM, Mario Romascanu wrote:
> Hi
>
> I was able to get to a certain point in deploying an environment on a 
> fresh installation of Mirantis OpenStack 9.0 but I am stuck with this 
> bizarre error in the controller deployment
> It does not seem to be  a communication issue - but rather a logical 
> one - an error 500 on a particular REST call URI to neutron and 200 OK 
> otherwise on different neutron URI.
> This occurs after deploying Ubuntu and Openstack on the Controller node
> *I am at a loss of what the issue is here - any suggestion welcome*
>
> "Deployment has failed. All nodes are finished. Failed tasks: 
> Task[connectivity_tests/4] Stopping the deployment process!"
> "Failed to deploy node 'MOS_Controller (1e:c1)': Task 
> connectivity_tests failed on node 4"
> [root at fuel ~]# fuel node
> id | status  | name                   | cluster | ip        | 
> mac               | roles      | pending_roles | online | group_id
> ---+---------+------------------------+---------+-----------+-------------------+------------+---------------+--------+---------
>  3 | stopped | MOS_Compute (46:4a)    |       1 | 10.20.0.4 | 
> 00:50:56:98:46:4a | compute    |               |      1 | 1
>  4 | error   | MOS_Controller (1e:c1) |       1 | 10.20.0.3 | 
> 00:50:56:98:1e:c1 | controller |               |      1 | 1
>
> An in the logs I see the traceback partially included - the root cause 
> is highlighted



---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20170223/29d473dc/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: lpikegnbgodgchlf.png
Type: image/png
Size: 18948 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20170223/29d473dc/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pgfolafgkiapkecp.png
Type: image/png
Size: 60274 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20170223/29d473dc/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: omfpknhclhemhmep.png
Type: image/png
Size: 46965 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20170223/29d473dc/attachment-0002.png>


More information about the Openstack mailing list