[Openstack] Troubles with networking part of openstack
Bartłomiej Solarz-Niesłuchowski
Bartlomiej.Solarz-Niesluchowski at wit.edu.pl
Tue Mar 28 11:20:13 UTC 2017
Dear List,
I am beginner of openstack user.
I setup openstack with RDO on Centos 7.
I have 6 machines:
they have two interfaces enp2s0f0 (10.51.0.x) and enp2s0f1 (213.135.46.x)
on machine x=1 i setup dashboard/neutron-server/nova/cinder/etc.. on
machines 2-6 i setup:
openstack-cinder-api.service,
openstack-cinder-scheduler.service,
openstack-cinder-volume.service,
openstack-nova-api.service,
openstack-nova-compute.service,
openstack-nova-conductor.service,
openstack-nova-consoleauth.service,
openstack-nova-novncproxy.service,
openstack-nova-scheduler.service
I run the virtual machine instance which have ip 10.0.3.4 (on machine 5)
I setup router on machine 1
I can ping from the virtual instance ip of router.
I see pings from wirtual machine on machine 1 (where sit router)
But i have totally no idea how to setup network connectivity with
outside world.
If somebody has any clarification please help.
Any help will be very needed...
Best Regards
PS-below some commands which i thing to be helpful for debug problem
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack network list
+----------------------------+-------------------+-----------------------------+
| ID | Name |
Subnets |
+----------------------------+-------------------+-----------------------------+
| ce71f5f2-6a7a-402d- | private |
81355100-82ab- |
| 98f7-48db18ee3a38 | |
4da4-8471-cb67de73de43 |
| d128c453-4b4f-4986-85db- | studenci-prywatna |
e84aabf0-9ae0-4e54-9692-60d |
| 8c1a6ca37761 | |
cbbf55f68 |
+----------------------------+-------------------+-----------------------------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack network list
+--------------------------------------+-------------------+--------------------------------------+
| ID | Name |
Subnets |
+--------------------------------------+-------------------+--------------------------------------+
| ce71f5f2-6a7a-402d-98f7-48db18ee3a38 | private |
81355100-82ab-4da4-8471-cb67de73de43 |
| d128c453-4b4f-4986-85db-8c1a6ca37761 | studenci-prywatna |
e84aabf0-9ae0-4e54-9692-60dcbbf55f68 |
+--------------------------------------+-------------------+--------------------------------------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack subnet list
+---------------------------------+-------------------+----------------------------------+-------------+
| ID | Name |
Network | Subnet |
+---------------------------------+-------------------+----------------------------------+-------------+
| 81355100-82ab- | private_subnet |
ce71f5f2-6a7a-402d- | 10.0.0.0/24 |
| 4da4-8471-cb67de73de43 | |
98f7-48db18ee3a38 | |
| e84aabf0-9ae0-4e54-9692-60dcbbf | studenci-prywatna |
d128c453-4b4f-4986-85db- | 10.0.3.0/24 |
| 55f68 | |
8c1a6ca37761 | |
+---------------------------------+-------------------+----------------------------------+-------------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack subnet list
+--------------------------------------+-------------------+--------------------------------------+-------------+
| ID | Name |
Network | Subnet |
+--------------------------------------+-------------------+--------------------------------------+-------------+
| 81355100-82ab-4da4-8471-cb67de73de43 | private_subnet |
ce71f5f2-6a7a-402d-98f7-48db18ee3a38 | 10.0.0.0/24 |
| e84aabf0-9ae0-4e54-9692-60dcbbf55f68 | studenci-prywatna |
d128c453-4b4f-4986-85db-8c1a6ca37761 | 10.0.3.0/24 |
+--------------------------------------+-------------------+--------------------------------------+-------------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack network list
+--------------------------------------+-------------------+--------------------------------------+
| ID | Name |
Subnets |
+--------------------------------------+-------------------+--------------------------------------+
| ce71f5f2-6a7a-402d-98f7-48db18ee3a38 | private |
81355100-82ab-4da4-8471-cb67de73de43 |
| d128c453-4b4f-4986-85db-8c1a6ca37761 | studenci-prywatna |
e84aabf0-9ae0-4e54-9692-60dcbbf55f68 |
+--------------------------------------+-------------------+--------------------------------------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack subnet list
+--------------------------------------+-------------------+--------------------------------------+-------------+
| ID | Name |
Network | Subnet |
+--------------------------------------+-------------------+--------------------------------------+-------------+
| 81355100-82ab-4da4-8471-cb67de73de43 | private_subnet |
ce71f5f2-6a7a-402d-98f7-48db18ee3a38 | 10.0.0.0/24 |
| e84aabf0-9ae0-4e54-9692-60dcbbf55f68 | studenci-prywatna |
d128c453-4b4f-4986-85db-8c1a6ca37761 | 10.0.3.0/24 |
+--------------------------------------+-------------------+--------------------------------------+-------------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack port list
+--------------------------------------+------+-------------------+-------------------------------------------------------------------------+--------+
| ID | Name | MAC Address |
Fixed IP Addresses
| Status |
+--------------------------------------+------+-------------------+-------------------------------------------------------------------------+--------+
| 0f6a1829-11a9-4217-874e-4d8cff9bc5f1 | | fa:16:3e:9c:aa:f1 |
ip_address='10.0.3.2', subnet_id='e84aabf0-9ae0-4e54-9692-60dcbbf55f68'
| ACTIVE |
| 142b9f9b-0976-4aa3-b4cc-e4f905e0cfbc | | fa:16:3e:52:d6:3d |
ip_address='10.0.3.4', subnet_id='e84aabf0-9ae0-4e54-9692-60dcbbf55f68'
| ACTIVE |
| 8a2e27f5-70f7-4b5a-8381-0277eb91c93e | | fa:16:3e:15:fe:5a |
ip_address='10.0.0.2', subnet_id='81355100-82ab-4da4-8471-cb67de73de43'
| ACTIVE |
| edef78b1-56cd-4358-be27-45a0a4d87d36 | | fa:16:3e:6f:0e:76 |
ip_address='10.0.3.1', subnet_id='e84aabf0-9ae0-4e54-9692-60dcbbf55f68'
| ACTIVE |
+--------------------------------------+------+-------------------+-------------------------------------------------------------------------+--------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack subnet show
e84aabf0-9ae0-4e54-9692-60dcbbf55f68
+-------------------+--------------------------------------+
| Field | Value |
+-------------------+--------------------------------------+
| allocation_pools | 10.0.3.2-10.0.3.254 |
| cidr | 10.0.3.0/24 |
| created_at | 2017-03-22T15:34:30Z |
| description | |
| dns_nameservers | |
| enable_dhcp | True |
| gateway_ip | 10.0.3.1 |
| host_routes | |
| id | e84aabf0-9ae0-4e54-9692-60dcbbf55f68 |
| ip_version | 4 |
| ipv6_address_mode | None |
| ipv6_ra_mode | None |
| name | studenci-prywatna |
| network_id | d128c453-4b4f-4986-85db-8c1a6ca37761 |
| project_id | e5a1d2cda6fd4895b68caa3b7fc4748f |
| revision_number | 2 |
| segment_id | None |
| service_types | |
| subnetpool_id | None |
| updated_at | 2017-03-22T15:34:30Z |
+-------------------+--------------------------------------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack router list
+--------------------------------------+-------------------+--------+-------+-------------+-------+----------------------------------+
| ID | Name | Status |
State | Distributed | HA | Project |
+--------------------------------------+-------------------+--------+-------+-------------+-------+----------------------------------+
| 6794f7f3-a2af-4538-883e-78b49a6ba633 | studenci-prywatna | ACTIVE |
UP | False | False | e5a1d2cda6fd4895b68caa3b7fc4748f |
+--------------------------------------+-------------------+--------+-------+-------------+-------+----------------------------------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack router show
studenci-prywatna
+-------------------------+--------------------------------------+
| Field | Value |
+-------------------------+--------------------------------------+
| admin_state_up | UP |
| availability_zone_hints | |
| availability_zones | nova |
| created_at | 2017-03-22T15:35:44Z |
| description | |
| distributed | False |
| external_gateway_info | None |
| flavor_id | None |
| ha | False |
| id | 6794f7f3-a2af-4538-883e-78b49a6ba633 |
| name | studenci-prywatna |
| project_id | e5a1d2cda6fd4895b68caa3b7fc4748f |
| revision_number | 17 |
| routes | |
| status | ACTIVE |
| updated_at | 2017-03-23T16:16:05Z |
+-------------------------+--------------------------------------+
[root at song-of-the-seas-01 ~(keystone_admin)]# openstack port list
--router studenci-prywatna
+--------------------------------------+------+-------------------+-------------------------------------------------------------------------+--------+
| ID | Name | MAC Address |
Fixed IP Addresses
| Status |
+--------------------------------------+------+-------------------+-------------------------------------------------------------------------+--------+
| edef78b1-56cd-4358-be27-45a0a4d87d36 | | fa:16:3e:6f:0e:76 |
ip_address='10.0.3.1', subnet_id='e84aabf0-9ae0-4e54-9692-60dcbbf55f68'
| ACTIVE |
+--------------------------------------+------+-------------------+-------------------------------------------------------------------------+--------+
[root at song-of-the-seas-01 ~(keystone_admin)]# ovs-vsctl show
8e74630d-5a11-4800-ac02-4bf297e2a20e
Manager "ptcp:6640:127.0.0.1"
is_connected: true
Bridge br-tun
Controller "tcp:127.0.0.1:6633"
is_connected: true
fail_mode: secure
Port "vxlan-0a330003"
Interface "vxlan-0a330003"
type: vxlan
options: {df_default="true", in_key=flow,
local_ip="10.51.0.1", out_key=flow, remote_ip="10.51.0.3"}
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port "vxlan-0a330004"
Interface "vxlan-0a330004"
type: vxlan
options: {df_default="true", in_key=flow,
local_ip="10.51.0.1", out_key=flow, remote_ip="10.51.0.4"}
Port "vxlan-0a330002"
Interface "vxlan-0a330002"
type: vxlan
options: {df_default="true", in_key=flow,
local_ip="10.51.0.1", out_key=flow, remote_ip="10.51.0.2"}
Port br-tun
Interface br-tun
type: internal
Port "vxlan-0a330006"
Interface "vxlan-0a330006"
type: vxlan
options: {df_default="true", in_key=flow,
local_ip="10.51.0.1", out_key=flow, remote_ip="10.51.0.6"}
Port "vxlan-0a330005"
Interface "vxlan-0a330005"
type: vxlan
options: {df_default="true", in_key=flow,
local_ip="10.51.0.1", out_key=flow, remote_ip="10.51.0.5"}
Bridge br-int
Controller "tcp:127.0.0.1:6633"
is_connected: true
fail_mode: secure
Port int-br-ex
Interface int-br-ex
type: patch
options: {peer=phy-br-ex}
Port br-int
Interface br-int
type: internal
Port "qr-edef78b1-56"
tag: 9
Interface "qr-edef78b1-56"
type: internal
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Bridge br-ex
Controller "tcp:127.0.0.1:6633"
is_connected: true
fail_mode: secure
Port "enp2s0f1"
Interface "enp2s0f1"
Port phy-br-ex
Interface phy-br-ex
type: patch
options: {peer=int-br-ex}
Port br-ex
Interface br-ex
type: internal
ovs_version: "2.6.1"
[root at song-of-the-seas-01 ~(keystone_admin)]# brctl show
bridge name bridge id STP enabled interfaces
[root at song-of-the-seas-01 ~(keystone_admin)]# tcpdump -i any -n -v
'icmp[icmptype] = icmp-echoreply or icmp[icmptype] = icmp-echo'
tcpdump: listening on any, link-type LINUX_SLL (Linux cooked), capture
size 65535 bytes
12:43:08.030018 IP (tos 0x0, ttl 64, id 16553, offset 0, flags [DF],
proto ICMP (1), length 84)
10.0.3.4 > 213.135.44.40: ICMP echo request, id 3713, seq 34867,
length 64
12:43:09.030002 IP (tos 0x0, ttl 64, id 17097, offset 0, flags [DF],
proto ICMP (1), length 84)
10.0.3.4 > 213.135.44.40: ICMP echo request, id 3713, seq 34868,
length 64
12:43:10.030037 IP (tos 0x0, ttl 64, id 17382, offset 0, flags [DF],
proto ICMP (1), length 84)
10.0.3.4 > 213.135.44.40: ICMP echo request, id 3713, seq 34869,
length 64
12:43:11.030025 IP (tos 0x0, ttl 64, id 18105, offset 0, flags [DF],
proto ICMP (1), length 84)
10.0.3.4 > 213.135.44.40: ICMP echo request, id 3713, seq 34870,
length 64
^C
4 packets captured
6 packets received by filter
0 packets dropped by kernel
[root at song-of-the-seas-01 ~(keystone_admin)]# ip ro
default via 213.135.46.254 dev br-ex
10.51.0.0/24 dev enp2s0f0 proto kernel scope link src 10.51.0.1
213.135.46.0/24 dev br-ex proto kernel scope link src 213.135.46.180
[root at song-of-the-seas-01 ~(keystone_admin)]# ip a | grep state
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
2: enp2s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state
UP qlen 1000
3: enp2s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master
ovs-system state UP qlen 1000
4: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen
1000
5: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
6: br-ex: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state
UNKNOWN qlen 1000
7: vxlan_sys_4789: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65470 qdisc
noqueue master ovs-system state UNKNOWN qlen 1000
8: br-tun: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000
[root at song-of-the-seas-01 ~(keystone_admin)]# tcpdump -i vxlan_sys_4789
tcpdump: WARNING: vxlan_sys_4789: no IPv4 address assigned
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on vxlan_sys_4789, link-type EN10MB (Ethernet), capture size
65535 bytes
13:18:26.060031 IP 10.0.3.4 > see-you-later.wsisiz.edu.pl: ICMP echo
request, id 3713, seq 36985, length 64
13:18:27.060032 IP 10.0.3.4 > see-you-later.wsisiz.edu.pl: ICMP echo
request, id 3713, seq 36986, length 64
13:18:28.060057 IP 10.0.3.4 > see-you-later.wsisiz.edu.pl: ICMP echo
request, id 3713, seq 36987, length 64
13:18:29.060006 IP 10.0.3.4 > see-you-later.wsisiz.edu.pl: ICMP echo
request, id 3713, seq 36988, length 64
--
Bartłomiej Solarz-Niesłuchowski, Administrator WSISiZ
e-mail: Bartlomiej.Solarz-Niesluchowski at wit.edu.pl
tel. 223486547, fax 223486501
JID: solarz at jabber.wit.edu.pl
01-447 Warszawa, ul. Newelska 6, pokój 404, pon.-pt. 8-16
Motto - Jak sobie pościelisz tak sie wyśpisz
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3940 bytes
Desc: Kryptograficzna sygnatura S/MIME
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20170328/286c3775/attachment.bin>
More information about the Openstack
mailing list