<div dir="ltr"><div><div><div><div><div><div><div>Kevin,<br><br></div>You are right. Just found the issue. Created external network as Flat network.<br><br></div>Now its is working :)<br><br></div>Thanks a lot guys for your valuable help<br><br></div>Kevin<br></div>Miguel<br></div>Noah<br><br></div>I will keep in touch wth you guys.<br><div><div><br><div><div><br><div><br><div><br></div></div></div></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jun 5, 2015 at 8:31 PM, Fox, Kevin M <span dir="ltr"><<a href="mailto:Kevin.Fox@pnnl.gov" target="_blank">Kevin.Fox@pnnl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
Since you are passing the tagged physical network device eth1.803 into the bridge, I think you need to use a flat network in the config/ external network create command. Otherwise it may do nested vlan tags.<br>
<br>
Thanks,<br>
Kevin <b>
<div><font face="Tahoma" size="2" color="#000000"> </font></div>
</b>
<hr>
<font face="Tahoma" size="2"><b>From:</b> Geo Varghese<br>
<b>Sent:</b> Friday, June 05, 2015 5:38:33 AM<span><br>
<b>To:</b> Miguel A Diaz Corchero<br>
</span><div><div><b>Cc:</b> <a href="mailto:openstack-operators@lists.openstack.org" target="_blank">openstack-operators@lists.openstack.org</a><br>
<b>Subject:</b> Re: [Openstack-operators] Help with multiple external network in openstack<br>
</div></div></font><div><div><br>
<div></div>
<div>
<div dir="ltr">
<div>Hi Miguel,<br>
<br>
</div>
<b>I am adding my content of /etc/neutron/plugins/ml2/ml2_conf.ini of controller</b><br>
<div>
<div><br>
[ml2]<br>
type_drivers = gre,vlan<br>
tenant_network_types = gre,vlan<br>
mechanism_drivers = openvswitch<br>
<br>
[ml2_type_flat]<br>
flat_networks = <br>
<br>
[ml2_type_vlan]<br>
network_vlan_ranges = physnet1:803:803,physnet2:805:805<br>
<br>
[ml2_type_gre]<br>
tunnel_id_ranges = 1:1000<br>
<br>
[ml2_type_vxlan]<br>
vni_ranges = <br>
vxlan_group = <br>
<br>
[securitygroup]<br>
enable_security_group = True<br>
enable_ipset = True<br>
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver<br>
<br>
[ovs]<br>
local_ip = 192.168.100.74 <br>
tunnel_type = gre<br>
enable_tunneling = True<br>
bridge_mappings = physnet1:br-ex803,physnet2:br-ex805<br>
<br>
</div>
<div><b>The content of /etc/neutron/l3_agent.ini of controller</b><br>
<br>
[DEFAULT]<br>
debug = True<br>
interface_driver = neutron.agent.linux.interface.OVSInterfaceDriver<br>
use_namespaces = True<br>
gateway_external_network_id = <br>
handle_internal_only_routers = True<br>
external_network_bridge = <br>
metadata_port = 9697<br>
send_arp_for_ha = 3<br>
periodic_interval = 40<br>
periodic_fuzzy_delay = 5<br>
router_delete_namespaces = False<br>
<br>
<br>
</div>
<div><b>Content of ovs-vsctl show after creating the bridges
</b><br>
</div>
<div><br>
root@Node25:/home/geo# ovs-vsctl show <br>
cd31399c-bdb7-4b79-9d51-acbec1a41619<br>
Bridge br-int<br>
fail_mode: secure<br>
Port int-br-ex<br>
Interface int-br-ex<br>
Port "qr-221f276d-81"<br>
tag: 1<br>
Interface "qr-221f276d-81"<br>
type: internal<br>
Port patch-tun<br>
Interface patch-tun<br>
type: patch<br>
options: {peer=patch-int}<br>
Port "int-br-ex805"<br>
Interface "int-br-ex805"<br>
Port "int-br-ex803"<br>
Interface "int-br-ex803"<br>
Port "qg-d3568030-c3"<br>
tag: 2<br>
Interface "qg-d3568030-c3"<br>
type: internal<br>
Port "tapd7bacca2-15"<br>
tag: 1<br>
Interface "tapd7bacca2-15"<br>
type: internal<br>
Port br-int<br>
Interface br-int<br>
type: internal<br>
Bridge "br-ex803"<br>
Port "eth1.803"<br>
Interface "eth1.803"<br>
Port "phy-br-ex803"<br>
Interface "phy-br-ex803"<br>
Port "br-ex803"<br>
Interface "br-ex803"<br>
type: internal<br>
Bridge br-tun<br>
Port "gre-c0a864fe"<br>
Interface "gre-c0a864fe"<br>
type: gre<br>
options: {in_key=flow, local_ip="192.168.100.74", out_key=flow, remote_ip="192.168.100.254"}<br>
Port patch-int<br>
Interface patch-int<br>
type: patch<br>
options: {peer=patch-tun}<br>
Port br-tun<br>
Interface br-tun<br>
type: internal<br>
Bridge "br-ex805"<br>
Port "phy-br-ex805"<br>
Interface "phy-br-ex805"<br>
Port "br-ex805"<br>
Interface "br-ex805"<br>
type: internal<br>
Port "eth1.805"<br>
Interface "eth1.805"<br>
ovs_version: "2.0.2"<br>
<br>
<br>
</div>
<div><b>External network added by following commands</b><br>
<br>
External network 1 => <br>
<br>
neutron net-create ext-net1 --shared --router:external=True --provider:physical_network physnet1 --provider:network_type vlan --provider:segmentation_id 803<br>
<br>
neutron subnet-create ext-net1 --name ext-subnet1 --allocation-pool start=192.168.200.150,end=192.168.200.160 --disable-dhcp
<a href="http://192.168.200.0/24" target="_blank">192.168.200.0/24</a><br>
<br>
External network 2 =><br>
neutron net-create ext-net2 --shared --router:external=True --provider:physical_network physnet2 --provider:network_type vlan --provider:segmentation_id 805<br>
<br>
neutron subnet-create ext-net2 --name ext-subnet1 --allocation-pool start=192.168.123.150,end=192.168.123.160 --disable-dhcp
<a href="http://192.168.123.0/24" target="_blank">192.168.123.0/24</a><br>
<br>
</div>
<div>Please update if you need any other details.<br>
<br>
</div>
<div>Thanks again for your time.<br>
</div>
<div><br>
</div>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, Jun 5, 2015 at 5:05 PM, Geo Varghese <span dir="ltr">
<<a href="mailto:gvarghese@aqorn.com" target="_blank">gvarghese@aqorn.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div>
<div>
<div>Hi Miguel,<br>
<br>
</div>
Thanks for getting back to me.<br>
<br>
</div>
I have already restarted both machines - controller and compute<br>
<br>
</div>
Do i need to paste any commands or conf to debug it?<br>
<div>
<div>
<div><br>
</div>
</div>
</div>
</div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, Jun 5, 2015 at 4:55 PM, Miguel A Diaz Corchero <span dir="ltr">
<<a href="mailto:miguelangel.diaz@externos.ciemat.es" target="_blank">miguelangel.diaz@externos.ciemat.es</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF">
<div>El 05/06/15 13:07, Geo Varghese escribió:<br>
</div>
<span>
<blockquote type="cite">
<div dir="ltr">I tried it but somethig missing still, ping to floating IP seems not working<br>
</div>
</blockquote>
</span>please, try to restart the L3 agent linked with that floating IP and let us know<span><br>
<blockquote type="cite">
<div dir="ltr">
<div><br>
do we have to add any changes to compute node for it? <br>
</div>
</div>
</blockquote>
</span>it shouldn't be necessary<span><font color="#888888"><br>
<br>
Miguel.</font></span>
<div>
<div><br>
<br>
<blockquote type="cite">
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, Jun 5, 2015 at 12:16 PM, Geo Varghese <span dir="ltr">
<<a href="mailto:gvarghese@aqorn.com" target="_blank">gvarghese@aqorn.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div>Miguel,<br>
<br>
</div>
Thanks thats a great link. Let me try it.<br>
</div>
<div>
<div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, Jun 5, 2015 at 12:04 PM, Miguel A Diaz Corchero <span dir="ltr">
<<a href="mailto:miguelangel.diaz@externos.ciemat.es" target="_blank">miguelangel.diaz@externos.ciemat.es</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF">
<div>Following this link I configured it in my infrastructure. Maybe this can also help you.<br>
<br>
<a href="https://www.softwareab.net/wordpress/openstack-adding-external-networks-neutron-gre/" target="_blank">https://www.softwareab.net/wordpress/openstack-adding-external-networks-neutron-gre/</a><br>
<br>
Miguel.<br>
<br>
El 04/06/15 23:15, Geo Varghese escribió:<br>
</div>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">
<div>Thanks a lot friend for explaining it. I am also using ubuntu.</div>
<div><br>
</div>
<div>let me try it. I will update you with the results.</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Fri, Jun 5, 2015 at 2:20 AM, Abrahams.Noah <span dir="ltr">
<<a href="mailto:Noah.Abrahams@igt.com" target="_blank">Noah.Abrahams@igt.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Hi Geo,</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">First a disclaimer: I’m working on Ubuntu and Icehouse, so you might have different behavior, based on your distributions. Also, I don’t have all the specifics
and flags you might need, but hopefully this can point you in the right direction. Also, also, the design below accounts for some VLAN segregation, and may be more complicated than what you need.</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Since you already have the eth devices created, and assuming your routing is correct: I would create a new bridge for each vlan with ovs-vsctl (say, br-ex803
and br-ex805). If you look at <a href="http://openvswitch.org/support/dist-docs/ovs-vsctl.8.txt" target="_blank">
http://openvswitch.org/support/dist-docs/ovs-vsctl.8.txt</a> you can find the syntax for add-br to create the bridge, then add-port to bind it to the eth device. You can also use ovs-vsctl to set the trunks property on the port, after it’s created, which you’ll
need for the vlan tagging. Then, create a new physnet to match each one of those (physnet3, physnet4, etc) and include them in the bridge-mapping as “physnet3:br-ex803”, or something similar, and specify the VLANs as belonging to that particular physnet in
the network_vlan_ranges parameter, like “…physnet3:803,physnet4:805”. </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">After all that, you’ll need to update the neutron sql database so the entry in the network segments table will point to the correct physnet. Search it by
the UUID of the network you’re creating, and update the physical_network property to match “physnet3” or whatever you create. Then you can create a subnet from that network, allocate from it, and it should work. You’ll also need to restart the openvswitch-agent
and the L3-agent, probably before you create the subnet.</span></p>
<span>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Noah Abrahams</span></b></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Staff Engineer @ IGT | Central Platforms and Apps</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
</span>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Geo Varghese [mailto:<a href="mailto:gvarghese@aqorn.com" target="_blank">gvarghese@aqorn.com</a>]
<br>
<b>Sent:</b> Thursday, June 04, 2015 12:43 PM<br>
<b>To:</b> Abrahams.Noah<br>
<b>Cc:</b> <a href="mailto:openstack-operators@lists.openstack.org" target="_blank">
openstack-operators@lists.openstack.org</a><br>
<b>Subject:</b> Re: [Openstack-operators] Help with multiple external network in openstack</span></p>
<div>
<div>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal">Hi Noah,</p>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Thanks a lot for valuable inputs.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">I am using vlan tags for 2 external network and it configured on eth1.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">The two interfaces for multiple external networks are eth1.803 and eth1.805</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Currently i didn't created br-ex bridge as it is multiple network.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">I have added vlan rages as => </p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">network_vlan_ranges = physnet1:100:2999</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">bridge_mappings as</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">bridge_mappings =</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Can you please explain what are the configurations I have to do to implement it.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Thanks for your time.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
</div>
<div>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal">On Fri, Jun 5, 2015 at 12:18 AM, Abrahams.Noah <<a href="mailto:Noah.Abrahams@igt.com" target="_blank">Noah.Abrahams@igt.com</a>> wrote:</p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Geo,</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">You also need to set the gateway_external_network_id variable to empty. If you don’t, the L3 agent is either using the gateway from the network with the
specified UUID, or can’t figure out which one to use.</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Also, if the networks have VLAN tags that would be handled by the switch, you might need to create that network on an entirely separate bridge (for example:
br-ex2) and bind it to your physical interface. After you do that, go through all the associations, such as adding the new physnet# in your bridge mappings and vlan ranges in your ml2_conf.ini.</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Noah Abrahams</span></b></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Staff Engineer @ IGT | Central Platforms and Apps</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> </span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Geo Varghese [mailto:<a href="mailto:gvarghese@aqorn.com" target="_blank">gvarghese@aqorn.com</a>]
<br>
<b>Sent:</b> Thursday, June 04, 2015 6:26 AM<br>
<b>To:</b> <a href="mailto:openstack-operators@lists.openstack.org" target="_blank">
openstack-operators@lists.openstack.org</a>; <a href="mailto:openstack@lists.openstack.org" target="_blank">
openstack@lists.openstack.org</a><br>
<b>Subject:</b> [Openstack-operators] Help with multiple external network in openstack</span></p>
<p class="MsoNormal"> </p>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi Team,</p>
</div>
<div>
<div>
<p class="MsoNormal">I need some help to setup multiple external network</p>
<div>
<p class="MsoNormal"><br clear="all">
</p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">In normal single external network we create
<b>br-ex</b> bridge and add it in </p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">/etc/neutron/l3_agent.ini</p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">As <br>
<br>
external_network_bridge = br-ex</p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">It is working for me.</p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">But in the case of multiple external network, this variable to be set to empty according to the docs. I did that but seems working.</p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Any one please specify whta other changes i have to do to make it working.</p>
</div>
<div>
<p class="MsoNormal">Thanks for your support guys.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"> </p>
<div>
<div>
<p class="MsoNormal">--</p>
<div>
<p class="MsoNormal">Regards,</p>
</div>
<div>
<p class="MsoNormal">Geo Varghese</p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal">CONFIDENTIALITY NOTICE: This message is the property of International Game Technology PLC and/or its subsidiaries and may contain proprietary, confidential or trade secret information. This message is intended solely for the use of the
addressee. If you are not the intended recipient and have received this message in error, please delete this message from your system. Any unauthorized reading, distribution, copying, or other use of this message or its attachments is strictly prohibited.
</p>
</div>
</div>
<p class="MsoNormal"><br>
<br clear="all">
</p>
<div>
<p class="MsoNormal"> </p>
</div>
<p class="MsoNormal">-- </p>
<div>
<div>
<p class="MsoNormal">--</p>
<div>
<p class="MsoNormal">Regards,</p>
</div>
<div>
<p class="MsoNormal">Geo Varghese</p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div>
<div>CONFIDENTIALITY NOTICE: This message is the property of International Game Technology PLC and/or its subsidiaries and may contain proprietary, confidential or trade secret information. This message is intended solely for the use of the addressee. If you
are not the intended recipient and have received this message in error, please delete this message from your system. Any unauthorized reading, distribution, copying, or other use of this message or its attachments is strictly prohibited.
</div>
</div>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
<div>
<div dir="ltr">--
<div>Regards,</div>
<div>Geo Varghese</div>
</div>
</div>
</div>
<br>
<fieldset></fieldset> <br>
</div>
</div>
<pre>_______________________________________________
OpenStack-operators mailing list
<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a>
</pre>
</blockquote>
<br>
</div>
<br>
_______________________________________________<br>
OpenStack-operators mailing list<br>
<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br>
</blockquote>
</div>
<br>
<br clear="all">
<br>
-- <br>
<div>
<div dir="ltr">--
<div>Regards,</div>
<div>Geo Varghese</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<br>
-- <br>
<div>
<div dir="ltr">--
<div>Regards,</div>
<div>Geo Varghese</div>
</div>
</div>
</div>
</blockquote>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<br>
-- <br>
<div>
<div dir="ltr">--
<div>Regards,</div>
<div>Geo Varghese</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<br>
-- <br>
<div>
<div dir="ltr">--
<div>Regards,</div>
<div>Geo Varghese</div>
</div>
</div>
</div>
</div>
</div></div></div>
</blockquote></div><br><br clear="all"><br>-- <br><div><div dir="ltr">--<div>Regards,</div><div>Geo Varghese</div></div></div>
</div></div>