<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 12 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:PMingLiU;
panose-1:2 2 5 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:"\@PMingLiU";
panose-1:2 2 5 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.emailstyle18
{mso-style-name:emailstyle18;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.im
{mso-style-name:im;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle24
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi James,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black;background:white">>>> The 'net-show' output would help me deduce what your intentions were and go from there:</span><span style="font-family:"Calibri","sans-serif";color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">root@control:# neutron net-show ext-net<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">+---------------------------+--------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| Field | Value |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">+---------------------------+--------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| admin_state_up | True |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| id | e567fd9d-f87a-491c-b8f1-32d28de4069e |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| name | ext-net |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| provider:network_type | gre |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| provider:physical_network | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| provider:segmentation_id | 1 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| router:external | True |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| shared | True |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| status | ACTIVE |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| subnets | 0f5d2be9-74b0-466e-b0e6-4be8f646338a |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| tenant_id | 7479d4eabeb14b45a7f38269155ec0f5 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">+---------------------------+--------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">root@control:# neutron subnet-show 0f5d2be9-74b0-466e-b0e6-4be8f646338a<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">+------------------+------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| Field | Value |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">+------------------+------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| allocation_pools | {"start": "172.29.105.101", "end": "172.29.105.127"} |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| cidr | 172.29.105.0/24 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| dns_nameservers | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| enable_dhcp | False |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| gateway_ip | 172.29.105.254 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| host_routes | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| id | 0f5d2be9-74b0-466e-b0e6-4be8f646338a |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| ip_version | 4 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| name | ext-subnet |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| network_id | e567fd9d-f87a-491c-b8f1-32d28de4069e |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| tenant_id | 7479d4eabeb14b45a7f38269155ec0f5 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">+------------------+------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">It’s GRE turning. I will do the vlan in next project.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks for looking into it,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Mitchell<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> James Denton [mailto:james.denton@rackspace.com]
<br>
<b>Sent:</b> Wednesday, March 04, 2015 7:30 PM<br>
<b>To:</b> Mitchell Chen; Kevin Benton<br>
<b>Cc:</b> openstack@lists.openstack.org<br>
<b>Subject:</b> Re: [Openstack] Can not ping the tenant router gateway from host<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p><span style="font-family:"Calibri","sans-serif";color:black">Mitchell,<o:p></o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black"><o:p> </o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black">Let's start with the br-ex bridge. That's the bridge connected to the external interface of the router and the physical network:<o:p></o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black"><o:p> </o:p></span></p>
<p><span style="color:#212121;background:white">> Bridge br-ex</span><span style="color:#212121"><br>
<span style="background:white">> Port "qg-6849da02-da"</span><br>
<span style="background:white">> Interface "qg-6849da02-da"</span><br>
<span style="background:white">> type: internal</span><br>
<span style="background:white">> Port br-ex</span><br>
<span style="background:white">> Interface br-ex</span><br>
<span style="background:white">> type: internal</span><br>
<span style="background:white">> Port "eth2"</span><br>
<span style="background:white">> Interface "eth2"</span><br>
<span style="background:white">> ovs_version: "2.0.2"</span></span><span style="font-family:"Calibri","sans-serif";color:black"><o:p></o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black"><o:p> </o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black">I can't tell from the output you've provided what provider attributes, if any, you set for the network '</span><span style="color:#212121;background:white">ext-net</span><span style="font-family:"Calibri","sans-serif";color:black">'.
Can you provide the output of 'neutron net-show </span><span style="color:#212121;background:white">ext-net</span><span style="font-family:"Calibri","sans-serif";color:black">'? <o:p></o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black"><o:p> </o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black">As it stands, any traffic leaving the qg interface will be untagged:<o:p></o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black"><o:p> </o:p></span></p>
<p><span style="color:#212121;background:white">> root@ control:~# ovs-ofctl dump-flows br-ex NXST_FLOW reply (xid=0x4):</span><span style="color:#212121"><br>
<span style="background:white">> cookie=0x0, duration=558.95s, table=0, n_packets=479, n_bytes=102435,</span><br>
<span style="background:white">> idle_age=10, priority=0 actions=NORMAL</span></span><span style="font-family:"Calibri","sans-serif";color:black"><o:p></o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black"><o:p> </o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black">So depending on the switch port configuration, traffic out the qg interface (from the Neutron router) may not reach the gateway at </span><span style="color:#212121;background:white">172.29.105.254</span><span style="font-family:"Calibri","sans-serif";color:black">.
Like say, if ext-net is configured as a VLAN network, there is nothing currently in place to tag the traffic accordingly, be it OVS or a eth2.x interface in br-ex. The 'external_network_bridge' option in l3_agent.ini plays a part in this as well. <span style="background:white">The
'net-show' output would help me deduce what your intentions were and go from there.</span><o:p></o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black"><o:p> </o:p></span></p>
<p><span style="font-family:"Calibri","sans-serif";color:black">James<o:p></o:p></span></p>
<div>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-family:"Calibri","sans-serif";color:#212121">
<hr size="2" width="98%" align="center">
</span></div>
<div id="divRplyFwdMsg">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:black"> Mitchell Chen <<a href="mailto:mitchell.chen@mediatek.com">mitchell.chen@mediatek.com</a>><br>
<b>Sent:</b> Wednesday, March 4, 2015 8:12 PM<br>
<b>To:</b> Kevin Benton<br>
<b>Cc:</b> James Denton; <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
<b>Subject:</b> RE: [Openstack] Can not ping the tenant router gateway from host</span><span style="font-family:"Calibri","sans-serif";color:#212121">
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri","sans-serif";color:#212121"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><i><u><span style="font-family:"Calibri","sans-serif";color:#1F497D">The openvswitch agent seems to be all up with my neutron and three compute nodes</span></u></i><u><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">.</span></u><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">root@control: # neutron agent-list</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">+--------------------------------------+--------------------+------------+-------+----------------+</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| id | agent_type | host | alive | admin_state_up |</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">+--------------------------------------+--------------------+------------+-------+----------------+</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| 68eba267-b885-4aad-96a4-e8d19ac9db4a | L3 agent | mussdhux20 | :-) | True |</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| c0726b66-a1f4-4b00-9120-7bf0ee91a3d0 | DHCP agent | mussdhux20 | :-) | True |</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| d8808f97-90f8-424d-a786-45b4541af755 | Open vSwitch agent | mussdhux04 | :-) | True |</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| e8d85451-3f6f-4b2a-94a1-6dd3e9a93cff | Metadata agent | mussdhux20 | :-) | True |</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| f4e51873-7e18-49a4-ab6b-94c24500e25f | Open vSwitch agent | mussdhux13 | :-) | True |</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| f8cab47d-a0db-4de2-b457-23c4e87ccb32 | Open vSwitch agent | mussdhux10 | :-) | True |</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">| fd9ab1c9-ce62-4504-8d68-215584a70a17 | Open vSwitch agent | mussdhux20 | :-) | True |</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">+--------------------------------------+--------------------+------------+-------+----------------+</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><i><u><span style="font-family:"Calibri","sans-serif";color:#1F497D">But, there is an error related to db.sock and exception happened, how is this happen? I really appreciate the light. Can this issue be fixed?</span></u></i><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><i><span style="font-family:"Calibri","sans-serif";color:#1F497D"> </span></i><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:40.146 1907
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">ERROR neutron.agent.linux.ovsdb_monitor [-] Error received from ovsdb monitor: ovsdb-client: unix:/var/run/openvswitch/db.sock: receive failed</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
(End of file)</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:40.148 1907 DEBUG neutron.agent.linux.async_process [-] Halting async process [['ovsdb-client', 'monitor', 'Interface', 'name,ofport', '--format=json']]
in response to an error. _handle_process_error /usr/lib/python2.7/dist-packages/neutron/agent/linux/async_process.py:173</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:40.148 1907 DEBUG neutron.agent.linux.utils [-] Running command: ['ps', '--ppid', '2452', '-o', 'pid='] create_process /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:48</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:40.186 1907 DEBUG neutron.agent.linux.utils [-]</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command: ['ps', '--ppid', '2452', '-o', 'pid=']</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit code: 1</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout: ''</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr: '' execute /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:75</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:40.876 1907 DEBUG neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent rpc_loop - iteration:633 started rpc_loop /usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py:1287</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:40.877 1907 DEBUG neutron.agent.linux.utils [-] Running command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-ofctl',
'dump-flows', 'br-int', 'table=22'] create_process /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:48</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:40.975 1907 DEBUG neutron.agent.linux.utils [-]</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-ofctl', 'dump-flows', 'br-int', 'table=22']</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit code: 1</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout: ''</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr: 'ovs-ofctl: br-int is not a bridge or a socket\n' execute /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:75</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:40.976 1907 ERROR neutron.agent.linux.ovs_lib [-]
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">Unable to execute ['ovs-ofctl', 'dump-flows', 'br-int', 'table=22']. Exception</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">:</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-ofctl', 'dump-flows', 'br-int', 'table=22']</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit code: 1</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout: ''</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr: 'ovs-ofctl: br-int is not a bridge or a socket\n'</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:40.976 1907 DEBUG neutron.agent.linux.utils [-] Running command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl',
'--timeout=10', '--', '--may-exist', 'add-br', 'br-int'] create_process /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:48</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.069 1907 DEBUG neutron.agent.linux.utils [-]</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', '--', '--may-exist', 'add-br', 'br-int']</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit code: 1</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout: ''</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr: '2015-03-04T20:05:41Z|00002|reconnect|WARN|unix:/var/run/openvswitch/db.sock: connection attempt failed (No such file or directory)\novs-vsctl: unix:/var/run/openvswitch/db.sock:
database connection failed (No such file or directory)\n' execute /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:75</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.070 1907 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', '--', '--may-exist', 'add-br', 'br-int'].
Exception:</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', '--', '--may-exist', 'add-br', 'br-int']</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit code: 1</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout: ''</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr: '2015-03-04T20:05:41Z|00002|reconnect|WARN|unix:/var/run/openvswitch/db.sock: connection attempt failed (No such file or directory)\novs-vsctl: unix:/var/run/openvswitch/db.sock:
database connection failed (No such file or directory)\n'</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.071 1907 DEBUG neutron.agent.linux.utils [-] Running command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl',
'--timeout=10', '--', 'set-fail-mode', 'br-int', 'secure'] create_process /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:48</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.165 1907 DEBUG neutron.agent.linux.utils [-]</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', '--', 'set-fail-mode', 'br-int', 'secure']</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit code: 1</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout: ''</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stderr: '2015-03-04T20:05:41Z|00002|reconnect|WARN|unix:/var/run/openvswitch/db.sock: connection attempt failed (No such file or directory)\novs-vsctl: unix:/var/run/openvswitch/db.sock:
database connection failed (No such file or directory)\n' execute /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:75</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.166 1907 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', '--', 'set-fail-mode', 'br-int', 'secure'].
Exception:</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', '--', 'set-fail-mode', 'br-int', 'secure']</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Exit code: 1</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stdout: ''</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">Stderr: '2015-03-04T20:05:41Z|00002|reconnect|WARN|unix:/var/run/openvswitch/db.sock: connection attempt failed (No such file or directory)\novs-vsctl: unix:/var/run/openvswitch/db.sock:
database connection failed (No such file or directory)\n'</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:red">2015-03-04 12:05:41.166 1907 DEBUG neutron.agent.linux.async_process [-] Halting async process [['ovsdb-client', 'monitor', 'Interface', 'name,ofport', '--format=json']].
stop /usr/lib/python2.7/dist-packages/neutron/agent/linux/async_process.py:90</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 CRITICAL neutron [-] Trying to re-send() an already-triggered event.</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron Traceback (most recent call last):</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/bin/neutron-openvswitch-agent", line 10, in <module></span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron sys.exit(main())</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1476, in main</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron agent.daemon_loop()</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1404, in daemon_loop</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron self.rpc_loop(polling_manager=pm)</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron self.gen.throw(type, value, traceback)</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/polling.py", line 41, in get_polling_manager</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron pm.stop()</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/polling.py", line 108, in stop</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron self._monitor.stop()</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/async_process.py", line 91, in stop</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron self._kill()</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/ovsdb_monitor.py", line 108, in _kill</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron super(SimpleInterfaceMonitor, self)._kill(*args, **kwargs)</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/async_process.py", line 118, in _kill</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron self._kill_event.send()</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 150, in send</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron assert self._result is NOT_USED, 'Trying to re-send() an already-triggered event.'</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron AssertionError: Trying to re-send() an already-triggered event.</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.167 1907 TRACE neutron</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">2015-03-04 12:05:41.704 6251 INFO neutron.common.config [-] Logging enabled!</span><span style="color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><span style="color:#212121"><o:p></o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#212121">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:#212121"> Kevin Benton [<a href="mailto:blak111@gmail.com">mailto:blak111@gmail.com</a>]
<br>
<b>Sent:</b> Wednesday, March 04, 2015 5:01 PM<br>
<b>To:</b> Mitchell Chen<br>
<b>Cc:</b> James Denton; <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
<b>Subject:</b> Re: [Openstack] Can not ping the tenant router gateway from host</span><span style="color:#212121"><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="color:#212121"> <o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="color:#212121">Did you confirm that the openvswitch agent is running on that host? Run 'neutron agent-list' to make sure it's active. If it is, check the neutron agent log (usually something like /var/log/neutron/openvswitch-agent.log)
for exceptions to see if it was having issues binding the port.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#212121"> <o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="color:#212121">On Wed, Mar 4, 2015 at 4:14 PM, Mitchell Chen <<a href="mailto:mitchell.chen@mediatek.com" target="_blank">mitchell.chen@mediatek.com</a>> wrote:<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="color:#212121">The 172.29.106.254 is the default gateway of both my neutron and control nodes. I can ping the 105 subnet from both neutron and control nodes:<br>
<br>
root@neutron:~# ping -c 4 172.29.105.254<br>
PING 172.29.105.254 (172.29.105.254) 56(84) bytes of data.<br>
64 bytes from <a href="http://172.29.105.254" target="_blank">172.29.105.254</a>: icmp_seq=1 ttl=63 time=1.83 ms<br>
64 bytes from <a href="http://172.29.105.254" target="_blank">172.29.105.254</a>: icmp_seq=2 ttl=63 time=1.80 ms<br>
64 bytes from <a href="http://172.29.105.254" target="_blank">172.29.105.254</a>: icmp_seq=3 ttl=63 time=1.80 ms<br>
64 bytes from <a href="http://172.29.105.254" target="_blank">172.29.105.254</a>: icmp_seq=4 ttl=63 time=1.82 ms<br>
<br>
--- 172.29.105.254 ping statistics ---<br>
4 packets transmitted, 4 received, 0% packet loss, time 3005ms<br>
<br>
>>>Is there a route on that device (static/local) that would allow you to reach the
<a href="http://172.29.105.0/24" target="_blank">172.29.105.0/24</a> subnet? Are you able to ping the ext-net gateway (172.29.105.254) from within the router namespace?<br>
<br>
No, the ext-net gateway (172.29.105.254) can not be pinged within the router namespace: (Is this right way to ping?)<br>
root@ neutron:~# ip netns exec qrouter-09800b9c-7f2e-40d7-94e5-09e8f73d0302 ping -I qg-6849da02-da 172.29.105.254<br>
PING 172.29.105.254 (172.29.105.254) from 172.29.105.101 qg-6849da02-da: 56(84) bytes of data.<br>
From 172.29.105.101 icmp_seq=1 Destination Host Unreachable<br>
From 172.29.105.101 icmp_seq=2 Destination Host Unreachable<br>
From 172.29.105.101 icmp_seq=3 Destination Host Unreachable<br>
From 172.29.105.101 icmp_seq=4 Destination Host Unreachable<br>
From 172.29.105.101 icmp_seq=5 Destination Host Unreachable<br>
From 172.29.105.101 icmp_seq=6 Destination Host Unreachable<br>
<br>
>>> It means that tap is stale. You can see if there is still a corresponding Neutron port with “neutron port-list | grep 27dd1b25-62”.<br>
<br>
Yes, there is corresponding port, bit it's status down<br>
<br>
<span class="im">root@control:# neutron port-list | grep 27dd1b25-62</span><br>
<span class="im">| 27dd1b25-621a-475f-9398-cf8e4d33a7d7 | | fa:16:3e:49:c7:00 | {"subnet_id": "33d60404-d979-4b63-83ef-653268195872", "ip_address": "192.168.2.2"} |</span><br>
<br>
<span class="im">root@control:# neutron port-show 27dd1b25-621a-475f-9398-cf8e4d33a7d7</span><br>
<span class="im">+-----------------------+------------------------------------------------------------------------------------+</span><br>
<span class="im">| Field | Value |</span><br>
<span class="im">+-----------------------+------------------------------------------------------------------------------------+</span><br>
<span class="im">| admin_state_up | True |</span><br>
<span class="im">| allowed_address_pairs | |</span><br>
<span class="im">| binding:vnic_type | normal |</span><br>
<span class="im">| device_id | dhcp0416e1db-8834-5f05-9716-ee162a01eef2-95f5f75f-577f-4827-b51c-f949fb46393b |</span><br>
<span class="im">| device_owner | network:dhcp |</span><br>
<span class="im">| extra_dhcp_opts | |</span><br>
<span class="im">| fixed_ips | {"subnet_id": "33d60404-d979-4b63-83ef-653268195872", "ip_address": "192.168.2.2"} |</span><br>
<span class="im">| id | 27dd1b25-621a-475f-9398-cf8e4d33a7d7 |</span><br>
<span class="im">| mac_address | fa:16:3e:49:c7:00 |</span><br>
<span class="im">| name | |</span><br>
<span class="im">| network_id | 95f5f75f-577f-4827-b51c-f949fb46393b |</span><br>
<span class="im">| security_groups | |</span><br>
<span class="im">| status | DOWN |</span><br>
<span class="im">| tenant_id | 1bc3de8b19384858a1a7a6395e1845e3 |</span><br>
<span class="im">+-----------------------+------------------------------------------------------------------------------------+</span><br>
<br>
<span class="im">-----Original Message-----</span><br>
<span class="im">From: James Denton [mailto:<a href="mailto:james.denton@rackspace.com">james.denton@rackspace.com</a>]</span><br>
<span class="im">Sent: Wednesday, March 04, 2015 2:19 PM</span><br>
<span class="im">To: Mitchell Chen</span><br>
<span class="im">Cc: <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a></span><br>
<span class="im">Subject: Re: [Openstack] Can not ping the tenant router gateway from host</span><o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span style="color:#212121">Hi Mitchell,<br>
<br>
>> I am able to ping from router to the router gateway (172.29.105.101)<br>
>> and router to internal tenant gateway (192.168.2.1)<br>
<br>
You are pinging these IPs within the router namespace, which I would expect to work, as those are the IPs configured on the router’s interfaces.<br>
<br>
>> … but still can not ping from control node to the router gateway<br>
<br>
The default route of your Neutron host appears to be 172.29.106.254. Is that also the case for the control host?<br>
<br>
>> default via 172.29.106.254 dev eth0<br>
<br>
Is there a route on that device (static/local) that would allow you to reach the <a href="http://172.29.105.0/24" target="_blank">
172.29.105.0/24</a> subnet? Are you able to ping the ext-net gateway (172.29.105.254) from within the router namespace?<br>
<br>
>> I saw there is a tag 4095 in the tap port of the br-int bridge. Is this OK?<br>
<br>
It means that tap is stale. You can see if there is still a corresponding Neutron port with “neutron port-list | grep 27dd1b25-62”.<br>
<br>
James<br>
<br>
> On Mar 4, 2015, at 3:03 PM, Mitchell Chen <<a href="mailto:mitchell.chen@mediatek.com">mitchell.chen@mediatek.com</a>> wrote:<br>
><br>
> Hi All,<br>
><br>
> I am struggling with not being able to ping the router gateway. I am able to ping from router to the router gateway (172.29.105.101) and router to internal tenant gateway (192.168.2.1), but still can not ping from control node to the router gateway. I am
using GRE tunneling. I saw there is a tag 4095 in the tap port of the br-int bridge. Is this OK? Please advise. From the following data, is there a way to debug the issue?<br>
><br>
> Thanks,<br>
> Mitchell<br>
><br>
><br>
> root@control:~# ovs-vsctl show<br>
> f22d3ba4-d785-4fe7-a283-16ffbc75c434<br>
> Bridge br-int<br>
> fail_mode: secure<br>
> Port "qr-784a2f1c-e6"<br>
> tag: 1<br>
> Interface "qr-784a2f1c-e6"<br>
> type: internal<br>
> Port "tap27dd1b25-62"<br>
> tag: 4095<br>
> Interface "tap27dd1b25-62"<br>
> type: internal<br>
> Port br-int<br>
> Interface br-int<br>
> type: internal<br>
> Port patch-tun<br>
> Interface patch-tun<br>
> type: patch<br>
> options: {peer=patch-int}<br>
> Bridge br-tun<br>
> Port patch-int<br>
> Interface patch-int<br>
> type: patch<br>
> options: {peer=patch-tun}<br>
> Port "gre-c0a801cc"<br>
> Interface "gre-c0a801cc"<br>
> type: gre<br>
> options: {in_key=flow, local_ip="192.168.1.220", out_key=flow, remote_ip="192.168.1.204"}<br>
> Port "gre-c0a801d5"<br>
> Interface "gre-c0a801d5"<br>
> type: gre<br>
> options: {in_key=flow, local_ip="192.168.1.220", out_key=flow, remote_ip="192.168.1.213"}<br>
> Port br-tun<br>
> Interface br-tun<br>
> type: internal<br>
> Port "gre-c0a801d2"<br>
> Interface "gre-c0a801d2"<br>
> type: gre<br>
> options: {in_key=flow, local_ip="192.168.1.220", out_key=flow, remote_ip="192.168.1.210"}<br>
> Bridge br-ex<br>
> Port "qg-6849da02-da"<br>
> Interface "qg-6849da02-da"<br>
> type: internal<br>
> Port br-ex<br>
> Interface br-ex<br>
> type: internal<br>
> Port "eth2"<br>
> Interface "eth2"<br>
> ovs_version: "2.0.2"<br>
><br>
> root@control:~# ovs-ofctl dump-flows br-int NXST_FLOW reply (xid=0x4):<br>
> cookie=0x0, duration=55.846s, table=0, n_packets=2, n_bytes=214,<br>
> idle_age=8, priority=1 actions=NORMAL cookie=0x0, duration=55.649s,<br>
> table=22, n_packets=0, n_bytes=0, idle_age=55, priority=0 actions=drop<br>
><br>
> root@ control:~# ovs-ofctl dump-flows br-tun NXST_FLOW reply<br>
> (xid=0x4):<br>
> cookie=0x0, duration=66.836s, table=0, n_packets=0, n_bytes=0,<br>
> idle_age=66, priority=1,in_port=3 actions=resubmit(,2) cookie=0x0,<br>
> duration=68.694s, table=0, n_packets=0, n_bytes=0, idle_age=68,<br>
> priority=1,in_port=1 actions=resubmit(,1) cookie=0x0,<br>
> duration=66.545s, table=0, n_packets=0, n_bytes=0, idle_age=66,<br>
> priority=1,in_port=4 actions=resubmit(,2) cookie=0x0,<br>
> duration=67.159s, table=0, n_packets=32, n_bytes=5592, idle_age=1,<br>
> priority=1,in_port=2 actions=resubmit(,2) cookie=0x0, duration=68.59s,<br>
> table=0, n_packets=5, n_bytes=390, idle_age=59, priority=0<br>
> actions=drop cookie=0x0, duration=68.495s, table=1, n_packets=0,<br>
> n_bytes=0, idle_age=68,<br>
> priority=1,dl_dst=00:00:00:00:00:00/01:00:00:00:00:00<br>
> actions=resubmit(,20) cookie=0x0, duration=68.391s, table=1,<br>
> n_packets=0, n_bytes=0, idle_age=68,<br>
> priority=1,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00<br>
> actions=resubmit(,21) cookie=0x0, duration=64.686s, table=2,<br>
> n_packets=32, n_bytes=5592, idle_age=1, priority=1,tun_id=0x2<br>
> actions=mod_vlan_vid:1,resubmit(,10)<br>
> cookie=0x0, duration=68.293s, table=2, n_packets=0, n_bytes=0,<br>
> idle_age=68, priority=0 actions=drop cookie=0x0, duration=68.193s,<br>
> table=3, n_packets=0, n_bytes=0, idle_age=68, priority=0 actions=drop<br>
> cookie=0x0, duration=68.082s, table=10, n_packets=32, n_bytes=5592,<br>
> idle_age=1, priority=1<br>
> actions=learn(table=20,hard_timeout=300,priority=1,NXM_OF_VLAN_TCI[0..<br>
> 11],NXM_OF_ETH_DST[]=NXM_OF_ETH_SRC[],load:0->NXM_OF_VLAN_TCI[],load:N<br>
> XM_NX_TUN_ID[]->NXM_NX_TUN_ID[],output:NXM_OF_IN_PORT[]),output:1<br>
> cookie=0x0, duration=56.741s, table=20, n_packets=0, n_bytes=0,<br>
> hard_timeout=300, idle_age=56, hard_age=1,<br>
> priority=1,vlan_tci=0x0001/0x0fff,dl_dst=b2:a9:8f:0a:42:fb<br>
> actions=load:0->NXM_OF_VLAN_TCI[],load:0x2->NXM_NX_TUN_ID[],output:2<br>
> cookie=0x0, duration=22.544s, table=20, n_packets=0, n_bytes=0,<br>
> hard_timeout=300, idle_age=22, hard_age=9,<br>
> priority=1,vlan_tci=0x0001/0x0fff,dl_dst=62:bb:fb:a4:92:db<br>
> actions=load:0->NXM_OF_VLAN_TCI[],load:0x2->NXM_NX_TUN_ID[],output:2<br>
> cookie=0x0, duration=67.982s, table=20, n_packets=0, n_bytes=0,<br>
> idle_age=67, priority=0 actions=resubmit(,21) cookie=0x0,<br>
> duration=64.782s, table=21, n_packets=0, n_bytes=0, idle_age=64,<br>
> dl_vlan=1 actions=strip_vlan,set_tunnel:0x2,output:4,output:3,output:2<br>
> cookie=0x0, duration=67.87s, table=21, n_packets=0, n_bytes=0,<br>
> idle_age=67, priority=0 actions=drop<br>
><br>
> root@ control:~# ovs-ofctl dump-flows br-ex NXST_FLOW reply (xid=0x4):<br>
> cookie=0x0, duration=558.95s, table=0, n_packets=479, n_bytes=102435,<br>
> idle_age=10, priority=0 actions=NORMAL<br>
><br>
> root@neutron:~# ip netns<br>
> qrouter-09800b9c-7f2e-40d7-94e5-09e8f73d0302<br>
> qdhcp-95f5f75f-577f-4827-b51c-f949fb46393b<br>
> root@mussdhux20:~# ip netns exec<br>
> qrouter-09800b9c-7f2e-40d7-94e5-09e8f73d0302 ip a<br>
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default<br>
> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00<br>
> inet <a href="http://127.0.0.1/8" target="_blank">127.0.0.1/8</a> scope host lo<br>
> valid_lft forever preferred_lft forever<br>
> inet6 ::1/128 scope host<br>
> valid_lft forever preferred_lft forever<br>
> 14: qr-784a2f1c-e6: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default<br>
> link/ether fa:16:3e:d2:db:51 brd ff:ff:ff:ff:ff:ff<br>
> inet <a href="http://192.168.2.1/24" target="_blank">192.168.2.1/24</a> brd 192.168.2.255 scope global qr-784a2f1c-e6<br>
> valid_lft forever preferred_lft forever<br>
> inet6 fe80::f816:3eff:fed2:db51/64 scope link<br>
> valid_lft forever preferred_lft forever<br>
> 15: qg-6849da02-da: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default<br>
> link/ether fa:16:3e:15:c8:76 brd ff:ff:ff:ff:ff:ff<br>
> inet <a href="http://172.29.105.101/24" target="_blank">172.29.105.101/24</a> brd 172.29.105.255 scope global qg-6849da02-da<br>
> valid_lft forever preferred_lft forever<br>
> inet <a href="http://172.29.105.102/32" target="_blank">172.29.105.102/32</a> brd 172.29.105.102 scope global qg-6849da02-da<br>
> valid_lft forever preferred_lft forever<br>
> inet6 fe80::f816:3eff:fe15:c876/64 scope link<br>
> valid_lft forever preferred_lft forever<br>
><br>
> /// I can ping from router to external router gateway root@ neutron:~#<br>
> ip netns exec qrouter-09800b9c-7f2e-40d7-94e5-09e8f73d0302 ping -I qg-6849da02-da 172.29.105.101<br>
> PING 172.29.105.101 (172.29.105.101) from 172.29.105.101 qg-6849da02-da: 56(84) bytes of data.<br>
> 64 bytes from <a href="http://172.29.105.101" target="_blank">172.29.105.101</a>: icmp_seq=1 ttl=64 time=0.067 ms<br>
> 64 bytes from <a href="http://172.29.105.101" target="_blank">172.29.105.101</a>: icmp_seq=2 ttl=64 time=0.048 ms<br>
> 64 bytes from <a href="http://172.29.105.101" target="_blank">172.29.105.101</a>: icmp_seq=3 ttl=64 time=0.062 ms<br>
> 64 bytes from <a href="http://172.29.105.101" target="_blank">172.29.105.101</a>: icmp_seq=4 ttl=64 time=0.051 ms<br>
> 64 bytes from <a href="http://172.29.105.101" target="_blank">172.29.105.101</a>: icmp_seq=5 ttl=64 time=0.061 ms<br>
> 64 bytes from <a href="http://172.29.105.101" target="_blank">172.29.105.101</a>: icmp_seq=6 ttl=64 time=0.050 ms ^C<br>
> --- 172.29.105.101 ping statistics ---<br>
> 6 packets transmitted, 6 received, 0% packet loss, time 4998ms rtt<br>
> min/avg/max/mdev = 0.048/0.056/0.067/0.010 ms<br>
><br>
> /// I can ping from router to internal tenant gateway<br>
> root@mussdhux20:~# ip netns exec qrouter-09800b9c-7f2e-40d7-94e5-09e8f73d0302 ping -I qr-784a2f1c-e6 192.168.2.1<br>
> PING 192.168.2.1 (192.168.2.1) from 192.168.2.1 qr-784a2f1c-e6: 56(84) bytes of data.<br>
> 64 bytes from <a href="http://192.168.2.1" target="_blank">192.168.2.1</a>: icmp_seq=1 ttl=64 time=0.045 ms<br>
> 64 bytes from <a href="http://192.168.2.1" target="_blank">192.168.2.1</a>: icmp_seq=2 ttl=64 time=0.047 ms<br>
> 64 bytes from <a href="http://192.168.2.1" target="_blank">192.168.2.1</a>: icmp_seq=3 ttl=64 time=0.064 ms<br>
> 64 bytes from <a href="http://192.168.2.1" target="_blank">192.168.2.1</a>: icmp_seq=4 ttl=64 time=0.049 ms<br>
> 64 bytes from <a href="http://192.168.2.1" target="_blank">192.168.2.1</a>: icmp_seq=5 ttl=64 time=0.056 ms<br>
> 64 bytes from <a href="http://192.168.2.1" target="_blank">192.168.2.1</a>: icmp_seq=6 ttl=64 time=0.044 ms ^C<br>
> --- 192.168.2.1 ping statistics ---<br>
> 6 packets transmitted, 6 received, 0% packet loss, time 4998ms rtt<br>
> min/avg/max/mdev = 0.044/0.050/0.064/0.011 ms<br>
><br>
> root@ neutron:~# ip a<br>
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default<br>
> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00<br>
> inet <a href="http://127.0.0.1/8" target="_blank">127.0.0.1/8</a> scope host lo<br>
> valid_lft forever preferred_lft forever<br>
> inet6 ::1/128 scope host<br>
> valid_lft forever preferred_lft forever<br>
> 2: eth2: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master ovs-system state UP group default qlen 1000<br>
> link/ether 00:d0:b7:9d:be:de brd ff:ff:ff:ff:ff:ff<br>
> inet6 fe80::2d0:b7ff:fe9d:bede/64 scope link<br>
> valid_lft forever preferred_lft forever<br>
> 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000<br>
> link/ether 00:02:b3:ea:fd:36 brd ff:ff:ff:ff:ff:ff<br>
> inet <a href="http://192.168.1.220/24" target="_blank">192.168.1.220/24</a> brd 192.168.1.255 scope global eth1<br>
> valid_lft forever preferred_lft forever<br>
> inet6 fe80::202:b3ff:feea:fd36/64 scope link<br>
> valid_lft forever preferred_lft forever<br>
> 4: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000<br>
> link/ether 00:0f:fe:5e:2b:52 brd ff:ff:ff:ff:ff:ff<br>
> inet <a href="http://172.29.106.220/24" target="_blank">172.29.106.220/24</a> brd 172.29.106.255 scope global eth0<br>
> valid_lft forever preferred_lft forever<br>
> inet6 fe80::20f:feff:fe5e:2b52/64 scope link<br>
> valid_lft forever preferred_lft forever<br>
> 5: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default<br>
> link/ether 42:ad:09:62:3e:ff brd ff:ff:ff:ff:ff:ff<br>
> 6: br-ex: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default<br>
> link/ether 00:d0:b7:9d:be:de brd ff:ff:ff:ff:ff:ff<br>
> inet6 fe80::4460:3dff:fe54:774a/64 scope link<br>
> valid_lft forever preferred_lft forever<br>
> 9: br-int: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default<br>
> link/ether 0e:51:a9:81:c8:4b brd ff:ff:ff:ff:ff:ff<br>
> inet6 fe80::50b6:6dff:fe2b:497f/64 scope link<br>
> valid_lft forever preferred_lft forever<br>
> 17: br-tun: <BROADCAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default<br>
> link/ether 96:20:ae:89:c4:49 brd ff:ff:ff:ff:ff:ff<br>
> inet6 fe80::14bd:19ff:fe80:55f7/64 scope link<br>
> valid_lft forever preferred_lft forever<br>
><br>
> root@ neutron:~# ip route<br>
> default via 172.29.106.254 dev eth0<br>
> <a href="http://169.254.0.0/16" target="_blank">169.254.0.0/16</a> dev eth1 scope link metric 1000<br>
> <a href="http://172.29.106.0/24" target="_blank">172.29.106.0/24</a> dev eth0 proto kernel scope link src 172.29.106.220<br>
> <a href="http://192.168.1.0/24" target="_blank">192.168.1.0/24</a> dev eth1 proto kernel scope link src 192.168.1.220<br>
><br>
> > > root@control# neutron net-list<br>
> +--------------------------------------+----------+------------------------------------------------------+<br>
> | id | name | subnets |<br>
> +--------------------------------------+----------+------------------------------------------------------+<br>
> | 95f5f75f-577f-4827-b51c-f949fb46393b | demo-net |<br>
> | 33d60404-d979-4b63-83ef-653268195872 <a href="http://192.168.2.0/24" target="_blank">
192.168.2.0/24</a> |<br>
> | e567fd9d-f87a-491c-b8f1-32d28de4069e | ext-net |<br>
> | 0f5d2be9-74b0-466e-b0e6-4be8f646338a <a href="http://172.29.105.0/24" target="_blank">
172.29.105.0/24</a> |<br>
> +--------------------------------------+----------+------------------------------------------------------+<br>
> root control # neutron subnet-list<br>
> +--------------------------------------+-------------+-----------------+------------------------------------------------------+<br>
> | id | name | cidr | allocation_pools |<br>
> +--------------------------------------+-------------+-----------------+------------------------------------------------------+<br>
> | 0f5d2be9-74b0-466e-b0e6-4be8f646338a | ext-subnet | <a href="http://172.29.105.0/24" target="_blank">
172.29.105.0/24</a> | {"start": "172.29.105.101", "end": "172.29.105.127"} |<br>
> | 33d60404-d979-4b63-83ef-653268195872 | demo-subnet | <a href="http://192.168.2.0/24" target="_blank">
192.168.2.0/24</a> | {"start": "192.168.2.2", "end": "192.168.2.254"} |<br>
> +--------------------------------------+-------------+-----------------+------------------------------------------------------+<br>
> > ><br>
> > > root@ control# neutron subnet-show ext-subnet<br>
> +------------------+------------------------------------------------------+<br>
> | Field | Value |<br>
> +------------------+------------------------------------------------------+<br>
> | allocation_pools | {"start": "172.29.105.101", "end": "172.29.105.127"} |<br>
> | cidr | <a href="http://172.29.105.0/24" target="_blank">172.29.105.0/24</a> |<br>
> | dns_nameservers | |<br>
> | enable_dhcp | False |<br>
> | gateway_ip | 172.29.105.254 |<br>
> | host_routes | |<br>
> | id | 0f5d2be9-74b0-466e-b0e6-4be8f646338a |<br>
> | ip_version | 4 |<br>
> | name | ext-subnet |<br>
> | network_id | e567fd9d-f87a-491c-b8f1-32d28de4069e |<br>
> | tenant_id | 7479d4eabeb14b45a7f38269155ec0f5 |<br>
> +------------------+------------------------------------------------------+<br>
> > > root@ control# neutron subnet-show demo-subnet<br>
> +------------------+--------------------------------------------------+<br>
> | Field | Value |<br>
> +------------------+--------------------------------------------------+<br>
> | allocation_pools | {"start": "192.168.2.2", "end": "192.168.2.254"} |<br>
> | cidr | <a href="http://192.168.2.0/24" target="_blank">192.168.2.0/24</a> |<br>
> | dns_nameservers | 8.8.8.8 |<br>
> | enable_dhcp | True |<br>
> | gateway_ip | 192.168.2.1 |<br>
> | host_routes | |<br>
> | id | 33d60404-d979-4b63-83ef-653268195872 |<br>
> | ip_version | 4 |<br>
> | name | demo-subnet |<br>
> | network_id | 95f5f75f-577f-4827-b51c-f949fb46393b |<br>
> | tenant_id | 1bc3de8b19384858a1a7a6395e1845e3 |<br>
> +------------------+--------------------------------------------------+<br>
> ************* Email Confidentiality Notice ******************** The<br>
> information contained in this e-mail message (including any<br>
> attachments) may be confidential, proprietary, privileged, or<br>
> otherwise exempt from disclosure under applicable laws. It is intended<br>
> to be conveyed only to the designated recipient(s). Any use,<br>
> dissemination, distribution, printing, retaining or copying of this<br>
> e-mail (including its<br>
> attachments) by unintended recipient(s) is strictly prohibited and may<br>
> be unlawful. If you are not an intended recipient of this e-mail, or<br>
> believe that you have received this e-mail in error, please notify the<br>
> sender immediately (by replying to this e-mail), delete any and all<br>
> copies of this e-mail (including any attachments) from your system,<br>
> and do not disclose the content of this e-mail to any other person. Thank you!<br>
><br>
> _______________________________________________<br>
> Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
> Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
> Unsubscribe :<br>
> <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br>
<br>
************* Email Confidentiality Notice ********************<br>
The information contained in this e-mail message (including any<br>
attachments) may be confidential, proprietary, privileged, or otherwise<br>
exempt from disclosure under applicable laws. It is intended to be<br>
conveyed only to the designated recipient(s). Any use, dissemination,<br>
distribution, printing, retaining or copying of this e-mail (including its<br>
attachments) by unintended recipient(s) is strictly prohibited and may<br>
be unlawful. If you are not an intended recipient of this e-mail, or believe<br>
that you have received this e-mail in error, please notify the sender<br>
immediately (by replying to this e-mail), delete any and all copies of<br>
this e-mail (including any attachments) from your system, and do not<br>
disclose the content of this e-mail to any other person. Thank you!<br>
_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><o:p></o:p></span></p>
</div>
</div>
</div>
<p class="MsoNormal"><span style="color:#212121"><br>
<br clear="all">
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="color:#212121"> <o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="color:#212121">-- <o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span style="color:#212121">Kevin Benton<o:p></o:p></span></p>
</div>
</div>
</div>
</div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<pre>************* Email Confidentiality Notice ********************<o:p></o:p></pre>
<pre>The information contained in this e-mail message (including any <o:p></o:p></pre>
<pre>attachments) may be confidential, proprietary, privileged, or otherwise<o:p></o:p></pre>
<pre>exempt from disclosure under applicable laws. It is intended to be <o:p></o:p></pre>
<pre>conveyed only to the designated recipient(s). Any use, dissemination, <o:p></o:p></pre>
<pre>distribution, printing, retaining or copying of this e-mail (including its <o:p></o:p></pre>
<pre>attachments) by unintended recipient(s) is strictly prohibited and may <o:p></o:p></pre>
<pre>be unlawful. If you are not an intended recipient of this e-mail, or believe <o:p></o:p></pre>
<pre>that you have received this e-mail in error, please notify the sender <o:p></o:p></pre>
<pre>immediately (by replying to this e-mail), delete any and all copies of <o:p></o:p></pre>
<pre>this e-mail (including any attachments) from your system, and do not<o:p></o:p></pre>
<pre>disclose the content of this e-mail to any other person. Thank you!<o:p></o:p></pre>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</body>
</html>
<table><tr><td><!--type:text--><!--{--><pre>************* Email Confidentiality Notice ********************
The information contained in this e-mail message (including any
attachments) may be confidential, proprietary, privileged, or otherwise
exempt from disclosure under applicable laws. It is intended to be
conveyed only to the designated recipient(s). Any use, dissemination,
distribution, printing, retaining or copying of this e-mail (including its
attachments) by unintended recipient(s) is strictly prohibited and may
be unlawful. If you are not an intended recipient of this e-mail, or believe
that you have received this e-mail in error, please notify the sender
immediately (by replying to this e-mail), delete any and all copies of
this e-mail (including any attachments) from your system, and do not
disclose the content of this e-mail to any other person. Thank you!
</pre><!--}--></td></tr></table>