Hi Syd, <div><br></div><div>Oops I didn't see you had q-dhcp set. You should disable this unless you are trying to use quantum with the v2 api (I.E: NOVA_USE_QUANTUM_API=v2).<br><br>My guess would be that something is wrong with the tunnels which is why DHCP isn't working. Can you confirm that ovs_quantum_agent is running on all your nodes?<br>
<br>Thanks, <br><br>Aaron<br></div><div><br><br><div class="gmail_quote">On Mon, Aug 6, 2012 at 5:28 PM, Syd (Sydney) Logan <span dir="ltr"><<a href="mailto:slogan@broadcom.com" target="_blank">slogan@broadcom.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div link="blue" vlink="purple" lang="EN-US">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Aaron,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">+1 for the quick response! Below I’ve pasted in the *plugin.ini files.
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">+1 also for the link to the v2 api page – I’ll take a look (while you respond to this e-mail
</span><span style="font-size:11.0pt;font-family:Wingdings;color:#1f497d">J</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">If in fact the bridge interface is not the issue (thanks for clarifying), I guess the question is what generally would keep a VM from being able to acquire
an IP address via DHCP? I’ve read posts that clarify that q_dhcp is not used for this purpose, so we don’t have to go down that path. Looks like the VM is unable to get out on the proper net to do its DHCP (which looks to be achieved via google’s public DHCP
server (see <a href="https://developers.google.com/speed/public-dns/docs/using%29" target="_blank">
https://developers.google.com/speed/public-dns/docs/using)</a>). Guessed (wrongly it appears) that the gw bridge was created to provide that ability.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">syd<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">The ovs_quantum_plugin.ini from the controller:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf00bf">[DATABASE]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># This line MUST be changed to actually run the plugin.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Example:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># sql_connection = mysql://<a href="http://root:nova@127.0.0.1:3306/ovs_quantum" target="_blank">root:nova@127.0.0.1:3306/ovs_quantum</a><u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Replace 127.0.0.1 above with the IP address of the database used by the<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># main quantum server. (Leave it as is if the database runs on this host.)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">sql_connection =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> mysql://root:password@localhost/ovs_quantum?charset=utf8<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Database reconnection retry times - in event connectivity is lost<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># set to -1 implies an infinite retry count<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># sql_max_retries = 10<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Database reconnection interval in seconds - in event connectivity is lost<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">reconnect_interval =</span><span style="font-size:9.0pt;font-family:"Lucida Console"">
<span style="color:#bf0000">2<u></u><u></u></span></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf0000"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf00bf">[OVS]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># This enables the new OVSQuantumTunnelAgent which enables tunneling<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># between hybervisors. Leave it set to False or omit for legacy behavior.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">enable_tunneling =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> True<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console""><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Do not change this parameter unless you have a good reason to.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># This is the name of the OVS integration bridge. There is one per hypervisor.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># The integration bridge acts as a virtual "patch port". All VM VIFs are<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># attached to this bridge and then "patched" according to their network<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># connectivity.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">integration_bridge =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> br-int<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console""><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Only used if enable-tunneling (above) is True.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># In most cases, the default value should be fine.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">tunnel_bridge =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> br-tun<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console""><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Uncomment this line if enable-tunneling is True above.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Set local-ip to be the local IP address of this hypervisor.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">local_ip =</span><span style="font-size:9.0pt;font-family:"Lucida Console"">
<span style="color:#bf0000">192.168</span>.<span style="color:#bf0000">3.1<u></u><u></u></span></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf0000"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Uncomment if you want to use custom VLAN range.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># vlan_min = 1<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># vlan_max = 4094<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf00bf">[AGENT]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Agent's polling interval in seconds<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">polling_interval =</span><span style="font-size:9.0pt;font-family:"Lucida Console"">
<span style="color:#bf0000">2<u></u><u></u></span></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Change to "sudo quantum-rootwrap" to limit commands that can be run<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># as root.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">root_helper =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> sudo<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Use Quantumv2 API<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">target_v2_api =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> False<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console""><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf">#-----------------------------------------------------------------------------<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Sample Configurations.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf">#-----------------------------------------------------------------------------<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf">#<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># 1. Without tunneling.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [DATABASE]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># sql_connection = mysql://<a href="http://root:nova@127.0.0.1:3306/ovs_quantum" target="_blank">root:nova@127.0.0.1:3306/ovs_quantum</a><u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [OVS]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">enable_tunneling =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> True<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># integration_bridge = br-int<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [AGENT]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># root_helper = sudo<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Add the following setting, if you want to log to a file<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># log_file = /var/log/quantum/ovs_quantum_agent.log<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Use Quantumv2 API<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># target_v2_api = False<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf">#<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># 2. With tunneling.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [DATABASE]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># sql_connection = mysql://<a href="http://root:nova@127.0.0.1:3306/ovs_quantum" target="_blank">root:nova@127.0.0.1:3306/ovs_quantum</a><u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [OVS]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">enable_tunneling =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> True<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># integration_bridge = br-int<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># tunnel_bridge = br-tun<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># remote-ip-file = /opt/stack/remote-ips.txt<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">local_ip =</span><span style="font-size:9.0pt;font-family:"Lucida Console"">
<span style="color:#bf0000">192.168</span>.<span style="color:#bf0000">3.1<u></u><u></u></span></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [AGENT]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># root_helper = sudo<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">And from the compute node:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf00bf;background:teal">[</span><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf00bf">DATABASE<span style="background:teal">]<u></u><u></u></span></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># This line MUST be changed to actually run the plugin.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Example:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># sql_connection = mysql://<a href="http://root:nova@127.0.0.1:3306/ovs_quantum" target="_blank">root:nova@127.0.0.1:3306/ovs_quantum</a><u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Replace 127.0.0.1 above with the IP address of the database used by the<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># main quantum server. (Leave it as is if the database runs on this host.)<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">sql_connection =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> mysql://root:password@<span style="color:#bf0000">192.168</span>.<span style="color:#bf0000">3.1</span>/ovs_quantum?charset=utf8<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Database reconnection retry times - in event connectivity is lost<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># set to -1 implies an infinite retry count<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># sql_max_retries = 10<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Database reconnection interval in seconds - in event connectivity is lost<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">reconnect_interval =</span><span style="font-size:9.0pt;font-family:"Lucida Console"">
<span style="color:#bf0000">2<u></u><u></u></span></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf0000"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf00bf">[OVS]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># This enables the new OVSQuantumTunnelAgent which enables tunneling<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># between hybervisors. Leave it set to False or omit for legacy behavior.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">enable_tunneling =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> True<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console""><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Do not change this parameter unless you have a good reason to.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># This is the name of the OVS integration bridge. There is one per hypervisor.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># The integration bridge acts as a virtual "patch port". All VM VIFs are<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># attached to this bridge and then "patched" according to their network<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># connectivity.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">integration_bridge =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> br-int<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console""><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Only used if enable-tunneling (above) is True.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># In most cases, the default value should be fine.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">tunnel_bridge =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> br-tun<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console""><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Uncomment this line if enable-tunneling is True above.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Set local-ip to be the local IP address of this hypervisor.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">local_ip =</span><span style="font-size:9.0pt;font-family:"Lucida Console"">
<span style="color:#bf0000">192.168</span>.<span style="color:#bf0000">3.2<u></u><u></u></span></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf0000"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Uncomment if you want to use custom VLAN range.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># vlan_min = 1<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># vlan_max = 4094<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#bf00bf">[AGENT]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Agent's polling interval in seconds<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">polling_interval =</span><span style="font-size:9.0pt;font-family:"Lucida Console"">
<span style="color:#bf0000">2<u></u><u></u></span></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Change to "sudo quantum-rootwrap" to limit commands that can be run<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># as root.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">root_helper =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> sudo<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Use Quantumv2 API<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">target_v2_api =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> False<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console""><u></u> <u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf">#-----------------------------------------------------------------------------<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Sample Configurations.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf">#-----------------------------------------------------------------------------<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf">#<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># 1. Without tunneling.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [DATABASE]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># sql_connection = mysql://<a href="http://root:nova@127.0.0.1:3306/ovs_quantum" target="_blank">root:nova@127.0.0.1:3306/ovs_quantum</a><u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [OVS]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">enable_tunneling =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> True<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># integration_bridge = br-int<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [AGENT]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># root_helper = sudo<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Add the following setting, if you want to log to a file<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># log_file = /var/log/quantum/ovs_quantum_agent.log<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># Use Quantumv2 API<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># target_v2_api = False<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf">#<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># 2. With tunneling.<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [DATABASE]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># sql_connection = mysql://<a href="http://root:nova@127.0.0.1:3306/ovs_quantum" target="_blank">root:nova@127.0.0.1:3306/ovs_quantum</a><u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [OVS]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">enable_tunneling =</span><span style="font-size:9.0pt;font-family:"Lucida Console""> True<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># integration_bridge = br-int<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># tunnel_bridge = br-tun<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># remote-ip-file = /opt/stack/remote-ips.txt<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#00bf00">local_ip =</span><span style="font-size:9.0pt;font-family:"Lucida Console"">
<span style="color:#bf0000">192.168</span>.<span style="color:#bf0000">3.2<u></u><u></u></span></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># [AGENT]<u></u><u></u></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:9.0pt;font-family:"Lucida Console";color:#0000bf"># root_helper = sudo<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Aaron Rosen [mailto:<a href="mailto:arosen@nicira.com" target="_blank">arosen@nicira.com</a>]
<br>
<b>Sent:</b> Monday, August 06, 2012 5:13 PM<br>
<b>To:</b> Syd (Sydney) Logan<br>
<b>Cc:</b> <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
<b>Subject:</b> Re: [Openstack] Configuring with devstack for multiple hardware nodes<u></u><u></u></span></p><div><div>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Hi Syd, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">There should not be an additional gateway interface on the compute nodes, only the node that has n-net in ENABLED_SERVICES. I'm assuming you want to use the OVSQuantumPlugin? Can you also attach /etc/quantum/plugins/openvswitch/ovs_quantum_plugin.ini
from your two nodes? Also if you are interested in trying out the folsom quantum code the following link should help you get running: <a href="http://wiki.openstack.org/RunningQuantumV2Api" target="_blank">http://wiki.openstack.org/RunningQuantumV2Api</a><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Aaron<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Mon, Aug 6, 2012 at 4:30 PM, Syd (Sydney) Logan <<a href="mailto:slogan@broadcom.com" target="_blank">slogan@broadcom.com</a>> wrote:<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">Hi,<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">I just posted the following at
<a href="http://forums.openstack.org/viewtopic.php?f=15&t=1435" target="_blank">http://forums.openstack.org/viewtopic.php?f=15&t=1435</a>, then realized this mailing list might be a better place to ask the question.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">In summary, I’ve cobbled together devstack-based nodes to exercise quantum/openvswitch (when I say cobbled, I mean my result is the combination of information from wiki and from
devstack, and elsewhere to create my localrc files, since there is no one definitive template that I could use, and it seems that devstack examples are not current with what is happening on Folsom). One node is a controller, one is a compute node. I can launch
using horizon on the controller, VMs launched on the controller are pingable, but ones launched on the compute node are not. The big difference I can see is a missing gateway interface on the controller (on gw-* displayed when I run ifconfig). By inspection
of the logs, I can see that the VMs are unable to establish a network, and I think the missing gateway interface may be the root cause for that.
<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Below are details:<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Two hosts, one configured as a controller, the other configured as a compute node.<u></u><u></u></p>
<p class="MsoNormal">Each host is dual homed, network for eth0 is connected to the local intranet, network for eth1 is configured as a local net 192.168.3.0<u></u><u></u></p>
<p class="MsoNormal">On the controller host, I used devstack with the following localrc (which is an aggregation of stuff I found on the devstack site, and stuff I found recently on the quantum wiki
-- it would be nice if complete templates for a controller and compute node supporting devstack and openvswitch were published on the devstack site or the wiki, perhaps since we are not yet at Folsom it makes sense they don't exist, if I get something working,
I will share my configuration in the entirety at whatever is the most appropriate place). Anyway, controller host localrc is:<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">HOST_IP=192.168.3.1<u></u><u></u></p>
<p class="MsoNormal">FLAT_INTERFACE=eth1<u></u><u></u></p>
<p class="MsoNormal">FIXED_RANGE=<a href="http://10.4.128.0/20" target="_blank">10.4.128.0/20</a><u></u><u></u></p>
<p class="MsoNormal">FIXED_NETWORK_SIZE=4096<u></u><u></u></p>
<p class="MsoNormal">FLOATING_RANGE=<a href="http://192.168.3.128/25" target="_blank">192.168.3.128/25</a><u></u><u></u></p>
<p class="MsoNormal">MULTI_HOST=True<u></u><u></u></p>
<p class="MsoNormal">LOGFILE=/opt/stack/logs/stack.sh.log<u></u><u></u></p>
<p class="MsoNormal">ADMIN_PASSWORD=password<u></u><u></u></p>
<p class="MsoNormal">MYSQL_PASSWORD=password<u></u><u></u></p>
<p class="MsoNormal">RABBIT_PASSWORD=password<u></u><u></u></p>
<p class="MsoNormal">SERVICE_PASSWORD=password<u></u><u></u></p>
<p class="MsoNormal">SERVICE_TOKEN=xyzpdqlazydog<u></u><u></u></p>
<p class="MsoNormal">ENABLED_SERVICES=g-api,g-reg,key,n-api,n-cpu,n-net,n-sch,n-vnc,horizon,mysql,rabbit,openstackx,q-svc,quantum,q-agt,q-dhcp<u></u><u></u></p>
<p class="MsoNormal">Q_PLUGIN=openvswitch<u></u><u></u></p>
<p class="MsoNormal">Q_AUTH_STRATEGY=noauth<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">If I run stack on this host, I get the following nova.conf:<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">[DEFAULT]<u></u><u></u></p>
<p class="MsoNormal">verbose=True<u></u><u></u></p>
<p class="MsoNormal">auth_strategy=keystone<u></u><u></u></p>
<p class="MsoNormal">allow_resize_to_same_host=True<u></u><u></u></p>
<p class="MsoNormal">root_helper=sudo /usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf<u></u><u></u></p>
<p class="MsoNormal">compute_scheduler_driver=nova.scheduler.filter_scheduler.FilterScheduler<u></u><u></u></p>
<p class="MsoNormal">dhcpbridge_flagfile=/etc/nova/nova.conf<u></u><u></u></p>
<p class="MsoNormal">fixed_range=<a href="http://10.4.128.0/20" target="_blank">10.4.128.0/20</a><u></u><u></u></p>
<p class="MsoNormal">s3_host=192.168.3.1<u></u><u></u></p>
<p class="MsoNormal">s3_port=3333<u></u><u></u></p>
<p class="MsoNormal">network_manager=nova.network.quantum.manager.QuantumManager<u></u><u></u></p>
<p class="MsoNormal">quantum_connection_host=localhost<u></u><u></u></p>
<p class="MsoNormal">quantum_connection_port=9696<u></u><u></u></p>
<p class="MsoNormal">quantum_use_dhcp=True<u></u><u></u></p>
<p class="MsoNormal">libvirt_vif_type=ethernet<u></u><u></u></p>
<p class="MsoNormal">libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtOpenVswitchDriver<u></u><u></u></p>
<p class="MsoNormal">linuxnet_interface_driver=nova.network.linux_net.LinuxOVSInterfaceDriver<u></u><u></u></p>
<p class="MsoNormal">osapi_compute_extension=nova.api.openstack.compute.contrib.standard_extensions<u></u><u></u></p>
<p class="MsoNormal">my_ip=192.168.3.1<u></u><u></u></p>
<p class="MsoNormal">public_interface=br100<u></u><u></u></p>
<p class="MsoNormal">vlan_interface=eth0<u></u><u></u></p>
<p class="MsoNormal">flat_network_bridge=br100<u></u><u></u></p>
<p class="MsoNormal">flat_interface=eth1<u></u><u></u></p>
<p class="MsoNormal">sql_connection=mysql://root:password@localhost/nova?charset=utf8<u></u><u></u></p>
<p class="MsoNormal">libvirt_type=kvm<u></u><u></u></p>
<p class="MsoNormal">libvirt_cpu_mode=none<u></u><u></u></p>
<p class="MsoNormal">instance_name_template=instance-%08x<u></u><u></u></p>
<p class="MsoNormal">novncproxy_base_url=<a href="http://192.168.3.1:6080/vnc_auto.html" target="_blank">http://192.168.3.1:6080/vnc_auto.html</a><u></u><u></u></p>
<p class="MsoNormal">xvpvncproxy_base_url=<a href="http://192.168.3.1:6081/console" target="_blank">http://192.168.3.1:6081/console</a><u></u><u></u></p>
<p class="MsoNormal">vncserver_listen=127.0.0.1<u></u><u></u></p>
<p class="MsoNormal">vncserver_proxyclient_address=127.0.0.1<u></u><u></u></p>
<p class="MsoNormal">api_paste_config=/etc/nova/api-paste.ini<u></u><u></u></p>
<p class="MsoNormal">image_service=nova.image.glance.GlanceImageService<u></u><u></u></p>
<p class="MsoNormal">ec2_dmz_host=192.168.3.1<u></u><u></u></p>
<p class="MsoNormal">rabbit_host=localhost<u></u><u></u></p>
<p class="MsoNormal">rabbit_password=password<u></u><u></u></p>
<p class="MsoNormal">glance_api_servers=<a href="http://192.168.3.1:9292" target="_blank">192.168.3.1:9292</a><u></u><u></u></p>
<p class="MsoNormal">force_dhcp_release=True<u></u><u></u></p>
<p class="MsoNormal">multi_host=True<u></u><u></u></p>
<p class="MsoNormal">send_arp_for_ha=True<u></u><u></u></p>
<p class="MsoNormal">logging_context_format_string=%(asctime)s %(color)s%(levelname)s %(name)s [^[[01;36m%(request_id)s ^[[00;36m%(user_name)s %(project_name)s%(color)s] ^[[01;35m%(instance)s%(color)s%(message)s^[[00m<u></u><u></u></p>
<p class="MsoNormal">logging_default_format_string=%(asctime)s %(color)s%(levelname)s %(name)s [^[[00;36m-%(color)s] ^[[01;35m%(instance)s%(color)s%(message)s^[[00m<u></u><u></u></p>
<p class="MsoNormal">logging_debug_format_suffix=^[[00;33mfrom (pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d^[[00m<u></u><u></u></p>
<p class="MsoNormal">logging_exception_prefix=%(color)s%(asctime)s TRACE %(name)s ^[[01;35m%(instance)s^[[00m<u></u><u></u></p>
<p class="MsoNormal">compute_driver=libvirt.LibvirtDriver<u></u><u></u></p>
<p class="MsoNormal">firewall_driver=nova.virt.libvirt.firewall.IptablesFirewallDriver<u></u><u></u></p>
<p class="MsoNormal">enabled_apis=ec2,osapi_compute,osapi_volume,metadata<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">If I run horizon, I can launch vms and ping them. If I look at the logs generated by the VMs, they are able to get a network. Furthermore, I get the following network interface
in addition to the tap interfaces generated for each VM:<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">gw-4f16e8db-20 Link encap:Ethernet HWaddr fa:16:3e:08:e0:2d<u></u><u></u></p>
<p class="MsoNormal">inet addr:10.4.128.1 Bcast:10.4.143.255 Mask:255.255.240.0<u></u><u></u></p>
<p class="MsoNormal">inet6 addr: fe80::f816:3eff:fe08:e02d/64 Scope:Link<u></u><u></u></p>
<p class="MsoNormal">UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1<u></u><u></u></p>
<p class="MsoNormal">RX packets:0 errors:0 dropped:0 overruns:0 frame:0<u></u><u></u></p>
<p class="MsoNormal">TX packets:6 errors:0 dropped:0 overruns:0 carrier:0<u></u><u></u></p>
<p class="MsoNormal">collisions:0 txqueuelen:0<u></u><u></u></p>
<p class="MsoNormal">RX bytes:0 (0.0 B) TX bytes:468 (468.0 B)<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Now, for the compute node, I use the following:<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">HOST_IP=192.168.3.2<u></u><u></u></p>
<p class="MsoNormal">FLAT_INTERFACE=eth1<u></u><u></u></p>
<p class="MsoNormal">FIXED_RANGE=<a href="http://10.4.128.0/20" target="_blank">10.4.128.0/20</a><u></u><u></u></p>
<p class="MsoNormal">FIXED_NETWORK_SIZE=4096<u></u><u></u></p>
<p class="MsoNormal">FLOATING_RANGE=<a href="http://192.168.3.128/25" target="_blank">192.168.3.128/25</a><u></u><u></u></p>
<p class="MsoNormal">MULTI_HOST=1<u></u><u></u></p>
<p class="MsoNormal">LOGFILE=/opt/stack/logs/stack.sh.log<u></u><u></u></p>
<p class="MsoNormal">ADMIN_PASSWORD=password<u></u><u></u></p>
<p class="MsoNormal">MYSQL_PASSWORD=password<u></u><u></u></p>
<p class="MsoNormal">RABBIT_PASSWORD=password<u></u><u></u></p>
<p class="MsoNormal">SERVICE_PASSWORD=password<u></u><u></u></p>
<p class="MsoNormal">SERVICE_TOKEN=xyzpdqlazydog<u></u><u></u></p>
<p class="MsoNormal">Q_HOST=192.168.3.1<u></u><u></u></p>
<p class="MsoNormal">MYSQL_HOST=192.168.3.1<u></u><u></u></p>
<p class="MsoNormal">RABBIT_HOST=192.168.3.1<u></u><u></u></p>
<p class="MsoNormal">GLANCE_HOSTPORT=<a href="http://192.168.3.1:9292" target="_blank">192.168.3.1:9292</a><u></u><u></u></p>
<p class="MsoNormal">ENABLED_SERVICES=n-cpu,rabbit,g-api,n-net,quantum,q-agt<u></u><u></u></p>
<p class="MsoNormal">Q_PLUGIN=openvswitch<u></u><u></u></p>
<p class="MsoNormal">Q_AUTH_STRATEGY=noauth<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">The resulting nova.conf is:<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">[DEFAULT]<u></u><u></u></p>
<p class="MsoNormal">verbose=True<u></u><u></u></p>
<p class="MsoNormal">auth_strategy=keystone<u></u><u></u></p>
<p class="MsoNormal">allow_resize_to_same_host=True<u></u><u></u></p>
<p class="MsoNormal">root_helper=sudo /usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf<u></u><u></u></p>
<p class="MsoNormal">compute_scheduler_driver=nova.scheduler.filter_scheduler.FilterScheduler<u></u><u></u></p>
<p class="MsoNormal">dhcpbridge_flagfile=/etc/nova/nova.conf<u></u><u></u></p>
<p class="MsoNormal">fixed_range=<a href="http://10.4.128.0/20" target="_blank">10.4.128.0/20</a><u></u><u></u></p>
<p class="MsoNormal">s3_host=192.168.3.2<u></u><u></u></p>
<p class="MsoNormal">s3_port=3333<u></u><u></u></p>
<p class="MsoNormal">network_manager=nova.network.quantum.manager.QuantumManager<u></u><u></u></p>
<p class="MsoNormal">quantum_connection_host=192.168.3.1<u></u><u></u></p>
<p class="MsoNormal">quantum_connection_port=9696<u></u><u></u></p>
<p class="MsoNormal">quantum_use_dhcp=True<u></u><u></u></p>
<p class="MsoNormal">libvirt_vif_type=ethernet<u></u><u></u></p>
<p class="MsoNormal">libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtOpenVswitchDriver<u></u><u></u></p>
<p class="MsoNormal">linuxnet_interface_driver=nova.network.linux_net.LinuxOVSInterfaceDriver<u></u><u></u></p>
<p class="MsoNormal">osapi_compute_extension=nova.api.openstack.compute.contrib.standard_extensions<u></u><u></u></p>
<p class="MsoNormal">my_ip=192.168.3.2<u></u><u></u></p>
<p class="MsoNormal">public_interface=br100<u></u><u></u></p>
<p class="MsoNormal">vlan_interface=eth0<u></u><u></u></p>
<p class="MsoNormal">flat_network_bridge=br100<u></u><u></u></p>
<p class="MsoNormal">flat_interface=eth1<u></u><u></u></p>
<p class="MsoNormal">sql_connection=mysql://<a href="http://root:password@192.168.3.1/nova?charset=utf8" target="_blank">root:password@192.168.3.1/nova?charset=utf8</a><u></u><u></u></p>
<p class="MsoNormal">libvirt_type=kvm<u></u><u></u></p>
<p class="MsoNormal">libvirt_cpu_mode=none<u></u><u></u></p>
<p class="MsoNormal">instance_name_template=instance-%08x<u></u><u></u></p>
<p class="MsoNormal">novncproxy_base_url=<a href="http://192.168.3.2:6080/vnc_auto.html" target="_blank">http://192.168.3.2:6080/vnc_auto.html</a><u></u><u></u></p>
<p class="MsoNormal">xvpvncproxy_base_url=<a href="http://192.168.3.2:6081/console" target="_blank">http://192.168.3.2:6081/console</a><u></u><u></u></p>
<p class="MsoNormal">vncserver_listen=127.0.0.1<u></u><u></u></p>
<p class="MsoNormal">vncserver_proxyclient_address=127.0.0.1<u></u><u></u></p>
<p class="MsoNormal">api_paste_config=/etc/nova/api-paste.ini<u></u><u></u></p>
<p class="MsoNormal">image_service=nova.image.glance.GlanceImageService<u></u><u></u></p>
<p class="MsoNormal">ec2_dmz_host=192.168.3.2<u></u><u></u></p>
<p class="MsoNormal">rabbit_host=192.168.3.1<u></u><u></u></p>
<p class="MsoNormal">rabbit_password=password<u></u><u></u></p>
<p class="MsoNormal">glance_api_servers=<a href="http://192.168.3.1:9292" target="_blank">192.168.3.1:9292</a><u></u><u></u></p>
<p class="MsoNormal">force_dhcp_release=True<u></u><u></u></p>
<p class="MsoNormal">multi_host=True<u></u><u></u></p>
<p class="MsoNormal">send_arp_for_ha=True<u></u><u></u></p>
<p class="MsoNormal">api_rate_limit=False<u></u><u></u></p>
<p class="MsoNormal">logging_context_format_string=%(asctime)s %(color)s%(levelname)s %(name)s [^[[01;36m%(request_id)s ^[[00;36m%(user_name)s %(project_name)s%(color)s] ^[[01;35m%(instance)s%(color)s%(message)s^[[00m<u></u><u></u></p>
<p class="MsoNormal">logging_default_format_string=%(asctime)s %(color)s%(levelname)s %(name)s [^[[00;36m-%(color)s] ^[[01;35m%(instance)s%(color)s%(message)s^[[00m<u></u><u></u></p>
<p class="MsoNormal">logging_debug_format_suffix=^[[00;33mfrom (pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d^[[00m<u></u><u></u></p>
<p class="MsoNormal">logging_exception_prefix=%(color)s%(asctime)s TRACE %(name)s ^[[01;35m%(instance)s^[[00m<u></u><u></u></p>
<p class="MsoNormal">compute_driver=libvirt.LibvirtDriver<u></u><u></u></p>
<p class="MsoNormal">firewall_driver=nova.virt.libvirt.firewall.IptablesFirewallDriver<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">I can spin up VMs on this host (usually, when I run horizon on the controller, it is this host upon which the first VM is launched). I get expected IP address in the range 10.4.128.*<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Unlike VMs on the host, I cannot ping (from either the controller (less worrisome) or the compute node (very worrisome). I looked at the console log for the VM, it is not getting
any network. The other major obvious difference is that there is no inteface gateway device when I do an ifconfig on the compute node.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">It is this last point (the lack of a interface gateway) that seems most likely to me to be the issue. Is there something I can run after launching devstack on the controller, before
I try to launch VMs, that will cause that gw to be created?<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">I did some tracebacks in the python code on the controller and it appears the gateway on the controller is being created by the quantum (???) service during its initialization (I
grepped around for "gw-") to identify where I should be putting tracebacks. According to what I have read on the net, localrc should not be enabling q-svc on the controller (and this makes sense given I am pointing back at 192.168.3.1 for quantum, as well
as other services).<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Again, hoping I mostly have the localrc contents right, and that maybe I just need to add some commands to the end of stack,sh to finish it off. Been frustrating seeing the VMs
get launched only to not be able to ping them (but damn, that's pretty cool they spin up, don't you think?) I have a lot to learn still (just 2 weeks into this) but kinda stuck on this issue.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Regards,<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">syd<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
Mailing list: <a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/~openstack</a><br>
Post to : <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
Unsubscribe : <a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/~openstack</a><br>
More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
</blockquote></div><br></div>