<div dir="ltr">I've always tested/worked with single node setup that devstack provides.<div>The host is Ubuntu 12.04, works just fine.</div><div><br></div><div>To setup lbaas in devstack. in addition to other neutron-related lines in localrc file you need to add the following:</div>
<div>service_enable q-lbaas</div><div><br></div><div>Thanks,</div><div>Eugene.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Aug 30, 2013 at 8:21 AM, Jake G. <span dir="ltr"><<a href="mailto:dj_dark_junglist@yahoo.com" target="_blank">dj_dark_junglist@yahoo.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="font-size:10pt;font-family:tahoma,new york,times,serif"><div style="font-family:tahoma,'new york',times,serif;font-size:10pt">
<span>Hi,</span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif"><span><br></span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif">
<span>I am not sure about Ubuntu. I was never able to get openstack working on Ubuntu so I gave up, but this is the process I used to set up LBaas on CentOS</span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif">
Please replace commands with Ubuntu style commands</div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif"><span><br></span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif">
<span><br></span></div><div style="background-color:transparent"><font>■ Add Quantum LBaas service to Openstack RDO</font></div><div style="background-color:transparent"><font><br></font></div><div style="background-color:transparent">
<font>1. install haproxy if it not already installed</font></div><div style="background-color:transparent"><font># yum install haproxy -y</font></div><div style="background-color:transparent"><font># reboot</font></div><div style="background-color:transparent">
<font><br></font></div><div style="background-color:transparent"><font>2. Make sure you have the modified kernel that
supports namespaces. (not necessary on Ubuntu. Already supports namespaces)</font></div><div style="background-color:transparent"><font># uname -r </font></div><div style="background-color:transparent"><font>Should look something like this. Your version may be different -> 2.6.32-358.114.1.openstack.el6.x86_64</font></div>
<div style="background-color:transparent"><font><br></font></div><div style="background-color:transparent"><font>3. Add following line in /etc/quantum/quantum.conf on your quantum-server host and restart quantum-server</font></div>
<div style="background-color:transparent"><font># vi /etc/quantum/quantum.conf</font></div><div style="background-color:transparent"><font>---------------------------------</font></div><div style="background-color:transparent">
<font>service_plugins =
quantum.plugins.services.agent_loadbalancer.plugin.LoadBalancerPlugin</font></div><div style="background-color:transparent"><font>---------------------------------</font></div><div style="background-color:transparent"><font># /etc/init.d/quantum-server restart</font></div>
<div style="background-color:transparent"><font><br></font></div><div style="background-color:transparent"><font>4. Insert the following line in /etc/openstack-dashboard/local_settings on horizon host, and restart httpd. This enables LBaaS operations on Dashboard WebUI</font></div>
<div style="background-color:transparent"><font># vi /etc/openstack-dashboard/local_settings</font></div><div style="background-color:transparent"><font>---------------------------------
</font></div><div style="background-color:transparent"><font>OPENSTACK_QUANTUM_NETWORK = { </font></div><div style="background-color:transparent"><font><span style="white-space:pre-wrap"> </span>'enable_lb': True</font></div>
<div style="background-color:transparent"><font><span style="white-space:pre-wrap"> </span>}</font></div><div style="background-color:transparent"><font>---------------------------------</font></div><div style="background-color:transparent">
<font># service httpd restart</font></div><div style="background-color:transparent"><font><br></font></div><div style="background-color:transparent"><font>5. Update the following lines in /etc/quantum/lbaas_agent.ini , then restart quantum-lbaas-agent service</font></div>
<div style="background-color:transparent"><font># vi /etc/quantum/lbaas_agent.ini</font></div><div style="background-color:transparent"><font>---------------------------------</font></div><div style="background-color:transparent">
<font><span style="white-space:pre-wrap"> </span>ovs_use_veth = True</font></div><div style="background-color:transparent"><font><span style="white-space:pre-wrap"> </span>use_namespaces = True</font></div><div style="background-color:transparent">
<font><span style="white-space:pre-wrap"> </span>interface_driver = quantum.agent.linux.interface.OVSInterfaceDriver</font></div><div style="background-color:transparent"><font><span style="white-space:pre-wrap"> </span>device_driver = quantum.plugins.services.agent_loadbalancer.drivers.haproxy.namespace_driver.HaproxyNSDriver</font></div>
<div style="background-color:transparent"><font><span style="white-space:pre-wrap"> </span>user_group = haproxy</font></div><div style="background-color:transparent"><font>---------------------------------</font></div><div style="background-color:transparent">
<font><span></span></font></div><div style="background-color:transparent"><font># /etc/init.d/quantum-lbaas-agent restart</font></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif">
<span><br></span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif"><span><br></span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif">
<span>This process worked for me, you could give it a try.</span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif"><span><br></span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif">
<span>Best,</span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif"><span>Jake</span></div><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif">
<span><br></span></div><div class="hm HOEnZb"><div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif"><span><br></span></div><div style="font-family:tahoma,'new york',times,serif;font-size:10pt">
<br></div> </div><div style="font-family:tahoma,'new york',times,serif;font-size:10pt"><div class="hm HOEnZb"> </div><div style="font-family:'times new roman','new york',times,serif;font-size:12pt">
<div class="hm HOEnZb"> </div><div dir="ltr"><div class="hm HOEnZb"> <hr size="1"> </div><font face="Arial"><div class="hm HOEnZb"> <b><span style="font-weight:bold">From:</span></b> Mahardhika <<a href="mailto:mahardika.gilang@andalabs.com" target="_blank">mahardika.gilang@andalabs.com</a>><br>
<b><span style="font-weight:bold">To:</span></b> Jake G. <<a href="mailto:dj_dark_junglist@yahoo.com" target="_blank">dj_dark_junglist@yahoo.com</a>>; Eugene Nikanorov <<a href="mailto:enikanorov@mirantis.com" target="_blank">enikanorov@mirantis.com</a>>; "<a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>" <<a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>> <br>
<b><span style="font-weight:bold">Sent:</span></b> Friday, August 30, 2013 1:01 PM</div><div><div class="h5"><br> <b><span style="font-weight:bold">Subject:</span></b> Re: [Openstack] Install/Enable Quantum lbass (load balancer)
feature?<br> </div></div></font> </div><div><div class="h5"> <div><br><div>
<div>
<div>Does lbass can get install on ubuntu
based system? how to check it?<br>
<br>
On 8/12/2013 4:16 PM, Jake G. wrote:<br>
</div>
<blockquote type="cite">
<div style="font-size:10pt;font-family:tahoma,'new york',times,serif">
<div><font>Ok i started from scratch and now everything
is working just fine. Thank you for all your help. </font></div>
<div><font><span></span></font></div>
<div><font>In the end I believe it was because I did
not have haproxy installed. </font></div>
<div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif"><font><br>
</font></div>
<div style="font-style:normal;font-size:13px;background-color:transparent;font-family:tahoma,'new york',times,serif"><font><br>
</font></div>
<div style="font-family:tahoma,'new york',times,serif;font-size:10pt"><br>
</div>
<div style="font-family:tahoma,'new york',times,serif;font-size:10pt">
<div style="font-family:'times new roman','new york',times,serif;font-size:12pt">
<div dir="ltr">
<hr size="1"> <font face="Arial"> <b><span style="font-weight:bold">From:</span></b> Eugene
Nikanorov <a rel="nofollow" href="mailto:enikanorov@mirantis.com" target="_blank"><enikanorov@mirantis.com></a><br>
<b><span style="font-weight:bold">To:</span></b> Jake
G. <a rel="nofollow" href="mailto:dj_dark_junglist@yahoo.com" target="_blank"><dj_dark_junglist@yahoo.com></a> <br>
<b><span style="font-weight:bold">Cc:</span></b>
<a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank">"openstack@lists.openstack.org"</a>
<a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank"><openstack@lists.openstack.org></a> <br>
<b><span style="font-weight:bold">Sent:</span></b>
Friday, August 9, 2013 7:50 PM<br>
<b><span style="font-weight:bold">Subject:</span></b>
Re: [Openstack] Install/Enable Quantum lbass (load
balancer) feature?<br>
</font> </div>
<div><br>
<div>
<div dir="ltr">use_namespaces has no effect, lbaas
agent in grizzly always relies on namespace support.
<div><br>
</div>
<div>Could you execute the failing command manually? </div>
<div>That needs to be done after you create a vip for
the pool.</div>
<div>The command should look like this:</div>
<div><span>sudo
quantum-rootwrap /etc/quantum/rootwrap.conf ip
netns exec qlbaas-e10951cd-4cca-4ba4-</span><span>acc0-0ccde6817029
haproxy -f /var</span></div>
<div><font style="color:rgb(121,74,114)">/lib/quantum/lbaas/e10951cd-4cca-4ba4-acc0-0ccde6817029/conf
-p
/var/lib/quantum/lbaas/e10951cd-4cca-4ba4-acc0-0ccde6817029/pid</font></div>
<div><font style="color:rgb(121,74,114)"><br>
</font></div>
<div>
<font color="#000000"><span style="font-size:small;background-color:transparent"><e10951cd-4cca-4ba4-</span><span style="font-size:small;background-color:transparent">acc0-0ccde6817029>
should be replaced with actual pool_id</span><font><br>
</font></font></div>
<div><font color="#000000"><span style="font-size:small;background-color:transparent">Could
you also verify that path and file </span><span style="font-size:small">/lib/quantum/lbaas/e10951cd-</span><span style="font-size:small">4cca-4ba4-acc0-0ccde6817029/</span><span style="font-size:small">conf exist?</span></font></div>
<div><span style="font-size:small"><font color="#000000"><br>
</font></span></div>
<div>
<span style="font-size:small"><font color="#000000">Thanks,</font></span></div>
<div><span style="font-size:small"><font color="#000000">Eugene.</font></span></div>
</div>
<div><br>
<br>
<div>On Fri, Aug 9,
2013 at 12:39 PM, Jake G. <span dir="ltr"><<a rel="nofollow" href="mailto:dj_dark_junglist@yahoo.com" target="_blank">dj_dark_junglist@yahoo.com</a>></span>
wrote:<br>
<blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div style="font-size:10pt;font-family:tahoma,'new york',times,serif">
<div>
<span>Yes this is my Kernel>
2.6.32-358.114.1.openstack.el6.x86_64</span></div>
<div><span>and
I enable: </span></div>
<div><span style="font-size:13px;background-color:transparent"><br>
</span></div>
<div><span style="font-size:13px;background-color:transparent">use_namespaces =
True</span><br>
</div>
<div style="background-color:transparent"><font><span></span></font></div>
<div style="background-color:transparent"><font>ovs_use_veth
= True</font></div>
<div><br>
</div>
<div>in /etc/quantum/dhcp_agent.ini
and etc/quantum/l3_agent.ini</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div style="font-size:12pt">
<div dir="ltr">
<hr size="1"> <font face="Arial">
<div> <b><span style="font-weight:bold">From:</span></b>
Eugene Nikanorov <<a rel="nofollow" href="mailto:enikanorov@mirantis.com" target="_blank">enikanorov@mirantis.com</a>><br>
<b><span style="font-weight:bold">To:</span></b>
Jake G. <<a rel="nofollow" href="mailto:dj_dark_junglist@yahoo.com" target="_blank">dj_dark_junglist@yahoo.com</a>>
<br>
<b><span style="font-weight:bold">Cc:</span></b>
"<a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>"
<<a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>>
<br>
</div>
<b><span style="font-weight:bold">Sent:</span></b>
Friday, August 9, 2013 5:33 PM
<div>
<div><br>
<b><span style="font-weight:bold">Subject:</span></b>
Re: [Openstack] Install/Enable
Quantum lbass (load balancer)
feature?<br>
</div>
</div>
</font> </div>
<div>
<div>
<div><br>
<div>
<div dir="ltr">Jake, haproxy.cfg
is created by lbaas agent when
you deploy an instance.
<div>Are you sure your host os
has namespace support?</div>
<div><br>
</div>
<div>Eugene.</div>
</div>
<div><br>
<br>
<div>
On Fri, Aug 9, 2013 at 12:30
PM, Jake G. <span dir="ltr"><<a rel="nofollow" href="mailto:dj_dark_junglist@yahoo.com" target="_blank">dj_dark_junglist@yahoo.com</a>></span>
wrote:<br>
<blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div>
<div><span>Good call!</span></div>
<div>
<span>Looks like i did
but the service wont
start. Do you have a
sample haproxy.cfg
file that will work
with Openstack?</span></div>
<div>
<span><br>
</span></div>
<div><span>Thank you</span></div>
<div>
<br>
</div>
<div>
<div style="font-size:12pt">
<div dir="ltr">
<hr size="1"> <font face="Arial">
<div> <b><span style="font-weight:bold">From:</span></b> Eugene Nikanorov <<a rel="nofollow" href="mailto:enikanorov@mirantis.com" target="_blank">enikanorov@mirantis.com</a>><br>
<b><span style="font-weight:bold">To:</span></b>
Jake G. <<a rel="nofollow" href="mailto:dj_dark_junglist@yahoo.com" target="_blank">dj_dark_junglist@yahoo.com</a>>
<br>
<b><span style="font-weight:bold">Cc:</span></b>
"<a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>"
<<a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>>
<br>
</div>
<b><span style="font-weight:bold">Sent:</span></b>
Friday, August
9, 2013 3:08 PM
<div>
<div><br>
<b><span style="font-weight:bold">Subject:</span></b>
Re:
[Openstack]
Install/Enable
Quantum lbass
(load
balancer)
feature?<br>
</div>
</div>
</font> </div>
<div>
<div>
<div><br>
<div>
<div dir="ltr">Do
you have
haproxy
package
installed on
your host?</div>
<div><br>
<br>
<div>On Fri,
Aug 9, 2013 at
9:41 AM, Jake
G. <span dir="ltr"><<a rel="nofollow" href="mailto:dj_dark_junglist@yahoo.com" target="_blank">dj_dark_junglist@yahoo.com</a>></span>
wrote:<br>
<blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div>
<div>
<span>I have
enabled LBaas
on my
openstack, but
after adding a
pool, vip,
members, and
monitor
successfully I
am still
unable to get
load balancing
working. </span></div>
<div>
I found this
blog to help
me so far <a rel="nofollow" href="http://kimizhang.wordpress.com/2013/08/08/openstack-grizzly-quantum-advanced-features-2/" target="_blank">http://kimizhang.wordpress.com/2013/08/08/openstack-grizzly-quantum-advanced-features-2/</a></div>
<div><br>
</div>
<div style="background-color:transparent"><font>When
I run <span style="color:rgb(121,74,114)">#
ps -ef | grep
haproxy</span>
I dont get
much: </font></div>
<div><font>root
27508 2718 0
14:16 pts/1
00:00:00 grep
haproxy</font></div>
<div style="background-color:transparent">
<font><span></span></font></div>
<div style="background-color:transparent"><font><br>
</font></div>
<div>
<font>My logs
show an issue
with haproxy:</font></div>
<div><br>
</div>
<div style="background-color:transparent">
<font style="color:rgb(121,74,114)">RuntimeError: </font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)">Command: ['sudo', 'quantum-rootwrap',
'/etc/quantum/rootwrap.conf',
'ip', 'netns',
'exec',
'qlbaas-e10951cd-4cca-4ba4-acc0-0ccde6817029',
'haproxy',
'-f', '/var</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)">/lib/quantum/lbaas/e10951cd-4cca-4ba4-acc0-0ccde6817029/conf',
'-p',
'/var/lib/quantum/lbaas/e10951cd-4cca-4ba4-acc0-0ccde6817029/pid']</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)">Exit code: 255</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)">Stdout: ''</font></div>
<div style="background-color:transparent">
<font style="color:rgb(121,74,114)">Stderr:
'<span style="font-weight:bold">exec
of haproxy
failed: No
such file or
directory</span>\n'</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)">2013-08-09 14:16:17 ERROR
[quantum.plugins.services.agent_loadbalancer.agent.manager]
Unable to
refresh device
for pool:
e10951cd-4cca-4ba4-acc0-0ccde6817029</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)">Traceback (most recent call last):</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> File
"/usr/lib/python2.6/site-packages/quantum/plugins/services/agent_loadbalancer/agent/manager.py",
line 189, in
refresh_device</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> self.driver.create(logical_config)</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> File
"/usr/lib/python2.6/site-packages/quantum/plugins/services/agent_loadbalancer/drivers/haproxy/namespace_driver.py",
line 48, in
create</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> self._spawn(logical_config)</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> File
"/usr/lib/python2.6/site-packages/quantum/plugins/services/agent_loadbalancer/drivers/haproxy/namespace_driver.py",
line 70, in
_spawn</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> ns.netns.execute(cmd)</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> File
"/usr/lib/python2.6/site-packages/quantum/agent/linux/ip_lib.py",
line 414, in
execute</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> check_exit_code=check_exit_code)</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> File
"/usr/lib/python2.6/site-packages/quantum/agent/linux/utils.py",
line 61, in
execute</font></div>
<div style="background-color:transparent"><font style="color:rgb(121,74,114)"> raise RuntimeError(m)</font></div>
<div>
<br>
</div>
<div>Any
ideas?</div>
<div>
<br>
</div>
<div> </div>
<div>
<div> </div>
<div style="font-size:12pt">
<div>
<div dir="ltr">
<hr size="1">
<font face="Arial">
<b><span style="font-weight:bold">From:</span></b>
Eugene
Nikanorov <<a rel="nofollow" href="mailto:enikanorov@mirantis.com" target="_blank">enikanorov@mirantis.com</a>><br>
<b><span style="font-weight:bold">To:</span></b>
Jake G. <<a rel="nofollow" href="mailto:dj_dark_junglist@yahoo.com" target="_blank">dj_dark_junglist@yahoo.com</a>>
<br>
<b><span style="font-weight:bold">Cc:</span></b>
"<a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>"
<<a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>>
<br>
<b><span style="font-weight:bold">Sent:</span></b>
Thursday,
August 8, 2013
7:04 PM<br>
<b><span style="font-weight:bold">Subject:</span></b>
Re:
[Openstack]
Install/Enable
Quantum lbass
(load
balancer)
feature?<br>
</font> </div>
</div>
<div>
<div>
<div><br>
<div>
<div dir="ltr">Hi
Jake,
<div><br>
</div>
<div>Regarding
lbaas in
grizzly
working on
RHEL/Centos -
it may be
problematic as
host operation
system must
support
network
namespaces. </div>
<div>If you do
have support
for network
namespaces
then you need
to do the
following
steps to setup
lbaas service
in quantum:<br>
</div>
<div><br>
</div>
<div>1)
specify lbaas
plugin in
quantum.conf:</div>
<div>service_plugins=
lbaas_plugin_classpath.</div>
<div>check
quantum/plugins/services/agent_loadbalancer/plugin.py
for correct
path as
currently the
name and path
has changed.</div>
<div><br>
</div>
<div>2) to
enable lbaas
service in
horizon you
need to do the
following:</div>
<div>add the
following
piece of code
to horizon/openstack_dashboard/local/local_settings.py
:</div>
<div><br>
</div>
<div>
<div>OPENSTACK_QUANTUM_NETWORK
= {</div>
<div>
'enable_lb':
False</div>
<div>}</div>
</div>
<div><br>
</div>
<div>3) start
quantum-lbaas-agent
on the host
providing
quantum.conf
and
lbaas-agent.ini.
lbaas-agent.ini
should reflect
core plugin
configuration
(should have
proper
interface
driver)</div>
<div><br>
</div>
<div>Note that
if host os has
no namespace
support, all
of above will
work (e.g.
REST API will
be
functional),
but you would
not be able to
deploy
loadbalancer
as lbaas agent
can only work
with
namespaces.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Eugene.</div>
</div>
<div><br>
<br>
<div>On Thu,
Aug 8, 2013 at
1:14 PM, Jake
G. <span dir="ltr"><<a rel="nofollow" href="mailto:dj_dark_junglist@yahoo.com" target="_blank">dj_dark_junglist@yahoo.com</a>></span>
wrote:<br>
<blockquote style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div>
<div><font face="tahoma,
new york,
times, serif">Hi
all!</font></div>
<div><span>How
can we
install/enable
the
Quantum-lbaas
(load
balancer)
feature for
Openstack
Grizzly? I
dont see any
docs for
RHEL/CentOS
specific
installs. </span></div>
<div><span>I
used RDO to
deploy
Openstack on a
single node.</span><br>
</div>
<div><font face="tahoma,
new york,
times, serif"><br>
</font></div>
<div><font face="tahoma,
new york,
times, serif">Thank
you! Jake</font></div>
</div>
</div>
<br>
_______________________________________________<br>
Mailing list:
<a rel="nofollow" href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to :
<a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe :
<a rel="nofollow" href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
<br>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
<br>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
<br>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
<br>
<br>
</div>
</div>
</div>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Mailing list: <a rel="nofollow" href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a>
Post to : <a rel="nofollow" href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>
Unsubscribe : <a rel="nofollow" href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a>
</pre>
</blockquote>
<br>
<br>
<div>-- <br>
Regards,<br>
Mahardhika Gilang<br>
<br>
<b>PT. Andalabs Technology
</b><br>
Gedung Gravira<br>
Jl. Cideng Barat no. 54<br>
Jakarta Pusat 10150<br>
<br>
HP : 0852 139 55861<br>
Email : <a rel="nofollow" href="mailto:mahardika.gilang@andalabs.com" target="_blank">mahardika.gilang@andalabs.com</a> </div>
</div>
</div><br><br></div> </div></div></div> </div> </div></div></blockquote></div><br></div>