<div dir="ltr">Do you mean br-ex interface and eth0.2? well the br-ex was created by openstack and eth0.2 is the network that I get access to outside from.<div><br></div><div>Thanks.</div><div><br></div><div><br></div><div class="gmail_extra">
<div class="gmail_quote">On 17 February 2013 01:33, Jean-Baptiste RANSY <span dir="ltr"><<a href="mailto:jean-baptiste.ransy@alyseo.com" target="_blank">jean-baptiste.ransy@alyseo.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div>
<div>You have two interfaces with the same
ip address<br>
<br>
The problem must be here now.<br>
<br>
JB<br>
<br>
<br>
</div>
<blockquote type="cite">
<div><b>root@controller:~# ip addr show</b></div>
4: eth0.2@eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500
qdisc noqueue state UP
<div> link/ether d4:ae:52:bb:aa:20 brd ff:ff:ff:ff:ff:ff</div>
<div> inet <font color="#ff0000"><a href="http://192.168.2.225/24" target="_blank">192.168.2.225/24</a></font>
brd 192.168.2.255 scope global eth0.2</div>
<div> inet6 fe80::d6ae:52ff:febb:aa20/64 scope link </div>
<div> valid_lft forever preferred_lft forever</div>
<div>7: br-ex: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500
qdisc noqueue state UNKNOWN </div>
<div> link/ether 9a:41:c8:8a:9e:49 brd ff:ff:ff:ff:ff:ff</div>
<div> inet <font color="#ff0000"><a href="http://192.168.2.225/24" target="_blank">192.168.2.225/24</a></font>
scope global br-ex</div>
</blockquote>
<br>
<br>
On 02/17/2013 02:15 AM, Chathura M. Sarathchandra Magurawalage
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hello JB,
<div><br>
</div>
<div>I changed the IP and restarted the <span style="font-family:arial,sans-serif;font-size:13px">quantum-l3-agent
but still no luck :(</span></div>
<div><span style="font-family:arial,sans-serif;font-size:13px"><br>
</span></div>
<div><span style="font-family:arial,sans-serif;font-size:13px">Thanks.</span></div>
</div>
<div class="gmail_extra"><br clear="all">
<div>
<div dir="ltr">
<div>-----------------------------------------------------------------------------------------------------------------------------</div>
Chathura Madhusanka Sarathchandra Magurawalage.
<div><span style="font-family:arial;font-size:small">1NW.2.1,
Desk 2</span><br>
<div>School of Computer Science and Electronic Engineering<br>
<div>University Of Essex</div>
<div>
United Kingdom.</div>
<div><br>
</div>
<div>Email: <a href="mailto:csarata@essex.ac.uk" target="_blank">csarata@essex.ac.uk</a></div>
<div> chathura.sarathchandra<a href="mailto:77.chathura@gmail.com" target="_blank">@gmail.com</a></div>
</div>
<div> <a href="mailto:77.chathura@gmail.com" target="_blank">77.chathura@gmail.com</a></div>
</div>
</div>
</div>
<br>
<br>
<div class="gmail_quote">On 17 February 2013 00:47,
Jean-Baptiste RANSY <span dir="ltr"><<a href="mailto:jean-baptiste.ransy@alyseo.com" target="_blank">jean-baptiste.ransy@alyseo.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div>and restart quantum-l3-agent :)<span><font color="#888888"><br>
<br>
JB</font></span>
<div>
<div><br>
<br>
On 02/17/2013 01:46 AM, Jean-Baptiste RANSY wrote:<br>
</div>
</div>
</div>
<div>
<div>
<blockquote type="cite">
<div>Found !<br>
<br>
On the controller node you must change the
metadata_ip in /etc/quantum/l3_agent.ini<br>
<br>
This params is used to create the nat rule
quantum-l3-agent-PREROUTING<br>
<br>
Just replace 127.0.0.1 by 192.168.2.225 and that
should be ok.<br>
<br>
JB<br>
<br>
<br>
On 02/17/2013 01:04 AM, Jean-Baptiste RANSY wrote:<br>
</div>
<blockquote type="cite">
<div>Hi, Chathura<br>
<br>
The compute node log file
/var/log/nova/nova-api.log is too light (maybe
logrotate :p)<br>
<br>
Please, clear nova-api.log, restart nova-api
service, start a new instance and wait
cloud-init fail to retrieve metadata.<br>
<br>
Thx,<br>
<br>
JB<br>
<br>
<br>
On 02/16/2013 11:35 PM, Chathura M.
Sarathchandra Magurawalage wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>Thanks for that.</div>
<div><b><br>
</b></div>
<div><b>root@controller:~# ip addr show</b></div>
<div>1: lo: <LOOPBACK,UP,LOWER_UP> mtu
16436 qdisc noqueue state UNKNOWN </div>
<div> link/loopback 00:00:00:00:00:00 brd
00:00:00:00:00:00</div>
<div> inet <a href="http://127.0.0.1/8" target="_blank">127.0.0.1/8</a>
scope host lo</div>
<div> inet6 ::1/128 scope host </div>
<div> valid_lft forever preferred_lft
forever</div>
<div>2: eth0:
<BROADCAST,MULTICAST,UP,LOWER_UP> mtu
1500 qdisc mq state UP qlen 1000</div>
<div> link/ether d4:ae:52:bb:aa:20 brd
ff:ff:ff:ff:ff:ff</div>
<div> inet <a href="http://10.10.10.1/24" target="_blank">10.10.10.1/24</a> brd
10.10.10.255 scope global eth0</div>
<div> inet6 fe80::d6ae:52ff:febb:aa20/64
scope link </div>
<div> valid_lft forever preferred_lft
forever</div>
<div>3: eth1: <BROADCAST,MULTICAST> mtu
1500 qdisc noop state DOWN qlen 1000</div>
<div> link/ether d4:ae:52:bb:aa:21 brd
ff:ff:ff:ff:ff:ff</div>
<div>4: eth0.2@eth0:
<BROADCAST,MULTICAST,UP,LOWER_UP> mtu
1500 qdisc noqueue state UP </div>
<div> link/ether d4:ae:52:bb:aa:20 brd
ff:ff:ff:ff:ff:ff</div>
<div> inet <a href="http://192.168.2.225/24" target="_blank">192.168.2.225/24</a> brd
192.168.2.255 scope global eth0.2</div>
<div> inet6 fe80::d6ae:52ff:febb:aa20/64
scope link </div>
<div> valid_lft forever preferred_lft
forever</div>
<div>5: br-int:
<BROADCAST,MULTICAST,UP,LOWER_UP> mtu
1500 qdisc noqueue state UNKNOWN </div>
<div> link/ether ba:7a:e9:dc:2b:41 brd
ff:ff:ff:ff:ff:ff</div>
<div> inet6 fe80::b87a:e9ff:fedc:2b41/64
scope link </div>
<div> valid_lft forever preferred_lft
forever</div>
<div>7: br-ex:
<BROADCAST,MULTICAST,UP,LOWER_UP> mtu
1500 qdisc noqueue state UNKNOWN </div>
<div> link/ether 9a:41:c8:8a:9e:49 brd
ff:ff:ff:ff:ff:ff</div>
<div> inet <a href="http://192.168.2.225/24" target="_blank">192.168.2.225/24</a> scope
global br-ex</div>
<div>8: tapf71b5b86-5c:
<BROADCAST,MULTICAST,UP,LOWER_UP> mtu
1500 qdisc noqueue state UNKNOWN </div>
<div> link/ether 2a:44:a3:d1:7d:f3 brd
ff:ff:ff:ff:ff:ff</div>
<div> inet <a href="http://10.5.5.2/24" target="_blank">10.5.5.2/24</a>
brd 10.5.5.255 scope global tapf71b5b86-5c</div>
<div> inet6 fe80::2844:a3ff:fed1:7df3/64
scope link </div>
<div> valid_lft forever preferred_lft
forever</div>
<div>9: qr-4d088f3a-78:
<BROADCAST,MULTICAST,UP,LOWER_UP> mtu
1500 qdisc noqueue state UNKNOWN </div>
<div> link/ether ca:5b:8d:4d:6d:fb brd
ff:ff:ff:ff:ff:ff</div>
<div> inet <a href="http://10.5.5.1/24" target="_blank">10.5.5.1/24</a>
brd 10.5.5.255 scope global qr-4d088f3a-78</div>
<div> inet6 fe80::c85b:8dff:fe4d:6dfb/64
scope link </div>
<div> valid_lft forever preferred_lft
forever</div>
<div>10: qg-6f8374cb-cb:
<BROADCAST,MULTICAST,UP,LOWER_UP> mtu
1500 qdisc noqueue state UNKNOWN </div>
<div> link/ether 0e:7f:dd:3a:80:bc brd
ff:ff:ff:ff:ff:ff</div>
<div> inet <a href="http://192.168.2.151/24" target="_blank">192.168.2.151/24</a> brd
192.168.2.255 scope global qg-6f8374cb-cb</div>
<div> inet6 fe80::c7f:ddff:fe3a:80bc/64
scope link </div>
<div> valid_lft forever preferred_lft
forever</div>
<div>27: br-tun: <BROADCAST,MULTICAST>
mtu 1500 qdisc noop state DOWN </div>
<div> link/ether 8a:cf:ec:7c:15:40 brd
ff:ff:ff:ff:ff:ff</div>
<div><br>
</div>
<div>
<div><b>cat /proc/sys/net/ipv4/ip_forward</b></div>
<div>1</div>
</div>
<div class="gmail_extra">
<div>
<div dir="ltr">
<div><br>
</div>
<div>
<div><b>root@computenode:~# ip addr
show</b></div>
<div>1: lo:
<LOOPBACK,UP,LOWER_UP> mtu
16436 qdisc noqueue state UNKNOWN </div>
<div> link/loopback
00:00:00:00:00:00 brd
00:00:00:00:00:00</div>
<div> inet <a href="http://127.0.0.1/8" target="_blank">127.0.0.1/8</a>
scope host lo</div>
<div> inet6 ::1/128 scope host </div>
<div> valid_lft forever
preferred_lft forever</div>
<div>2: eth0:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc mq state UP qlen 1000</div>
<div> link/ether d4:ae:52:bb:a1:9d
brd ff:ff:ff:ff:ff:ff</div>
<div> inet <a href="http://10.10.10.12/24" target="_blank">10.10.10.12/24</a>
brd 10.10.10.255 scope global eth0</div>
<div> inet6
fe80::d6ae:52ff:febb:a19d/64 scope
link </div>
<div> valid_lft forever
preferred_lft forever</div>
<div>3: eth1:
<BROADCAST,MULTICAST> mtu 1500
qdisc noop state DOWN qlen 1000</div>
<div> link/ether d4:ae:52:bb:a1:9e
brd ff:ff:ff:ff:ff:ff</div>
<div>4: eth0.2@eth0:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue state UP </div>
<div> link/ether d4:ae:52:bb:a1:9d
brd ff:ff:ff:ff:ff:ff</div>
<div> inet <a href="http://192.168.2.234/24" target="_blank">192.168.2.234/24</a>
brd 192.168.2.255 scope global
eth0.2</div>
<div> inet6
fe80::d6ae:52ff:febb:a19d/64 scope
link </div>
<div> valid_lft forever
preferred_lft forever</div>
<div>5: br-int:
<BROADCAST,MULTICAST> mtu 1500
qdisc noop state DOWN </div>
<div> link/ether ae:9b:43:09:af:40
brd ff:ff:ff:ff:ff:ff</div>
<div>9: qbr256f5ed2-43:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue state UP </div>
<div> link/ether c6:c0:df:64:c6:99
brd ff:ff:ff:ff:ff:ff</div>
<div> inet6
fe80::20e8:b9ff:fe6c:6f55/64 scope
link </div>
<div> valid_lft forever
preferred_lft forever</div>
<div>10: qvo256f5ed2-43:
<BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP>
mtu 1500 qdisc pfifo_fast state UP
qlen 1000</div>
<div> link/ether 76:25:8b:fd:90:3b
brd ff:ff:ff:ff:ff:ff</div>
<div> inet6
fe80::7425:8bff:fefd:903b/64 scope
link </div>
<div> valid_lft forever
preferred_lft forever</div>
<div>11: qvb256f5ed2-43:
<BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP>
mtu 1500 qdisc pfifo_fast master
qbr256f5ed2-43 state UP qlen 1000</div>
<div> link/ether c6:c0:df:64:c6:99
brd ff:ff:ff:ff:ff:ff</div>
<div> inet6
fe80::c4c0:dfff:fe64:c699/64 scope
link </div>
<div> valid_lft forever
preferred_lft forever</div>
<div>13: br-tun:
<BROADCAST,MULTICAST> mtu 1500
qdisc noop state DOWN </div>
<div> link/ether be:8c:30:78:35:48
brd ff:ff:ff:ff:ff:ff</div>
<div>15: vnet0:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc pfifo_fast master
qbr256f5ed2-43 state UNKNOWN qlen
500</div>
<div> link/ether fe:16:3e:57:ec:ff
brd ff:ff:ff:ff:ff:ff</div>
<div> inet6
fe80::fc16:3eff:fe57:ecff/64 scope
link </div>
<div> valid_lft forever
preferred_lft forever</div>
</div>
<div><br>
</div>
<div>btw cronus is my compute node and I
have renamed it to computenode to
understand it better.</div>
</div>
</div>
<br>
<div class="gmail_quote">On 16 February 2013
22:11, Jean-Baptiste RANSY <span dir="ltr"><<a href="mailto:jean-baptiste.ransy@alyseo.com" target="_blank">jean-baptiste.ransy@alyseo.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div>Download in progress<br>
<br>
Can you send me the output of those
commands i forgot :<br>
<br>
Controller Node:<br>
$ ip addr show<br>
$ cat /proc/sys/net/ipv4/ip_forward<br>
<br>
Compute Node:<br>
$ ip addr show<span><font color="#888888"><br>
<br>
<br>
JB</font></span>
<div>
<div><br>
<br>
<br>
On 02/16/2013 10:45 PM, Chathura
M. Sarathchandra Magurawalage
wrote:<br>
</div>
</div>
</div>
<div>
<div>
<blockquote type="cite">
<div dir="ltr">
<div>Thanks Ransy,</div>
<div><br>
</div>
<div>I have created a tar file
with the configuration and
log files in it. Please
download it using the
following URL. I have pasted
the output of the commands
below.</div>
<div><br>
</div>
<div><a href="https://www.dropbox.com/s/qyfcsn50060y304/confilesnlogs.tar" target="_blank">https://www.dropbox.com/s/qyfcsn50060y304/confilesnlogs.tar</a><br>
</div>
<div><br>
</div>
<div><b>Controller node:</b></div>
<div><b>root@controller:~#
keystone endpoint-list</b></div>
<div>+----------------------------------+-----------+-------------------------------------------------+-------------------------------------------------+--------------------------------------------+Controller
node</div>
<div>| id
| region |
publicurl
|
internalurl
|
adminurl |</div>
<div>+----------------------------------+-----------+-------------------------------------------------+-------------------------------------------------+--------------------------------------------+</div>
<div>|
2c9a1cb0fe8247d9b7716432cf459fe5
| RegionOne | <a href="http://192.168.2.225:8774/v2/$%28tenant_id%29s" target="_blank">http://192.168.2.225:8774/v2/$(tenant_id)s</a>
| <a href="http://192.168.2.225:8774/v2/$%28tenant_id%29s" target="_blank">http://192.168.2.225:8774/v2/$(tenant_id)s</a>
| <a href="http://192.168.2.225:8774/v2/$%28tenant_id%29s" target="_blank">http://192.168.2.225:8774/v2/$(tenant_id)s</a>
|</div>
<div>|
2d306903ed3342a8aaaac7c5680c116f
| RegionOne | <a href="http://192.168.2.225:9696/" target="_blank">http://192.168.2.225:9696/</a>
| <a href="http://192.168.2.225:9696/" target="_blank">http://192.168.2.225:9696/</a>
| <a href="http://192.168.2.225:9696/" target="_blank">http://192.168.2.225:9696/</a>
|</div>
<div>|
3848114f120f42bf819bc2443b28ac9e
| RegionOne | <a href="http://192.168.2.225:8080/v1/AUTH_$%28tenant_id%29s" target="_blank">http://192.168.2.225:8080/v1/AUTH_$(tenant_id)s</a>
| <a href="http://192.168.2.225:8080/v1/AUTH_$%28tenant_id%29s" target="_blank">http://192.168.2.225:8080/v1/AUTH_$(tenant_id)s</a>
| <a href="http://192.168.2.225:8080/v1" target="_blank">http://192.168.2.225:8080/v1</a>
|</div>
<div>|
4955173b8d9e4d33ae4a5b29dc12c74d
| RegionOne | <a href="http://192.168.2.225:8776/v1/$%28tenant_id%29s" target="_blank">http://192.168.2.225:8776/v1/$(tenant_id)s</a>
| <a href="http://192.168.2.225:8776/v1/$%28tenant_id%29s" target="_blank">http://192.168.2.225:8776/v1/$(tenant_id)s</a>
| <a href="http://192.168.2.225:8776/v1/$%28tenant_id%29s" target="_blank">http://192.168.2.225:8776/v1/$(tenant_id)s</a>
|</div>
<div>|
d313aa76bf854dde94f33a49a9f0c8ac
| RegionOne | <a href="http://192.168.2.225:9292/v2" target="_blank">http://192.168.2.225:9292/v2</a>
| <a href="http://192.168.2.225:9292/v2" target="_blank">http://192.168.2.225:9292/v2</a>
| <a href="http://192.168.2.225:9292/v2" target="_blank">http://192.168.2.225:9292/v2</a>
|</div>
<div>|
e5aa4ecf3cbe4dd5aba9b204c74fee6a
| RegionOne | <a href="http://192.168.2.225:5000/v2.0" target="_blank">http://192.168.2.225:5000/v2.0</a>
| <a href="http://192.168.2.225:5000/v2.0" target="_blank">http://192.168.2.225:5000/v2.0</a>
| <a href="http://192.168.2.225:35357/v2.0" target="_blank">http://192.168.2.225:35357/v2.0</a>
|</div>
<div>|
fba6f790e3b444c890d114f13cd32b37
| RegionOne | <a href="http://192.168.2.225:8773/services/Cloud" target="_blank">http://192.168.2.225:8773/services/Cloud</a>
| <a href="http://192.168.2.225:8773/services/Cloud" target="_blank">http://192.168.2.225:8773/services/Cloud</a>
| <a href="http://192.168.2.225:8773/services/Admin" target="_blank">http://192.168.2.225:8773/services/Admin</a>
|</div>
<div>+----------------------------------+-----------+-------------------------------------------------+-------------------------------------------------+--------------------------------------------+</div>
<div><br>
</div>
<div>
<div><b>root@controller:~#
ip link show</b></div>
<div>1: lo:
<LOOPBACK,UP,LOWER_UP>
mtu 16436 qdisc noqueue
state UNKNOWN </div>
<div> link/loopback
00:00:00:00:00:00 brd
00:00:00:00:00:00</div>
<div>2: eth0:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc mq state UP
qlen 1000</div>
<div> link/ether
d4:ae:52:bb:aa:20 brd
ff:ff:ff:ff:ff:ff</div>
<div>3: eth1:
<BROADCAST,MULTICAST>
mtu 1500 qdisc noop state
DOWN qlen 1000</div>
<div> link/ether
d4:ae:52:bb:aa:21 brd
ff:ff:ff:ff:ff:ff</div>
<div> 4: eth0.2@eth0:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue
state UP </div>
<div> link/ether
d4:ae:52:bb:aa:20 brd
ff:ff:ff:ff:ff:ff</div>
<div>5: br-int:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue
state UNKNOWN </div>
<div> link/ether
ba:7a:e9:dc:2b:41 brd
ff:ff:ff:ff:ff:ff</div>
<div>7: br-ex:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue
state UNKNOWN </div>
<div> link/ether
9a:41:c8:8a:9e:49 brd
ff:ff:ff:ff:ff:ff</div>
<div>8: tapf71b5b86-5c:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue
state UNKNOWN </div>
<div> link/ether
2a:44:a3:d1:7d:f3 brd
ff:ff:ff:ff:ff:ff</div>
<div>9: qr-4d088f3a-78:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue
state UNKNOWN </div>
<div> link/ether
ca:5b:8d:4d:6d:fb brd
ff:ff:ff:ff:ff:ff</div>
<div>10: qg-6f8374cb-cb:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue
state UNKNOWN </div>
<div> link/ether
0e:7f:dd:3a:80:bc brd
ff:ff:ff:ff:ff:ff</div>
<div>27: br-tun:
<BROADCAST,MULTICAST>
mtu 1500 qdisc noop state
DOWN </div>
<div> link/ether
8a:cf:ec:7c:15:40 brd
ff:ff:ff:ff:ff:ff</div>
</div>
<div><br>
</div>
<div>
<div><b>root@controller:~#
ip route show</b></div>
<div>default via
192.168.2.253 dev eth0.2 </div>
<div>default via
192.168.2.253 dev eth0.2
metric 100 </div>
<div><a href="http://10.5.5.0/24" target="_blank">10.5.5.0/24</a>
dev tapf71b5b86-5c proto
kernel scope link src
10.5.5.2 </div>
<div><a href="http://10.5.5.0/24" target="_blank">10.5.5.0/24</a>
dev qr-4d088f3a-78 proto
kernel scope link src
10.5.5.1 </div>
<div><a href="http://10.10.10.0/24" target="_blank">10.10.10.0/24</a>
dev eth0 proto kernel
scope link src
10.10.10.1 </div>
<div><a href="http://192.168.2.0/24" target="_blank">192.168.2.0/24</a>
dev eth0.2 proto kernel
scope link src
192.168.2.225 </div>
<div><a href="http://192.168.2.0/24" target="_blank">192.168.2.0/24</a>
dev qg-6f8374cb-cb proto
kernel scope link src
192.168.2.151 </div>
<div><a href="http://192.168.2.0/24" target="_blank">192.168.2.0/24</a>
dev br-ex proto kernel
scope link src
192.168.2.225</div>
</div>
<div class="gmail_extra"> <br>
<span style="font-family:arial,sans-serif;font-size:13px"><b>$
ip netns show (Did not
return anything)</b></span></div>
<div class="gmail_extra"><span style="font-family:arial,sans-serif;font-size:13px"><br>
</span></div>
<div class="gmail_extra">
<div class="gmail_extra"><font face="arial, sans-serif"><b>root@controller:~#
ovs-vsctl show</b></font></div>
<div class="gmail_extra"><font face="arial, sans-serif">a566afae-d7a8-42a9-aefe-8b0f2f7054a3</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Bridge br-tun</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Port "gre-4"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
"gre-4"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type: gre</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
options:
{in_key=flow,
out_key=flow,
remote_ip="10.10.10.12"}</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Port "gre-3"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
"gre-3"</font></div>
<div class="gmail_extra"> <font face="arial, sans-serif">
type: gre</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
options:
{in_key=flow,
out_key=flow,
remote_ip="127.0.0.1"}</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Port patch-int</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
patch-int</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type:
patch</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
options:
{peer=patch-tun}</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Port br-tun</font></div>
<div class="gmail_extra"> <font face="arial, sans-serif">
Interface
br-tun</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type:
internal</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Port "gre-1"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
"gre-1"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type: gre</font></div>
<div class="gmail_extra"> <font face="arial, sans-serif">
options:
{in_key=flow,
out_key=flow,
remote_ip="10.0.0.3"}</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Bridge br-ex</font></div>
<div class="gmail_extra"> <font face="arial, sans-serif">
Port br-ex</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
br-ex</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type:
internal</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Port
"qg-6f8374cb-cb"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
"qg-6f8374cb-cb"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type:
internal</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Port "br0"</font></div>
<div class="gmail_extra"> <font face="arial, sans-serif">
Interface
"br0"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Bridge br-int</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Port br-int</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
br-int</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type:
internal</font></div>
<div class="gmail_extra"> <font face="arial, sans-serif">
Port
"tapf71b5b86-5c"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
tag: 1</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
"tapf71b5b86-5c"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type:
internal</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Port patch-tun</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
patch-tun</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type:
patch</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
options:
{peer=patch-int}</font></div>
<div class="gmail_extra"> <font face="arial, sans-serif">
Port
"qr-4d088f3a-78"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
tag: 1</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
Interface
"qr-4d088f3a-78"</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
type:
internal</font></div>
<div class="gmail_extra"><font face="arial, sans-serif">
ovs_version:
"1.4.0+build0"</font></div>
<div style="font-family:arial,sans-serif;font-size:13px">
<br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div style="font-family:arial,sans-serif;font-size:13px"><b>Compute
node:</b></div>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
<div>
<div><font face="arial,
sans-serif"><b>root@cronus:~#
ip link show</b></font></div>
<div><font face="arial,
sans-serif">1: lo:
<LOOPBACK,UP,LOWER_UP>
mtu 16436 qdisc
noqueue state UNKNOWN </font></div>
<div> <font face="arial,
sans-serif">
link/loopback
00:00:00:00:00:00 brd
00:00:00:00:00:00</font></div>
<div><font face="arial,
sans-serif">2: eth0:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc mq
state UP qlen 1000</font></div>
<div><font face="arial,
sans-serif">
link/ether
d4:ae:52:bb:a1:9d brd
ff:ff:ff:ff:ff:ff</font></div>
<div><font face="arial,
sans-serif">3: eth1:
<BROADCAST,MULTICAST>
mtu 1500 qdisc noop
state DOWN qlen 1000</font></div>
<div><font face="arial,
sans-serif">
link/ether
d4:ae:52:bb:a1:9e brd
ff:ff:ff:ff:ff:ff</font></div>
<div><font face="arial,
sans-serif">4:
eth0.2@eth0:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue
state UP </font></div>
<div><font face="arial,
sans-serif">
link/ether
d4:ae:52:bb:a1:9d brd
ff:ff:ff:ff:ff:ff</font></div>
<div><font face="arial,
sans-serif">5: br-int:
<BROADCAST,MULTICAST>
mtu 1500 qdisc noop
state DOWN </font></div>
<div><font face="arial,
sans-serif">
link/ether
ae:9b:43:09:af:40 brd
ff:ff:ff:ff:ff:ff</font></div>
<div><font face="arial,
sans-serif">9:
qbr256f5ed2-43:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc noqueue
state UP </font></div>
<div><font face="arial,
sans-serif">
link/ether
c6:c0:df:64:c6:99 brd
ff:ff:ff:ff:ff:ff</font></div>
<div><font face="arial,
sans-serif">10:
qvo256f5ed2-43:
<BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP>
mtu 1500 qdisc
pfifo_fast state UP
qlen 1000</font></div>
<div><font face="arial,
sans-serif">
link/ether
76:25:8b:fd:90:3b brd
ff:ff:ff:ff:ff:ff</font></div>
<div><font face="arial,
sans-serif">11:
qvb256f5ed2-43:
<BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP>
mtu 1500 qdisc
pfifo_fast master
qbr256f5ed2-43 state
UP qlen 1000</font></div>
<div><font face="arial,
sans-serif">
link/ether
c6:c0:df:64:c6:99 brd
ff:ff:ff:ff:ff:ff</font></div>
<div><font face="arial,
sans-serif">13:
br-tun:
<BROADCAST,MULTICAST>
mtu 1500 qdisc noop
state DOWN </font></div>
<div><font face="arial,
sans-serif">
link/ether
be:8c:30:78:35:48 brd
ff:ff:ff:ff:ff:ff</font></div>
<div><font face="arial,
sans-serif">15: vnet0:
<BROADCAST,MULTICAST,UP,LOWER_UP>
mtu 1500 qdisc
pfifo_fast master
qbr256f5ed2-43 state
UNKNOWN qlen 500</font></div>
<div><font face="arial,
sans-serif">
link/ether
fe:16:3e:57:ec:ff brd
ff:ff:ff:ff:ff:ff</font></div>
<div style="font-family:arial,sans-serif;font-size:13px"><br>
</div>
</div>
<div>
<div><font face="arial,
sans-serif"><b>root@cronus:~#
ip route show</b></font></div>
<div><font face="arial,
sans-serif">default
via 192.168.2.253 dev
eth0.2 metric 100 </font></div>
<div><font face="arial,
sans-serif"><a href="http://10.10.10.0/24" target="_blank">10.10.10.0/24</a> dev eth0
proto kernel scope
link src 10.10.10.12 </font></div>
<div><font face="arial,
sans-serif"><a href="http://192.168.2.0/24" target="_blank">192.168.2.0/24</a> dev
eth0.2 proto kernel
scope link src
192.168.2.234 </font></div>
</div>
<div><font face="arial,
sans-serif"><br>
</font></div>
<div> <font face="arial,
sans-serif">
<div> <b>root@cronus:~#
ovs-vsctl show</b></div>
<div>d85bc334-6d64-4a13-b851-d56b18ff1549</div>
<div> Bridge br-int</div>
<div> Port
"qvo0e743b01-89"</div>
<div> tag:
4095</div>
<div>
Interface
"qvo0e743b01-89"</div>
<div> Port
"qvo256f5ed2-43"</div>
<div> tag: 1</div>
<div>
Interface
"qvo256f5ed2-43"</div>
<div> Port
patch-tun</div>
<div>
Interface patch-tun</div>
<div>
type: patch</div>
<div>
options:
{peer=patch-int}</div>
<div> Port br-int</div>
<div>
Interface br-int</div>
<div>
type: internal</div>
<div> Port
"qvoee3d4131-2a"</div>
<div> tag:
4095</div>
<div>
Interface
"qvoee3d4131-2a"</div>
<div> Port
"qvocbc816bd-3d"</div>
<div> tag:
4095</div>
<div>
Interface
"qvocbc816bd-3d"</div>
<div> Bridge br-tun</div>
<div> Port br-tun</div>
<div>
Interface br-tun</div>
<div>
type: internal</div>
<div> Port
"gre-2"</div>
<div>
Interface "gre-2"</div>
<div>
type: gre</div>
<div>
options: {in_key=flow,
out_key=flow,
remote_ip="10.10.10.1"}</div>
<div> Port
"gre-1"</div>
<div>
Interface "gre-1"</div>
<div>
type: gre</div>
<div>
options: {in_key=flow,
out_key=flow,
remote_ip="10.0.0.3"}</div>
<div> Port
patch-int</div>
<div>
Interface patch-int</div>
<div>
type: patch</div>
<div>
options:
{peer=patch-tun}</div>
<div> Port
"gre-3"</div>
<div>
Interface "gre-3"</div>
<div>
type: gre</div>
<div>
options: {in_key=flow,
out_key=flow,
remote_ip="127.0.0.1"}</div>
<div> ovs_version:
"1.4.0+build0"</div>
<div><br>
</div>
<div><br>
</div>
<div>Thanks I appreciate
your help.</div>
<div><br>
</div>
</font></div>
</div>
<div class="gmail_extra">
<div class="gmail_quote">On
16 February 2013 16:49,
Jean-Baptiste RANSY <span dir="ltr"><<a href="mailto:jean-baptiste.ransy@alyseo.com" target="_blank">jean-baptiste.ransy@alyseo.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div>Please provide
files listed bellow
:<br>
<br>
Controller Node :<br>
/etc/nova/nova.conf<br>
/etc/nova/api-paste.ini<br>
/etc/quantum/l3_agent.ini<br>
/etc/quantum/quantum.conf<br>
/etc/quantum/dhcp_agent.ini<br>
/etc/quantum/plugins/openvswitch/ovs_quantum_plugin.ini<br>
/etc/quantum/api-paste.ini<br>
/var/log/nova/*.log<br>
/var/log/quantum/*.log<br>
<br>
Compute Node :<br>
/etc/nova/nova.conf<br>
/etc/nova/nova-compute.conf<br>
/etc/nova/api-paste.ini<br>
/etc/quantum/quantum.conf<br>
/etc/quantum/plugins/openvswitch/ovs_quantum_plugin.ini<br>
/var/log/nova/*.log<br>
/var/log/quantum/*.log<br>
<br>
Plus, complete
output of the
following commands :<br>
<br>
Controller Node :<br>
$ keystone
endpoint-list<br>
$ ip link show<br>
$ ip route show<br>
$ ip netns show<br>
$ ovs-vsctl show<br>
<br>
Compute Node :<br>
$ ip link show<br>
$ ip route show<br>
$ ovs-vsctl show<br>
<br>
Regards,<br>
<br>
Jean-Baptiste RANSY
<div>
<div><br>
<br>
<br>
On 02/16/2013
05:32 PM,
Chathura M.
Sarathchandra
Magurawalage
wrote:<br>
</div>
</div>
</div>
<div>
<div>
<blockquote type="cite">
<div dir="ltr">Hello
Jean,
<div><br>
</div>
<div>Thanks
for your
reply.</div>
<div><br>
</div>
<div>I
followed the
instructions
in <a href="http://docs.openstack.org/folsom/basic-install/content/basic-install_network.html" target="_blank">http://docs.openstack.org/folsom/basic-install/content/basic-install_network.html</a>.
And my
Controller and
the
Network-node
is installed
in the same
physical node.</div>
<div><br>
</div>
<div>I am
using Folsom
but without
Network
namespaces. <br>
</div>
<div><br>
</div>
<div>But in
the website
you have
provided it
states that "<span style="font-size:13px;font-family:Verdana,Geneva,sans-serif">If you run
both L3 + DHCP
services on
the same node,
you should
enable
namespaces to
avoid
conflicts with
routes :</span>"</div>
<div><br>
</div>
<div>But
currently
quantum-dhcp-agent
and
quantum-l3-agent
are running in
the same
node? </div>
<div><br>
</div>
<div>Additionally
the control
node serves as
a DHCP server
for the local
network (
Don't know if
that would
make and
difference)</div>
<div><br>
</div>
<div>Any idea
what the
problem could
be?</div>
<div><br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
16 February
2013 16:21,
Jean-Baptiste
RANSY <span dir="ltr"><<a href="mailto:jean-baptiste.ransy@alyseo.com" target="_blank">jean-baptiste.ransy@alyseo.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div>Hello
Chathura,<br>
<br>
Are you using
Folsom with
Network
Namespaces ?<br>
<br>
If yes, have a
look here : <a href="http://docs.openstack.org/folsom/openstack-network/admin/content/ch_limitations.html" target="_blank">http://docs.openstack.org/folsom/openstack-network/admin/content/ch_limitations.html</a><br>
<br>
<br>
Regards,<br>
<br>
Jean-Baptsite
RANSY
<div>
<div><br>
<br>
<br>
On 02/16/2013
05:01 PM,
Chathura M.
Sarathchandra
Magurawalage
wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">Hello
guys,
<div><br>
</div>
<div>The
problem still
exists. Any
ideas?</div>
<div><br>
</div>
<div>Thanks </div>
<div class="gmail_extra">
<div>
<div dir="ltr">
<div><br>
</div>
</div>
</div>
<div class="gmail_quote">
On 15 February
2013 14:37,
Sylvain Bauza
<span dir="ltr"><<a href="mailto:sylvain.bauza@digimind.com" target="_blank">sylvain.bauza@digimind.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
Metadata API
allows to
fetch SSH
credentials
when booting
(pubkey I
mean).<br>
If a VM is
unable to
reach metadata
service, then
it won't be
able to get
its public
key, so you
won't be able
to connect,
unless you
specifically
go thru a
Password
authentication
(provided
password auth
is enabled in
/etc/ssh/sshd_config,
which is not
the case with
Ubuntu cloud
archive).<br>
There is also
a side effect,
the boot
process is
longer as the
instance is
waiting for
the curl
timeout
(60sec.) to
finish booting
up.<br>
<br>
Re: Quantum,
the metadata
API is
actually
DNAT'd from
Network node
to the
Nova-api node
(here
172.16.0.1 as
internal
management IP)
:<br>
Chain
quantum-l3-agent-PREROUTING
(1 references)
<div><br>
target
prot opt
source
destination<br>
</div>
DNAT tcp
-- <a href="http://0.0.0.0/0" target="_blank">0.0.0.0/0</a>
169.254.169.254
tcp
dpt:80 to:<a href="http://172.16.0.1:8775" target="_blank">172.16.0.1:8775</a><br>
<br>
<br>
Anyway, the
first step is
to :<br>
1. grab the
console.log<br>
2. access thru
VNC to the
desired
instance<br>
<br>
Troubleshooting
will be easier
once that
done.<br>
<br>
-Sylvain<br>
<br>
<br>
<br>
Le 15/02/2013
14:24,
Chathura M.
Sarathchandra
Magurawalage a
écrit :<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div> Hello
Guys,<br>
<br>
Not sure if
this is the
right port but
these are the
results:<br>
<br>
</div>
*Compute
node:*
<div><br>
<br>
root@computenode:~#
netstat -an |
grep 8775<br>
</div>
tcp 0
0 <a href="http://0.0.0.0:8775" target="_blank">0.0.0.0:8775</a> <<a href="http://0.0.0.0:8775" target="_blank">http://0.0.0.0:8775</a>>
0.0.0.0:*
LISTEN<br>
<br>
*Controller: *
<div><br>
<br>
root@controller:~#
netstat -an |
grep 8775<br>
</div>
tcp 0
0 <a href="http://0.0.0.0:8775" target="_blank">0.0.0.0:8775</a> <<a href="http://0.0.0.0:8775" target="_blank">http://0.0.0.0:8775</a>>
0.0.0.0:*
LISTEN<br>
<br>
*Additionally
I cant curl
169.254.169.254
from the
compute node.
I am not sure
if this is
related to not
being able to
PING the VM.*
<div><br>
<br>
curl -v <a href="http://169.254.169.254" target="_blank">http://169.254.169.254</a><br>
* About to
connect() to
169.254.169.254
port 80 (#0)<br>
* Trying
169.254.169.254...<br>
<br>
Thanks for
your help<br>
<br>
<br>
-----------------------------------------------------------------------------------------------------------------------------<br>
Chathura
Madhusanka
Sarathchandra
Magurawalage.<br>
1NW.2.1, Desk
2<br>
School of
Computer
Science and
Electronic
Engineering<br>
University Of
Essex<br>
United
Kingdom.<br>
<br>
</div>
Email: <a href="mailto:csarata@essex.ac.uk" target="_blank">csarata@essex.ac.uk</a>
<mailto:<a href="mailto:csarata@essex.ac.uk" target="_blank">csarata@essex.ac.uk</a>><br>
<a href="mailto:chathura.sarathchandra@gmail.com" target="_blank">chathura.sarathchandra@gmail.com</a>
<mailto:<a href="mailto:77.chathura@gmail.com" target="_blank">77.chathura@gmail.com</a>><br>
<a href="mailto:77.chathura@gmail.com" target="_blank">77.chathura@gmail.com</a>
<mailto:<a href="mailto:77.chathura@gmail.com" target="_blank">77.chathura@gmail.com</a>>
<div><br>
<br>
<br>
On 15 February
2013 11:03,
Anil Vishnoi
<<a href="mailto:vishnoianil@gmail.com" target="_blank">vishnoianil@gmail.com</a>
<mailto:<a href="mailto:vishnoianil@gmail.com" target="_blank">vishnoianil@gmail.com</a>>>
wrote:<br>
<br>
If you are
using ubuntu
cloud image
then the only
way to log-in
is<br>
to do ssh
with the
public key.
For that you
have to create
ssh key<br>
pair and
download the
ssh key. You
can create
this ssh pair
using<br>
horizon/cli.<br>
<br>
<br>
On Fri,
Feb 15, 2013
at 4:27 PM,
Sylvain Bauza<br>
</div>
<<a href="mailto:sylvain.bauza@digimind.com" target="_blank">sylvain.bauza@digimind.com</a>
<mailto:<a href="mailto:sylvain.bauza@digimind.com" target="_blank">sylvain.bauza@digimind.com</a>>>
<div> <br>
wrote:<br>
<br>
<br>
Le
15/02/2013
11:42,
Chathura M.
Sarathchandra
Magurawalage a<br>
écrit
:<br>
<br>
<br>
How can I log
into the VM
from VNC? What
are the
credentials?<br>
<br>
<br>
You
have multiple
ways to get
VNC access.
The easiest
one is<br>
thru
Horizon. Other
can be looking
at the KVM
command-line
for<br>
the
desired
instance (on
the compute
node) and
check the vnc<br>
port
in use
(assuming KVM
as
hypervisor).<br>
This
is basic
knowledge of
Nova.<br>
<br>
<br>
<br>
nova-api-metadata
is running
fine in the
compute node.<br>
<br>
<br>
Make
sure the
metadata port
is avaible
thanks to
telnet or<br>
netstat,
nova-api can
be running
without
listening on
metadata<br>
port.<br>
<br>
<br>
<br>
<br>
_______________________________________________<br>
Mailing list:
<a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/~openstack</a><br>
</div>
<<a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/%7Eopenstack</a>><br>
Post
to : <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
<mailto:<a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a>><br>
Unsubscribe :
<a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/~openstack</a><br>
<<a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/%7Eopenstack</a>>
<div><br>
More
help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><br>
<br>
<br>
<br>
<br>
--
Thanks &
Regards<br>
--Anil
Kumar Vishnoi<br>
<br>
<br>
</div>
</blockquote>
<br>
</blockquote>
</div>
<br>
</div>
</div>
<br>
<fieldset></fieldset>
<br>
</div>
</div>
<pre><div><div>_______________________________________________
Mailing list: <a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/~openstack</a></div></div><div>
Post to : <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a>
Unsubscribe : <a href="https://launchpad.net/%7Eopenstack" target="_blank">https://launchpad.net/~openstack</a>
More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a>
</div></pre>
</blockquote>
<br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<br>
</blockquote>
<br>
</blockquote>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div>
</blockquote></div><br></div></div>