<div dir="ltr">If the ARP request reaches the compute node, then you do already know tunnelling (or whatever transport type you're using) is not your problem.<div>The security group is also configured properly, so it does not seem something you need to worry about.</div><div><br></div><div>This leaves us with two possible problems:</div><div>1) did the dhcp agent give our VM an IP address?</div><div>To this aim, check if there is any error in the dhcp agent log. Check if your VM's MAC address is in the hosts file for the VM's network dnsmasq instance.</div><div>In case you should not be able to find the dnsmasq instance, then this would be the root cause of your problem.</div><div>2) did the ovs agent wire the port for your VM?</div><div>Find the ovs port associated with the VM's interface. If you are using ML2 with hybrid plugging the interface name should something like qvo-<port_id>.</div><div>Ensure a local vlan tag is attached to that port. If the vlan tag is 4095 then your port is on the "dead vlan" because the ovs agent recognized it as "alien". Check for errors in the ovs agent log.</div><div><br></div><div>However, the first thing you should do in my opinion is to check the VM log. It won't be the first time I blame the network and then find out that the VM image I was using was broken.</div><div>You don't need to have connectivity to access the VM console. nova console-proxy does that for you. Also, if you just want to see the vm console rather than interact with it, just use the command nova console-log <vm_id></div><div><br></div><div>Hope this helps,</div><div>Salvatore</div></div><div class="gmail_extra"><br><div class="gmail_quote">On 12 October 2014 19:26, Shashank Hegde <span dir="ltr"><<a href="mailto:hegde.shashank@gmail.com" target="_blank">hegde.shashank@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Danny,<div><br></div><div>You can ssh into your compute node with X forwarding:</div><div>ssh -X user@compute</div><div><br></div><div>You can then attach to the VM's console using the command:</div><div>vncviewer :<display-number></div><div><br></div><div>You can find the display number using the command:</div><div>ps aux | grep kvm</div><div>Look for vnc there. Its of the form <a href="http://127.0.0.1" target="_blank">127.0.0.1</a>:<display-number><br></div></div><div class="gmail_extra"><br clear="all"><div>~ Shashank<br></div>
<br><div class="gmail_quote"><div><div class="h5">On Sun, Oct 12, 2014 at 10:17 AM, Danny Choi (dannchoi) <span dir="ltr"><<a href="mailto:dannchoi@cisco.com" target="_blank">dannchoi@cisco.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5">
<div style="word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:Calibri,sans-serif">
<div>I do have security rule configured to allow ICMP.</div>
<div><br>
</div>
<div>
<p style="margin:0px;font-size:11px;font-family:Menlo">localadmin@qa4:~/devstack$ nova secgroup-list-rules default</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">+-------------+-----------+---------+-----------+--------------+</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| IP Protocol | From Port | To Port | IP Range | Source Group |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">+-------------+-----------+---------+-----------+--------------+</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| tcp | 22 | 22 | <a href="http://0.0.0.0/0" target="_blank">0.0.0.0/0</a> | |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| | | | | default |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| | | | | default |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| icmp | -1 | -1 | <a href="http://0.0.0.0/0" target="_blank">0.0.0.0/0</a> | |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">+-------------+-----------+---------+-----------+———————+</p>
<p style="margin:0px;font-size:11px;font-family:Menlo"><br>
</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">Danny</p>
</div>
<div><br>
</div>
<span>
<div style="font-family:Calibri;font-size:11pt;text-align:left;color:black;BORDER-BOTTOM:medium none;BORDER-LEFT:medium none;PADDING-BOTTOM:0in;PADDING-LEFT:0in;PADDING-RIGHT:0in;BORDER-TOP:#b5c4df 1pt solid;BORDER-RIGHT:medium none;PADDING-TOP:3pt">
<span style="font-weight:bold">From: </span>Remo Mattei <<a href="mailto:remo@italy1.com" target="_blank">remo@italy1.com</a>><br>
<span style="font-weight:bold">Date: </span>Sunday, October 12, 2014 at 1:00 PM<br>
<span style="font-weight:bold">To: </span>Danny Choi <<a href="mailto:dannchoi@cisco.com" target="_blank">dannchoi@cisco.com</a>><br>
<span style="font-weight:bold">Cc: </span>"<a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>" <<a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a>>, "<a href="mailto:openstack-dev@lists.openstack.org" target="_blank">openstack-dev@lists.openstack.org</a>"
<<a href="mailto:openstack-dev@lists.openstack.org" target="_blank">openstack-dev@lists.openstack.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [Openstack] [qa] How to troubleshoot why a VM at Compute node won't response to ARP request from Neutron router<br>
</div><div><div>
<div><br>
</div>
<div>
<div dir="auto">
<div>By default icmp is not allowed <br>
<br>
Inviato da <span style="background-color:rgba(255,255,255,0)">iPhone ()</span></div>
<div><br>
Il giorno 12/ott/2014, alle ore 09:25, Danny Choi (dannchoi) <<a href="mailto:dannchoi@cisco.com" target="_blank">dannchoi@cisco.com</a>> ha scritto:<br>
<br>
</div>
<blockquote type="cite">
<div>
<div style="font-size:14px;font-family:Calibri,sans-serif">Hi,</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">Using devstack to deploy OpenStack, I have Controller + Network running at one physical node and Compute at a separate node.</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">I launched a VM at the Compute node with a private address 10.0.0.2 (Neutron router interface is 10.0.0.1).</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">At the Controller node, in the qrouter namespace, I could not ping the VM private address 10.0.0.2.</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">At the Compute node, tcpdump of the tap interface indicated ARP requests were received.</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">However, it did not show any ARP response.</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">My understanding is that the VM’s virtual interface is directly connected to this tap interface. Since the VM is unreachable, I cannot</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">launch its console to see if the ARP requests are received at the virtual interface.</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">Any suggestions on how to troubleshoot this? </div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">
<p style="margin:0px;font-size:11px;font-family:Menlo">localadmin@qa4:~/devstack$ nova show vm1</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">+--------------------------------------+----------------------------------------------------------------+</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| Property | Value |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">+--------------------------------------+----------------------------------------------------------------+</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| OS-DCF:diskConfig | MANUAL |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| OS-EXT-AZ:availability_zone | nova |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| OS-EXT-STS:power_state | 1 |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| OS-EXT-STS:task_state | - |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| OS-EXT-STS:vm_state | active |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| OS-SRV-USG:launched_at | 2014-10-12T14:25:15.000000 |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| OS-SRV-USG:terminated_at | - |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| accessIPv4 | |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| accessIPv6 | |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| config_drive | |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| created | 2014-10-12T14:23:30Z |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| flavor | m1.tiny (1) |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| hostId | 00ac69883737ebd290ad4f38cae979a6e268902333261ba6bfbade44 |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| id | 04b5a345-cadf-4dee-9209-5bcf589b6a3c |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| image | cirros-0.3.2-x86_64-uec (14a55982-a093-4850-80c8-7b2ae3a7eaba) |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| key_name | - |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| metadata | {} |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| name | vm1 |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| os-extended-volumes:volumes_attached | [] |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| private network | 10.0.0.2, 172.29.173.5 |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| progress | 0 |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| security_groups | default |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| status | ACTIVE |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| tenant_id | 90058797dddc49efae4d1f45aa5ab982 |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| updated | 2014-10-12T14:23:39Z |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">| user_id | 5ab6344540974a1fbda5b539778ebe35 |</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">+--------------------------------------+----------------------------------------------------------------+</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">localadmin@qa4:~/devstack$ </p>
<p style="margin:0px;font-size:11px;font-family:Menlo">localadmin@qa4:~/devstack$ ip netns</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">qdhcp-f55f0683-830f-4523-82cb-46d638f91d47</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">qrouter-62aecbdd-d58d-4b33-a743-b16ca38544c5</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">localadmin@qa4:~/devstack$ </p>
<p style="margin:0px;font-size:11px;font-family:Menlo">localadmin@qa4:~/devstack$ </p>
<p style="margin:0px;font-size:11px;font-family:Menlo">localadmin@qa4:~/devstack$ sudo ip netns exec qrouter-62aecbdd-d58d-4b33-a743-b16ca38544c5 ping 10.0.0.2</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data.</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">From 10.0.0.1 icmp_seq=1 Destination Host Unreachable</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">From 10.0.0.1 icmp_seq=2 Destination Host Unreachable</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">From 10.0.0.1 icmp_seq=3 Destination Host Unreachable</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">From 10.0.0.1 icmp_seq=4 Destination Host Unreachable</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">From 10.0.0.1 icmp_seq=5 Destination Host Unreachable</p>
<p style="margin:0px;font-size:11px;font-family:Menlo">From 10.0.0.1 icmp_seq=6 Destination Host Unreachable</p>
<p style="margin:0px;font-size:11px;font-family:Menlo"><br>
</p>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div>
<p style="margin:0px"><font face="Times">localadmin@qa5:~/devstack$ sudo tcpdump -i tapade47169-57</font></p>
<p style="margin:0px"><font face="Times">tcpdump: WARNING: tapade47169-57: no IPv4 address assigned</font></p>
<p style="margin:0px"><font face="Times">tcpdump: verbose output suppressed, use -v or -vv for full protocol decode</font></p>
<p style="margin:0px"><font face="Times">listening on tapade47169-57, link-type EN10MB (Ethernet), capture size 65535 bytes</font></p>
<p style="margin:0px"><font face="Times">11:58:30.042379 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
<p style="margin:0px"><font face="Times">11:58:31.041840 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
<p style="margin:0px"><font face="Times">11:58:32.041848 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
<p style="margin:0px"><font face="Times">11:58:33.044212 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
<p style="margin:0px"><font face="Times">11:58:34.041866 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif"><br>
</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">Thanks,</div>
<div style="font-size:14px;font-family:Calibri,sans-serif">Danny</div>
!DSPAM:1,543aaefc201211675819574! </div>
</blockquote>
<blockquote type="cite">
<div><span>_______________________________________________</span><br>
<span>Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a></span><br>
<span>Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a></span><br>
<span>Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a></span><br>
<span></span><br>
<span></span><br>
<span>!DSPAM:1,543aaefc201211675819574!</span><br>
</div>
</blockquote>
</div>
</div>
</div></div></span>
</div>
<br></div></div>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div>
<br>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div>