<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>Hi Danny,</div>
<div><br>
</div>
<div>Did your instance get its IP from DHCP? This may be seen in the console log using ‘nova console-log <instance_uuid>’. The output will vary depending on the instance's OS. To troubleshoot DHCP issues, use tcpdump across the different interfaces (taps, bridges,
physical interfaces) to verify DHCP is working properly using ‘tcpdump –I <interface> port 67 or port 68’. </div>
<div><br>
</div>
<div>James</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>"Danny Choi (dannchoi)" <<a href="mailto:dannchoi@cisco.com">dannchoi@cisco.com</a>><br>
<span style="font-weight:bold">Date: </span>Sunday, October 12, 2014 at 11:25 AM<br>
<span style="font-weight:bold">To: </span>"<a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a>" <<a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a>>, "<a href="mailto:openstack-dev@lists.openstack.org">openstack-dev@lists.openstack.org</a>"
<<a href="mailto:openstack-dev@lists.openstack.org">openstack-dev@lists.openstack.org</a>><br>
<span style="font-weight:bold">Subject: </span>[Openstack] [qa] How to troubleshoot why a VM at Compute node won't response to ARP request from Neutron router<br>
</div>
<div><br>
</div>
<div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0);">
<div style="font-size: 14px; font-family: Calibri, sans-serif;">Hi,</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">Using devstack to deploy OpenStack, I have Controller + Network running at one physical node and Compute at a separate node.</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">I launched a VM at the Compute node with a private address 10.0.0.2 (Neutron router interface is 10.0.0.1).</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">At the Controller node, in the qrouter namespace, I could not ping the VM private address 10.0.0.2.</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">At the Compute node, tcpdump of the tap interface indicated ARP requests were received.</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">However, it did not show any ARP response.</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">My understanding is that the VM’s virtual interface is directly connected to this tap interface. Since the VM is unreachable, I cannot</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">launch its console to see if the ARP requests are received at the virtual interface.</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">Any suggestions on how to troubleshoot this? </div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">localadmin@qa4:~/devstack$ nova show vm1</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">+--------------------------------------+----------------------------------------------------------------+</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| Property | Value |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">+--------------------------------------+----------------------------------------------------------------+</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| OS-DCF:diskConfig | MANUAL |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| OS-EXT-AZ:availability_zone | nova |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| OS-EXT-STS:power_state | 1 |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| OS-EXT-STS:task_state | - |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| OS-EXT-STS:vm_state | active |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| OS-SRV-USG:launched_at | 2014-10-12T14:25:15.000000 |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| OS-SRV-USG:terminated_at | - |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| accessIPv4 | |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| accessIPv6 | |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| config_drive | |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| created | 2014-10-12T14:23:30Z |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| flavor | m1.tiny (1) |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| hostId | 00ac69883737ebd290ad4f38cae979a6e268902333261ba6bfbade44 |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| id | 04b5a345-cadf-4dee-9209-5bcf589b6a3c |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| image | cirros-0.3.2-x86_64-uec (14a55982-a093-4850-80c8-7b2ae3a7eaba) |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| key_name | - |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| metadata | {} |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| name | vm1 |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| os-extended-volumes:volumes_attached | [] |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| private network | 10.0.0.2, 172.29.173.5 |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| progress | 0 |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| security_groups | default |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| status | ACTIVE |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| tenant_id | 90058797dddc49efae4d1f45aa5ab982 |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| updated | 2014-10-12T14:23:39Z |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">| user_id | 5ab6344540974a1fbda5b539778ebe35 |</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">+--------------------------------------+----------------------------------------------------------------+</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">localadmin@qa4:~/devstack$ </p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">localadmin@qa4:~/devstack$ ip netns</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">qdhcp-f55f0683-830f-4523-82cb-46d638f91d47</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">qrouter-62aecbdd-d58d-4b33-a743-b16ca38544c5</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">localadmin@qa4:~/devstack$ </p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">localadmin@qa4:~/devstack$ </p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">localadmin@qa4:~/devstack$ sudo ip netns exec qrouter-62aecbdd-d58d-4b33-a743-b16ca38544c5 ping 10.0.0.2</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data.</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">From 10.0.0.1 icmp_seq=1 Destination Host Unreachable</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">From 10.0.0.1 icmp_seq=2 Destination Host Unreachable</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">From 10.0.0.1 icmp_seq=3 Destination Host Unreachable</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">From 10.0.0.1 icmp_seq=4 Destination Host Unreachable</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">From 10.0.0.1 icmp_seq=5 Destination Host Unreachable</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">From 10.0.0.1 icmp_seq=6 Destination Host Unreachable</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;"><br>
</p>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div>
<p style="margin: 0px;"><font face="Times">localadmin@qa5:~/devstack$ sudo tcpdump -i tapade47169-57</font></p>
<p style="margin: 0px;"><font face="Times">tcpdump: WARNING: tapade47169-57: no IPv4 address assigned</font></p>
<p style="margin: 0px;"><font face="Times">tcpdump: verbose output suppressed, use -v or -vv for full protocol decode</font></p>
<p style="margin: 0px;"><font face="Times">listening on tapade47169-57, link-type EN10MB (Ethernet), capture size 65535 bytes</font></p>
<p style="margin: 0px;"><font face="Times">11:58:30.042379 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
<p style="margin: 0px;"><font face="Times">11:58:31.041840 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
<p style="margin: 0px;"><font face="Times">11:58:32.041848 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
<p style="margin: 0px;"><font face="Times">11:58:33.044212 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
<p style="margin: 0px;"><font face="Times">11:58:34.041866 ARP, Request who-has 10.0.0.2 tell 10.0.0.1, length 42</font></p>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;"><br>
</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">Thanks,</div>
<div style="font-size: 14px; font-family: Calibri, sans-serif;">Danny</div>
</div>
</div>
</span>
</body>
</html>