<html><head><meta http-equiv="Content-Type" content="text/html charset=iso-8859-1"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Forgot to reply to all for others following this thread.<div><div><br></div><div>Suzuki-</div><div>This patch should fix your issue when using multiple subnets:</div><div><br><a href="https://review.openstack.org/#/c/12397/">https://review.openstack.org/#/c/12397/</a><br><div><div><br></div><div>If it does not, let me know.</div><div><br></div><div>mark</div><div><br></div><div>On Sep 5, 2012, at 1:58 AM, Dan Wendlandt <<a href="mailto:dan@nicira.com">dan@nicira.com</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">yes<br><br>On Tue, Sep 4, 2012 at 10:40 PM, Takaaki Suzuki <<a href="mailto:suzuki@midokura.com">suzuki@midokura.com</a>> wrote:<br><blockquote type="cite">Hi Mark.<br><br>Thank you for your comment.<br>I'll try again.<br><br>So, I just want to make sure.<br>Is this function support in Quantum folsom release?<br><br>Thanks!<br>Suzuki<br><br>On Wed, Sep 5, 2012 at 8:12 AM, Mark McClain <<a href="mailto:mark.mcclain@dreamhost.com">mark.mcclain@dreamhost.com</a>> wrote:<br><blockquote type="cite">I think we've isolated the problem. Until we can get the patch posted, try this workaround:<br><br>1) create the subnets<br>2) kill dnsmasq instance for the network<br>3) restart dhcp_agent<br><br>If this does not work, let me know,<br><br>mark<br><br>On Sep 4, 2012, at 6:47 PM, Takaaki Suzuki <<a href="mailto:suzuki@midokura.com">suzuki@midokura.com</a>> wrote:<br><br><blockquote type="cite">Thank you for investigate this problem.<br><br><blockquote type="cite">1. Can you send me the results of ps aux |grep dnsmasq<br></blockquote>nobody 12592 0.0 0.0 28812 1084 ? S Sep03 0:00<br>dnsmasq --no-hosts --no-resolv --strict-order --bind-interfaces<br>--interface=tapbd10a19b-a6 --except-interface=lo<br>--domain=openstacklocal<br>--pid-file=/opt/stack/data/dhcp/069f4cfc-3f97-4018-b08e-4a4868f3ca94/pid<br>--dhcp-hostsfile=/opt/stack/data/dhcp/069f4cfc-3f97-4018-b08e-4a4868f3ca94/host<br>--dhcp-optsfile=/opt/stack/data/dhcp/069f4cfc-3f97-4018-b08e-4a4868f3ca94/opts<br>--leasefile-ro --dhcp-range=set:tag0,192.168.10.0,static,120s<br><br><blockquote type="cite">2. Can you also please send the ifconfig. The tap devices for also ip<br>address. Can you please send me ip addr. (my gut feeling is that we do not<br>configure 192.168.30.2 but rather 192.168.10.2.<br></blockquote><br>- ifconfig<br>tap0118eb34-42 Link encap:Ethernet HWaddr de:fe:b2:24:cc:0f<br> inet6 addr: fe80::dcfe:b2ff:fe24:cc0f/64 Scope:Link<br> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1<br> RX packets:33 errors:0 dropped:0 overruns:0 frame:0<br> TX packets:33 errors:0 dropped:0 overruns:0 carrier:0<br> collisions:0 txqueuelen:500<br> RX bytes:4770 (4.7 KB) TX bytes:4770 (4.7 KB)<br><br>tap0e74b599-a1 Link encap:Ethernet HWaddr 36:42:91:96:44:14<br> inet6 addr: fe80::3442:91ff:fe96:4414/64 Scope:Link<br> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1<br> RX packets:7129 errors:0 dropped:0 overruns:0 frame:0<br> TX packets:7140 errors:0 dropped:0 overruns:0 carrier:0<br> collisions:0 txqueuelen:500<br> RX bytes:1763458 (1.7 MB) TX bytes:1699484 (1.6 MB)<br><br>tap0fb10fc2-62 Link encap:Ethernet HWaddr 92:bf:8b:95:b2:7b<br> inet6 addr: fe80::90bf:8bff:fe95:b27b/64 Scope:Link<br> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1<br> RX packets:27 errors:0 dropped:0 overruns:0 frame:0<br> TX packets:30 errors:0 dropped:0 overruns:0 carrier:0<br> collisions:0 txqueuelen:500<br> RX bytes:4302 (4.3 KB) TX bytes:3804 (3.8 KB)<br><br>tap38bea316-b0 Link encap:Ethernet HWaddr fa:68:38:20:63:60<br> inet6 addr: fe80::f868:38ff:fe20:6360/64 Scope:Link<br> UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1<br> RX packets:7091 errors:0 dropped:0 overruns:0 frame:0<br> TX packets:7009 errors:0 dropped:0 overruns:0 carrier:0<br> collisions:0 txqueuelen:500<br> RX bytes:1761232 (1.7 MB) TX bytes:1692872 (1.6 MB)<br><br>- ipaddr<br>1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN<br> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00<br> inet 127.0.0.1/8 scope host lo<br> inet6 ::1/128 scope host<br> valid_lft forever preferred_lft forever<br>2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000<br> link/ether d4:ae:52:67:54:a0 brd ff:ff:ff:ff:ff:ff<br> inet *.*.*.*/* brd 192.168.100.255 scope global eth0<br> inet6 fe80::d6ae:52ff:fe67:54a0/64 scope link<br> valid_lft forever preferred_lft forever<br>3: eth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000<br> link/ether d4:ae:52:67:54:a1 brd ff:ff:ff:ff:ff:ff<br>4: eth2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000<br> link/ether 00:1b:21:d8:ef:38 brd ff:ff:ff:ff:ff:ff<br>5: eth3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN qlen 1000<br> link/ether 00:1b:21:d8:ef:39 brd ff:ff:ff:ff:ff:ff<br>6: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue<br>state DOWN<br> link/ether 9e:9f:7d:e9:66:f9 brd ff:ff:ff:ff:ff:ff<br> inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0<br>18: tap8f8a93a5-68: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether 3a:2c:83:b2:a6:1f brd ff:ff:ff:ff:ff:ff<br>19: tap4002a239-42: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether 16:f5:da:f9:ad:a7 brd ff:ff:ff:ff:ff:ff<br>21: tap1be70123-2e: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether 52:4d:f8:0c:5e:8c brd ff:ff:ff:ff:ff:ff<br>22: tapbc94fdb2-97: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether 62:9a:d5:74:32:53 brd ff:ff:ff:ff:ff:ff<br>25: tap2142521d-5f: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether c2:5e:48:0a:7b:20 brd ff:ff:ff:ff:ff:ff<br>27: tap0c3e2dff-86: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether 76:8c:30:bc:f8:e4 brd ff:ff:ff:ff:ff:ff<br>28: tapcffed6f3-c7: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether 42:b4:fb:5e:48:05 brd ff:ff:ff:ff:ff:ff<br>31: tapb4d4ef2a-ae: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether 9a:03:a6:fc:b2:30 brd ff:ff:ff:ff:ff:ff<br>32: tap78dbef47-a5: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether c6:29:cc:f1:bb:53 brd ff:ff:ff:ff:ff:ff<br>33: tap1abc032d-e3: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether 1e:c5:b8:19:5f:ba brd ff:ff:ff:ff:ff:ff<br>34: tapa52d8c40-61: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast<br>state DOWN qlen 500<br> link/ether 62:fe:48:04:04:18 brd ff:ff:ff:ff:ff:ff<br>95: br-int: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN<br> link/ether a6:22:56:a0:13:4c brd ff:ff:ff:ff:ff:ff<br>108: tap0e74b599-a1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc<br>pfifo_fast state UP qlen 500<br> link/ether 36:42:91:96:44:14 brd ff:ff:ff:ff:ff:ff<br> inet6 fe80::3442:91ff:fe96:4414/64 scope link<br> valid_lft forever preferred_lft forever<br>109: tap38bea316-b0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc<br>pfifo_fast state UP qlen 500<br> link/ether fa:68:38:20:63:60 brd ff:ff:ff:ff:ff:ff<br> inet6 fe80::f868:38ff:fe20:6360/64 scope link<br> valid_lft forever preferred_lft forever<br>110: tap0118eb34-42: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc<br>pfifo_fast state UP qlen 500<br> link/ether de:fe:b2:24:cc:0f brd ff:ff:ff:ff:ff:ff<br> inet6 fe80::dcfe:b2ff:fe24:cc0f/64 scope link<br> valid_lft forever preferred_lft forever<br>111: tap0fb10fc2-62: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc<br>pfifo_fast state UP qlen 500<br> link/ether 92:bf:8b:95:b2:7b brd ff:ff:ff:ff:ff:ff<br> inet6 fe80::90bf:8bff:fe95:b27b/64 scope link<br> valid_lft forever preferred_lft forever<br>115: br-tun: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN<br> link/ether 5a:86:d9:8f:14:42 brd ff:ff:ff:ff:ff:ff<br><br>Hope this help.<br>Thanks!<br>Suzuki<br><br>On Tue, Sep 4, 2012 at 8:22 PM, Gary Kotton <<a href="mailto:gkotton@redhat.com">gkotton@redhat.com</a>> wrote:<br><blockquote type="cite">Hi,<br>Just a few more questions:<br>1. Can you send me the results of ps aux |grep dnsmasq<br>2. Can you also please send the ifconfig. The tap devices for also ip<br>address. Can you please send me ip addr. (my gut feeling is that we do not<br>configure 192.168.30.2 but rather 192.168.10.2.<br>Thanks<br>Gary<br><br><br>On 09/04/2012 12:56 PM, Takaaki Suzuki wrote:<br><blockquote type="cite"><blockquote type="cite"><br>Can you also please provide sudo ovs-vsctl show?<br></blockquote><br>sure.<br><br>midokura16:~/devstack# ovs-vsctl show<br>d699f1f2-792c-4eb9-8306-32a622316389<br> Bridge br-tun<br> Port br-tun<br> Interface br-tun<br> type: internal<br> Port patch-int<br> Interface patch-int<br> type: patch<br> options: {peer=patch-tun}<br> Bridge br-int<br> Port "tapee78cf13-65"<br> tag: 4<br> Interface "tapee78cf13-65"<br> type: internal<br> Port "tap0e74b599-a1"<br> tag: 3<br> Interface "tap0e74b599-a1"<br> Port "tapc2df9bdf-da"<br> tag: 1<br> Interface "tapc2df9bdf-da"<br> type: internal<br> Port "tapda44c6f5-b4"<br> tag: 3<br> Interface "tapda44c6f5-b4"<br> type: internal<br> Port br-int<br> Interface br-int<br> type: internal<br> Port patch-tun<br> Interface patch-tun<br> type: patch<br> options: {peer=patch-int}<br> Port "tap0fb10fc2-62"<br> tag: 2<br> Interface "tap0fb10fc2-62"<br> Port "tap0118eb34-42"<br> tag: 2<br> Interface "tap0118eb34-42"<br> Port "tapbd10a19b-a6"<br> tag: 2<br> Interface "tapbd10a19b-a6"<br> type: internal<br> Port "tap38bea316-b0"<br> tag: 3<br> Interface "tap38bea316-b0"<br> ovs_version: "1.6.1"<br><br>Thanks!<br>Suzuki<br><br>On Tue, Sep 4, 2012 at 6:52 PM, Gary Kotton<<a href="mailto:gkotton@redhat.com">gkotton@redhat.com</a>> wrote:<br><blockquote type="cite"><br>On 09/04/2012 12:48 PM, Takaaki Suzuki wrote:<br><blockquote type="cite"><br>Hi Gary<br><br>Thank you for your support.<br>I share with you information.<br></blockquote><br><br>Can you also please provide sudo ovs-vsctl show?<br><br>Thanks<br>Gary<br><br><blockquote type="cite"><blockquote type="cite">1. can you please do quantum port-list?<br></blockquote><br>quantum --os_token f095d7163a564456b60bf47b078537a7 --os_url<br><a href="http://localhost:9696/">http://localhost:9696/</a> port-list<br><br>- VM port<br>admin_state_up : True<br>device_id : d6f9eb16-fb54-4c6c-8c1f-dd7859696910<br>device_owner :<br>fixed_ips :{"subnet_id":<br>"2c6e941e-cf21-40c9-8f1a-37db0e2e9a46", "ip_address": "192.168.30.3"}<br>id : 0118eb34-424f-460e-8e12-42ecffb2dad8<br>mac_address : fa:16:3e:0d:e6:31<br>name :<br>network_id : 069f4cfc-3f97-4018-b08e-4a4868f3ca94<br>status : ACTIVE<br>tenant_id :cf67ba5e70e346b9a080fb349b5e1125<br><br>- DHCP agent port<br>admin_state_up : True<br>device_id :<br><br><br>dhcp72aca792-f411-52a0-a641-defa1b398574-069f4cfc-3f97-4018-b08e-4a4868f3ca94<br>device_owner : network:dhcp<br>fixed_ips : {"subnet_id":<br>"bf07d0cd-7abb-4bf0-83a2-dfc1f3c21f8e", "ip_address": "192.168.10.2"},<br>{"subnet_id": "2c6e941e-cf21-40c9-8f1a-37db0e2e9a46", "ip_address":<br>"192.168.30.2"}<br>id : bd10a19b-a679-4b65-b36b-7beffcdae1ba<br>mac_address : fa:16:3e:6c:f0:b5<br>name : DHCP Agent<br>network_id : 069f4cfc-3f97-4018-b08e-4a4868f3ca94<br>status : ACTIVE<br>tenant_id :cf67ba5e70e346b9a080fb349b5e1125<br><br><br><blockquote type="cite">2. Is the DHCP agent running (q-dhcp in stackrc)?<br></blockquote><br>Yes, DHCP agent running. I added "enable_service q-dhcp".<br><br><blockquote type="cite">3. How did you launch the VM's? Did you use nova boot --nic<br>net-id=quantum<br>network ID?<br></blockquote><br>I use Horizon for Quantum V2 (<a href="https://github.com/amotoki/horizon">https://github.com/amotoki/horizon</a>).<br><br><blockquote type="cite">4. Can you please check that the host files has the MAC address and IP<br>address of your VM - this is under /opt/stack/data/dhcp/<network id>/..<br></blockquote><br>midokura16:/opt/stack/data/dhcp/069f4cfc-3f97-4018-b08e-4a4868f3ca94#<br>cat<br>host<br>fa:16:3e:0d:e6:31,192-168-30-3.openstacklocal,192.168.30.3<br>fa:16:3e:6c:f0:b5,192-168-10-2.openstacklocal,192.168.10.2<br>fa:16:3e:6c:f0:b5,192-168-30-2.openstacklocal,192.168.30.2<br><br>- dnsmasq syslog when launch VM.<br>dnsmasq-dhcp[12592]: DHCPDISCOVER(tapbd10a19b-a6) fa:16:3e:0d:e6:31 no<br>address available<br>dnsmasq-dhcp[12592]: last message repeated 2 times<br>dnsmasq-dhcp[12592]: DHCPDISCOVER(tapbd10a19b-a6) fa:16:3e:15:62:6a no<br>address available<br>dnsmasq-dhcp[12592]: last message repeated 2 times<br><br>- sudo ip netns exec 069f4cfc-3f97-4018-b08e-4a4868f3ca94 ip link<br>104: tapbd10a19b-a6:<BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu<br>1500 qdisc noqueue state UNKNOWN<br> link/ether fa:16:3e:6c:f0:b5 brd ff:ff:ff:ff:ff:ff<br><br>- sudo ip netns exec 069f4cfc-3f97-4018-b08e-4a4868f3ca94 ip route<br>192.168.10.0/24 dev tapbd10a19b-a6 proto kernel scope link src<br>192.168.10.2<br>192.168.30.0/24 dev tapbd10a19b-a6 proto kernel scope link src<br>192.168.30.2<br><br>- quantum-dhcp agent spawn dnsmasq for test04 network<br>dnsmasq --no-hosts --no-resolv --strict-order --bind-interfaces<br>--interface=tapbd10a19b-a6 --except-interface=lo<br>--domain=openstacklocal<br>--pid-file=/opt/stack/data/dhcp/069f4cfc-3f97-4018-b08e-4a4868f3ca94/pid<br><br><br>--dhcp-hostsfile=/opt/stack/data/dhcp/069f4cfc-3f97-4018-b08e-4a4868f3ca94/host<br><br><br>--dhcp-optsfile=/opt/stack/data/dhcp/069f4cfc-3f97-4018-b08e-4a4868f3ca94/opts<br>--leasefile-ro --dhcp-range=set:tag0,192.168.10.0,static,120s<br><br>Hope that helped.<br>Thanks!<br><br>Suzuki<br><br>On Tue, Sep 4, 2012 at 6:13 PM, Gary Kotton<<a href="mailto:gkotton@redhat.com">gkotton@redhat.com</a>> wrote:<br><blockquote type="cite"><br>On 09/04/2012 12:03 PM, Takaaki Suzuki wrote:<br><blockquote type="cite"><br>Hi<br><br>Currently, I see that DHCP instance is created per network, at least<br>from looking at the Dnsmasq implementation.<br><br>I'm curious to know how a DHCP instance can provide services to a VM<br>attached to a port on a network that has multiple subnets.<br><br>It doesn't seem possible to me that a VM can get two IP addresses on<br>an interface from this DHCP server. Is this feature supported in<br>Quantum?<br><br>I ran a quick test using Devstack + QuantumV2 + OVS plugin. I created<br>one network called "test04", and two subnets for tor the network,<br>192.168.10.0/24 and 192.168.30.0/24.<br></blockquote><br>When a Quantum port is allocated an IP address is selected from one of<br>the<br>subnets configured on the network (unless the user has requested more<br>than<br>one IP address). The DHCP agent will learn this IP address and update<br>the<br>hosts file.<br><br>Can you please provide the following information:<br>1. can you please do quantum port-list?<br>2. Is the DHCP agent running (q-dhcp in stackrc)?<br>3. How did you launch the VM's? Did you use nova boot --nic<br>net-id=quantum<br>network ID?<br>4. Can you please check that the host files has the MAC address and IP<br>address of your VM - this is under /opt/stack/data/dhcp/<network id>/..<br><br>Thanks<br>Gary<br><blockquote type="cite"><br>With Dnsmasq running as the DHCP server, I launched a VM, and as<br>suspected, it did not receive any IP address. I checked the Dnsmasq<br>log and it looked like it did receive DHCPDISCOVER message but it did<br>not offer anything back.<br><br>I would love to know there is actually a way to get this to work, or<br>if I'm missing some critical steps here.<br><br>Thanks!<br>Suzuki<br><br>_______________________________________________<br>Mailing list: <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>Post to : <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>Unsubscribe : <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>More help : <a href="https://help.launchpad.net/ListHelp">https://help.launchpad.net/ListHelp</a><br></blockquote><br><br><br>_______________________________________________<br>Mailing list: <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>Post to : <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>Unsubscribe : <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>More help : <a href="https://help.launchpad.net/ListHelp">https://help.launchpad.net/ListHelp</a><br></blockquote></blockquote><br><br></blockquote></blockquote><br></blockquote><br>_______________________________________________<br>Mailing list: <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>Post to : <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>Unsubscribe : <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>More help : <a href="https://help.launchpad.net/ListHelp">https://help.launchpad.net/ListHelp</a><br></blockquote><br></blockquote><br>_______________________________________________<br>Mailing list: <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>Post to : <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>Unsubscribe : <a href="https://launchpad.net/~openstack">https://launchpad.net/~openstack</a><br>More help : <a href="https://help.launchpad.net/ListHelp">https://help.launchpad.net/ListHelp</a><br></blockquote><br><br><br>-- <br>~~~~~~~~~~~~~~~~~~~~~~~~~~~<br>Dan Wendlandt<br>Nicira, Inc: <a href="http://www.nicira.com">www.nicira.com</a><br>twitter: danwendlandt<br>~~~~~~~~~~~~~~~~~~~~~~~~~~~<br></blockquote></div><br></div></div></body></html>