[Openstack-operators] instance failing to dhcp using ip helper-address
Matt Rae
mattrae at gmail.com
Tue Apr 8 14:17:15 UTC 2014
Thanks Joe! I was able to get this to work by enabling 'option 82' on my
switch for the dhcp relay after being pointed to this thread for dnsmasq:
http://lists.thekelleys.org.uk/pipermail/dnsmasq-discuss/2011q3/005244.html
Specifically "dhcp-relay option 82 replace mac" worked for me.
Matt
On Tue, Apr 1, 2014 at 12:32 PM, Joe Topjian <joe at topjian.net> wrote:
> Not to pass the buck, but are you able to get this type of scenario
> working outside of OpenStack? For example: setting up your own dnsmasq
> service on vlan 104 and either a bare-metal server or vanilla kvm vm on
> vlan 103?
>
> This would at least confirm whether the problem is in nova or dnsmasq
> itself.
>
>
> On Tue, Apr 1, 2014 at 11:55 AM, Matt Rae <mattrae at gmail.com> wrote:
>
>> Hi I am trying to test a scenario where instances are not on the same
>> vlan as nova-network. Right now the instances are failing to dhcp. I'm
>> using nova-network with the flatdhcpmanager. I've configured a ip
>> helper-address on the instance vlan that forwards dhcp requests to
>> nova-network [1]. With dhcpdump I see the dhcpdiscover is making it to the
>> nova-network node, but dnsmasq is not responding to the request [2]. When
>> the instance is on the same vlan as nova-network, dnsmasq responds[3].
>>
>> Anybody have ideas of what might be going wrong? My current thought is
>> that maybe dnsmasq requires some additional option to respond to a request
>> originating from a different subnet. Here are dnsmasq processes running,
>> the networks I created and network configuration [4].
>>
>> Matt
>>
>> [1]
>>
>> ip routing
>> vlan 103
>> name "esx"
>> untagged 13-15,20
>> tagged 25
>> ip address 192.168.3.1 255.255.255.0
>> ip helper-address 192.168.2.3
>> exit
>> vlan 104
>> name "novanetwork"
>> untagged 19,21-22
>> ip address 192.168.2.1 255.255.255.0
>> exit
>>
>>
>> [2]
>>
>> $ sudo dhcpdump -i br100
>>
>> TIME: 2014-04-01 17:46:38.806
>> IP: 0.0.0.0 (e0:0:0:f:fa:60) > 255.255.255.255 (ff:ff:ff:ff:ff:ff)
>> OP: 1 (BOOTPREQUEST)
>> HTYPE: 1 (Ethernet)
>> HLEN: 6
>> HOPS: 0
>> XID: b004cb38
>> SECS: 0
>> FLAGS: 0
>> CIADDR: 0.0.0.0
>> YIADDR: 0.0.0.0
>> SIADDR: 0.0.0.0
>> GIADDR: 0.0.0.0
>> CHADDR: e0:00:00:0f:fa:60:00:00:00:00:00:00:00:00:00:00
>> SNAME: .
>> FNAME: .
>> OPTION: 53 ( 1) DHCP message type 1 (DHCPDISCOVER)
>> OPTION: 12 ( 7) Host name monarch
>> OPTION: 55 ( 17) Parameter Request List 1 (Subnet mask)
>> 28 (Broadcast address)
>> 2 (Time offset)
>> 3 (Routers)
>> 15 (Domainname)
>> 6 (DNS server)
>> 119 (Domain Search)
>> 12 (Host name)
>> 44 (NetBIOS name server)
>> 47 (NetBIOS scope)
>> 26 (Interface MTU)
>> 121 (Classless Static Route)
>> 42 (NTP servers)
>> 121 (Classless Static Route)
>> 249 (MSFT - Classless route)
>> 252 (MSFT - WinSock Proxy Auto Detect)
>> 42 (NTP servers)
>>
>>
>> ---------------------------------------------------------------------------
>>
>> TIME: 2014-04-01 17:46:40.596
>> IP: 0.0.0.0 (e0:0:0:f:fa:60) > 255.255.255.255 (ff:ff:ff:ff:ff:ff)
>> OP: 1 (BOOTPREQUEST)
>> HTYPE: 1 (Ethernet)
>> HLEN: 6
>> HOPS: 0
>> XID: b004cb38
>> SECS: 3
>> FLAGS: 0
>> CIADDR: 0.0.0.0
>> YIADDR: 0.0.0.0
>> SIADDR: 0.0.0.0
>> GIADDR: 0.0.0.0
>> CHADDR: e0:00:00:0f:fa:60:00:00:00:00:00:00:00:00:00:00
>> SNAME: .
>> FNAME: .
>> OPTION: 53 ( 1) DHCP message type 1 (DHCPDISCOVER)
>> OPTION: 12 ( 7) Host name monarch
>> OPTION: 55 ( 17) Parameter Request List 1 (Subnet mask)
>> 28 (Broadcast address)
>> 2 (Time offset)
>> 3 (Routers)
>> 15 (Domainname)
>> 6 (DNS server)
>> 119 (Domain Search)
>> 12 (Host name)
>> 44 (NetBIOS name server)
>> 47 (NetBIOS scope)
>> 26 (Interface MTU)
>> 121 (Classless Static Route)
>> 42 (NTP servers)
>> 121 (Classless Static Route)
>> 249 (MSFT - Classless route)
>> 252 (MSFT - WinSock Proxy Auto Detect)
>> 42 (NTP servers)
>>
>>
>> ---------------------------------------------------------------------------
>>
>> TIME: 2014-04-01 17:46:44.414
>> IP: 0.0.0.0 (e0:0:0:f:fa:60) > 255.255.255.255 (ff:ff:ff:ff:ff:ff)
>> OP: 1 (BOOTPREQUEST)
>> HTYPE: 1 (Ethernet)
>> HLEN: 6
>> HOPS: 0
>> XID: b004cb38
>> SECS: 6
>> FLAGS: 0
>> CIADDR: 0.0.0.0
>> YIADDR: 0.0.0.0
>> SIADDR: 0.0.0.0
>> GIADDR: 0.0.0.0
>> CHADDR: e0:00:00:0f:fa:60:00:00:00:00:00:00:00:00:00:00
>> SNAME: .
>> FNAME: .
>> OPTION: 53 ( 1) DHCP message type 1 (DHCPDISCOVER)
>> OPTION: 12 ( 7) Host name monarch
>> OPTION: 55 ( 17) Parameter Request List 1 (Subnet mask)
>> 28 (Broadcast address)
>> 2 (Time offset)
>> 3 (Routers)
>> 15 (Domainname)
>> 6 (DNS server)
>> 119 (Domain Search)
>> 12 (Host name)
>> 44 (NetBIOS name server)
>> 47 (NetBIOS scope)
>> 26 (Interface MTU)
>> 121 (Classless Static Route)
>> 42 (NTP servers)
>> 121 (Classless Static Route)
>> 249 (MSFT - Classless route)
>> 252 (MSFT - WinSock Proxy Auto Detect)
>> 42 (NTP servers)
>>
>>
>> ---------------------------------------------------------------------------
>>
>> TIME: 2014-04-01 17:46:50.463
>> IP: 0.0.0.0 (e0:0:0:f:fa:60) > 255.255.255.255 (ff:ff:ff:ff:ff:ff)
>> OP: 1 (BOOTPREQUEST)
>> HTYPE: 1 (Ethernet)
>> HLEN: 6
>> HOPS: 0
>> XID: b004cb38
>> SECS: 12
>> FLAGS: 0
>> CIADDR: 0.0.0.0
>> YIADDR: 0.0.0.0
>> SIADDR: 0.0.0.0
>> GIADDR: 0.0.0.0
>> CHADDR: e0:00:00:0f:fa:60:00:00:00:00:00:00:00:00:00:00
>> SNAME: .
>> FNAME: .
>> OPTION: 53 ( 1) DHCP message type 1 (DHCPDISCOVER)
>> OPTION: 12 ( 7) Host name monarch
>> OPTION: 55 ( 17) Parameter Request List 1 (Subnet mask)
>> 28 (Broadcast address)
>> 2 (Time offset)
>> 3 (Routers)
>> 15 (Domainname)
>> 6 (DNS server)
>> 119 (Domain Search)
>> 12 (Host name)
>> 44 (NetBIOS name server)
>> 47 (NetBIOS scope)
>> 26 (Interface MTU)
>> 121 (Classless Static Route)
>> 42 (NTP servers)
>> 121 (Classless Static Route)
>> 249 (MSFT - Classless route)
>> 252 (MSFT - WinSock Proxy Auto Detect)
>> 42 (NTP servers)
>>
>>
>> ---------------------------------------------------------------------------
>>
>> TIME: 2014-04-01 17:46:57.693
>> IP: 0.0.0.0 (e0:0:0:f:fa:60) > 255.255.255.255 (ff:ff:ff:ff:ff:ff)
>> OP: 1 (BOOTPREQUEST)
>> HTYPE: 1 (Ethernet)
>> HLEN: 6
>> HOPS: 0
>> XID: b004cb38
>> SECS: 20
>> FLAGS: 0
>> CIADDR: 0.0.0.0
>> YIADDR: 0.0.0.0
>> SIADDR: 0.0.0.0
>> GIADDR: 0.0.0.0
>> CHADDR: e0:00:00:0f:fa:60:00:00:00:00:00:00:00:00:00:00
>> SNAME: .
>> FNAME: .
>> OPTION: 53 ( 1) DHCP message type 1 (DHCPDISCOVER)
>> OPTION: 12 ( 7) Host name monarch
>> OPTION: 55 ( 17) Parameter Request List 1 (Subnet mask)
>> 28 (Broadcast address)
>> 2 (Time offset)
>> 3 (Routers)
>> 15 (Domainname)
>> 6 (DNS server)
>> 119 (Domain Search)
>> 12 (Host name)
>> 44 (NetBIOS name server)
>> 47 (NetBIOS scope)
>> 26 (Interface MTU)
>> 121 (Classless Static Route)
>> 42 (NTP servers)
>> 121 (Classless Static Route)
>> 249 (MSFT - Classless route)
>> 252 (MSFT - WinSock Proxy Auto Detect)
>> 42 (NTP servers)
>>
>>
>> ---------------------------------------------------------------------------
>>
>>
>>
>> [3]
>>
>> TIME: 2014-03-28 01:32:25.174
>> IP: 0.0.0.0 (fa:16:3e:b1:e1:16) > 255.255.255.255 (ff:ff:ff:ff:ff:ff)
>> OP: 1 (BOOTPREQUEST)
>> HTYPE: 1 (Ethernet)
>> HLEN: 6
>> HOPS: 0
>> XID: e1c7ef5b
>> SECS: 0
>> FLAGS: 0
>> CIADDR: 0.0.0.0
>> YIADDR: 0.0.0.0
>> SIADDR: 0.0.0.0
>> GIADDR: 0.0.0.0
>> CHADDR: fa:16:3e:b1:e1:16:00:00:00:00:00:00:00:00:00:00
>> SNAME: .
>> FNAME: .
>> OPTION: 53 ( 1) DHCP message type 1 (DHCPDISCOVER)
>> OPTION: 50 ( 4) Request IP address 10.34.104.76
>> OPTION: 55 ( 13) Parameter Request List 1 (Subnet mask)
>> 28 (Broadcast address)
>> 2 (Time offset)
>> 3 (Routers)
>> 15 (Domainname)
>> 6 (DNS server)
>> 119 (Domain Search)
>> 12 (Host name)
>> 44 (NetBIOS name server)
>> 47 (NetBIOS scope)
>> 26 (Interface MTU)
>> 121 (Classless Static Route)
>> 42 (NTP servers)
>>
>>
>> ---------------------------------------------------------------------------
>>
>> TIME: 2014-03-28 01:32:25.177
>> IP: 192.168.2.3 (52:54:0:7b:ae:bc) > 192.168.2.2 (fa:16:3e:b1:e1:16)
>> OP: 2 (BOOTPREPLY)
>> HTYPE: 1 (Ethernet)
>> HLEN: 6
>> HOPS: 0
>> XID: e1c7ef5b
>> SECS: 0
>> FLAGS: 0
>> CIADDR: 0.0.0.0
>> YIADDR: 192.168.2.2
>> SIADDR: 192.168.2.3
>> GIADDR: 0.0.0.0
>> CHADDR: fa:16:3e:b1:e1:16:00:00:00:00:00:00:00:00:00:00
>> SNAME: .
>> FNAME: .
>> OPTION: 53 ( 1) DHCP message type 2 (DHCPOFFER)
>> OPTION: 54 ( 4) Server identifier 192.168.2.3
>> OPTION: 51 ( 4) IP address leasetime 120 (2m)
>> OPTION: 58 ( 4) T1 60 (60s)
>> OPTION: 59 ( 4) T2 105 (1m45s)
>> OPTION: 1 ( 4) Subnet mask 255.255.255.0
>> OPTION: 28 ( 4) Broadcast address 192.168.2.255
>> OPTION: 3 ( 4) Routers 192.168.2.3
>> OPTION: 6 ( 4) DNS server 192.168.2.3
>> OPTION: 15 ( 9) Domainname novalocal
>> OPTION: 12 ( 3) Host name testinstance
>>
>> ---------------------------------------------------------------------------
>>
>> TIME: 2014-03-28 01:32:25.177
>> IP: 0.0.0.0 (fa:16:3e:b1:e1:16) > 255.255.255.255 (ff:ff:ff:ff:ff:ff)
>> OP: 1 (BOOTPREQUEST)
>> HTYPE: 1 (Ethernet)
>> HLEN: 6
>> HOPS: 0
>> XID: e1c7ef5b
>> SECS: 0
>> FLAGS: 0
>> CIADDR: 0.0.0.0
>> YIADDR: 0.0.0.0
>> SIADDR: 0.0.0.0
>> GIADDR: 0.0.0.0
>> CHADDR: fa:16:3e:b1:e1:16:00:00:00:00:00:00:00:00:00:00
>> SNAME: .
>> FNAME: .
>> OPTION: 53 ( 1) DHCP message type 3 (DHCPREQUEST)
>> OPTION: 54 ( 4) Server identifier 192.168.2.3
>> OPTION: 50 ( 4) Request IP address 192.168.2.2
>> OPTION: 55 ( 13) Parameter Request List 1 (Subnet mask)
>> 28 (Broadcast address)
>> 2 (Time offset)
>> 3 (Routers)
>> 15 (Domainname)
>> 6 (DNS server)
>> 119 (Domain Search)
>> 12 (Host name)
>> 44 (NetBIOS name server)
>> 47 (NetBIOS scope)
>> 26 (Interface MTU)
>> 121 (Classless Static Route)
>> 42 (NTP servers)
>>
>>
>> ---------------------------------------------------------------------------
>>
>> TIME: 2014-03-28 01:32:25.181
>> IP: 192.168.2.3 (52:54:0:7b:ae:bc) > 192.168.2.2 (fa:16:3e:b1:e1:16)
>> OP: 2 (BOOTPREPLY)
>> HTYPE: 1 (Ethernet)
>> HLEN: 6
>> HOPS: 0
>> XID: e1c7ef5b
>> SECS: 0
>> FLAGS: 0
>> CIADDR: 0.0.0.0
>> YIADDR: 192.168.2.2
>> SIADDR: 192.168.2.3
>> GIADDR: 0.0.0.0
>> CHADDR: fa:16:3e:b1:e1:16:00:00:00:00:00:00:00:00:00:00
>> SNAME: .
>> FNAME: .
>> OPTION: 53 ( 1) DHCP message type 5 (DHCPACK)
>> OPTION: 54 ( 4) Server identifier 192.168.2.3
>> OPTION: 51 ( 4) IP address leasetime 120 (2m)
>> OPTION: 58 ( 4) T1 60 (60s)
>> OPTION: 59 ( 4) T2 105 (1m45s)
>> OPTION: 1 ( 4) Subnet mask 255.255.255.0
>> OPTION: 28 ( 4) Broadcast address 192.168.2.255
>> OPTION: 3 ( 4) Routers 192.168.2.3
>> OPTION: 6 ( 4) DNS server 192.168.2.3
>> OPTION: 15 ( 9) Domainname novalocal
>> OPTION: 12 ( 3) Host name testinstance
>>
>> ---------------------------------------------------------------------------
>>
>>
>> [4]
>>
>> sudo nova-manage network create --label=private --fixed_range_v4=
>> 192.168.3.0/24 --num_networks=1 --network_size=256 --multi_host=T
>> --bridge_interface=eth1 --bridge=br100 --dns1=8.8.8.8
>>
>> $ ps aux | grep dnsmasq
>> 107 2067 0.0 0.0 25976 948 ? S 17:21 0:00
>> /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf
>> nobody 2440 0.0 0.0 27544 1036 ? S 17:21 0:00
>> /usr/sbin/dnsmasq --strict-order --bind-interfaces --conf-file=
>> --pid-file=/var/lib/nova/networks/nova-br100.pid
>> --listen-address=192.168.3.3 --except-interface=lo
>> --dhcp-range=set:private,192.168.3.2,static,255.255.255.0,120s
>> --dhcp-lease-max=256
>> --dhcp-hostsfile=/var/lib/nova/networks/nova-br100.conf
>> --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro --domain=novalocal
>> --no-hosts --addn-hosts=/var/lib/nova/networks/nova-br100.hosts
>> root 2441 0.0 0.0 27516 244 ? S 17:21 0:00
>> /usr/sbin/dnsmasq --strict-order --bind-interfaces --conf-file=
>> --pid-file=/var/lib/nova/networks/nova-br100.pid
>> --listen-address=192.168.3.3 --except-interface=lo
>> --dhcp-range=set:private,192.168.3.2,static,255.255.255.0,120s
>> --dhcp-lease-max=256
>> --dhcp-hostsfile=/var/lib/nova/networks/nova-br100.conf
>> --dhcp-script=/usr/bin/nova-dhcpbridge --leasefile-ro --domain=novalocal
>> --no-hosts --addn-hosts=/var/lib/nova/networks/nova-br100.hosts
>> ubuntu 3148 0.0 0.0 8112 896 pts/0 S+ 17:48 0:00 grep
>> --color=auto dnsmasq
>>
>>
>> $ ip addr
>> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue state UNKNOWN
>> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>> inet 127.0.0.1/8 scope host lo
>> inet 169.254.169.254/32 scope link lo
>> inet6 ::1/128 scope host
>> valid_lft forever preferred_lft forever
>> 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> master br0 state UP qlen 1000
>> link/ether 52:54:00:8c:e5:35 brd ff:ff:ff:ff:ff:ff
>> inet6 fe80::5054:ff:fe8c:e535/64 scope link
>> valid_lft forever preferred_lft forever
>> 3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
>> master br100 state UP qlen 1000
>> link/ether 52:54:00:7b:ae:bc brd ff:ff:ff:ff:ff:ff
>> inet6 fe80::5054:ff:fe7b:aebc/64 scope link
>> valid_lft forever preferred_lft forever
>> 4: br0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
>> link/ether 52:54:00:8c:e5:35 brd ff:ff:ff:ff:ff:ff
>> inet 192.168.1.23/24 brd 192.168.1.255 scope global br0
>> inet6 fe80::5054:ff:fe8c:e535/64 scope link
>> valid_lft forever preferred_lft forever
>> 5: br100: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state
>> UP
>> link/ether 52:54:00:7b:ae:bc brd ff:ff:ff:ff:ff:ff
>> inet 192.168.3.3/24 brd 192.168.3.255 scope global br100
>> inet6 fe80::d44e:e4ff:fe32:e4d/64 scope link
>> valid_lft forever preferred_lft forever
>> 7: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue
>> state DOWN
>> link/ether fa:2c:a4:32:84:e7 brd ff:ff:ff:ff:ff:ff
>> inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
>>
>>
>>
>> _______________________________________________
>> OpenStack-operators mailing list
>> OpenStack-operators at lists.openstack.org
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20140408/e1a84ea4/attachment.html>
More information about the OpenStack-operators
mailing list