<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none"><!-- p { margin-top: 0px; margin-bottom: 0px; }--></style>
</head>
<body dir="ltr" style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<div class="_rp_g" tabindex="-1" style="font-family:'Segoe UI','Segoe WP','Segoe UI WPC',Tahoma,Arial,sans-serif; background-color:rgb(255,255,255)">
<div tabindex="-1" style="font-size: 16px; font-family: 'Segoe UI', 'Segoe WP', 'Segoe UI WPC', Tahoma, Arial, sans-serif; background-color: rgb(255, 255, 255);">
<div tabindex="-1">
<div tabindex="0">
<div class="_rp_H3" tabindex="-1" style="min-width: 350px; clear: both;">
<div tabindex="-1" class="_rp_w3 ms-border-color-neutralLight ShowReferenceAttachmentsLinks" style="border-color: rgb(234, 234, 234); min-height: 70px; border-bottom-width: 1px; border-bottom-style: solid; padding-bottom: 30px;">
<div class="_rp_x3" tabindex="-1" style="min-height: 70px; min-width: 200px; width: 976.233px; overflow: hidden;">
<div class="_rp_X">
<div class="_rp_91" style="margin-top: 15px; float: left; width: 976.233px;">
<div class="_rp_b1" id="ItemHeader.ToContainer" tabindex="-1" style="margin: 0px 0px 6px; clear: both; width: auto;">
<div class="rpHighlightAllClass rpHighlightAllRecipientsClass rpHighlightToClass _rp_a1" style="overflow: hidden;">
<div class="_rw_4" tabindex="0" style="line-height: 18px;">
<div class="_rw_3" style="top: 0px; bottom: 0px; display: inline;"><span class="_rw_5" style="display: inline-block; white-space: nowrap; font-size: 0px; vertical-align: top; height: 18px;"><span class="_rw_2" tabindex="-1" style="border-style: none; display: table-cell; padding-right: 8px;">
<div class="_pe_7 _pe_k _pe_8" tabindex="-1" style="outline: none; overflow: hidden; width: 165.556px; display: table; vertical-align: middle;">
<span class="_pe_b _pe_k _pe_41 bidi _pe_D ms-font-color-black ms-font-color-themePrimary-hover allowTextSelection" style="unicode-bidi: embed; direction: ltr; vertical-align: middle; display: table-cell; width: 165.556px; overflow: hidden; font-size: 12px; line-height: normal;"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">I'm
trying to ass</span><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">ign floating ips but they are not accessible on some instances.</span></span></div>
</span></span></div>
</div>
</div>
</div>
</div>
</div>
</div>
<div>
<div class="_rp_y3" id="Item.MessagePartBody" style="clear: both; top: -5px; width: auto; padding-top: 12px; word-wrap: break-word;">
<div class="_rp_z3 ms-font-weight-regular ms-font-color-neutralDark rpHighlightAllClass rpHighlightBodyClass" id="Item.MessageUniqueBody" tabindex="0" style="color: rgb(33, 33, 33); font-size: 15px; outline: none;">
<div class="rps_40b5">
<div dir="ltr" style="font-size: 12pt; color: rgb(0, 0, 0); font-family: Calibri, Arial, Helvetica, sans-serif;">
<p>Instance overview lists floating ip under IP Addresses, but when I take a look at the port on the subnet it has a status of N/A and Host = None, Profile = None, VIF Type = unbound, VIF Details = none, VNIC Type normal.<br>
</p>
<p><br>
</p>
<p>So I started investigating keepalived.conf for the HA router and noticed that it seems to be unable to bind to the virtual interfaces.<br>
</p>
<p><br>
</p>
<p>OpenStack Kilo<br>
</p>
<p>Ubuntu 14.04<br>
</p>
<p>2 Network Nodes<br>
</p>
<p>1 Controller<br>
</p>
<p>4 Compute Nodes<br>
</p>
<p><br>
</p>
<p>Network 1<br>
</p>
<div>Feb 3 12:15:20 network2 Keepalived[16193]: Starting VRRP child process, pid=16194</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: Interface queue is empty</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: No such interface, qg-18b1e1bc-10</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: Registering Kernel netlink reflector</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: Registering Kernel netlink command channel</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: Registering gratuitous ARP shared channel</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: Initializing ipvs 2.6</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: Opening file '/var/lib/neutron/ha_confs/c19a7d8b-5f93-4b1c-a507-6b3f380bd468/keepalived.conf'.</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: Configuration is using : 62880 Bytes</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: Using LinkWatch kernel netlink reflector...</div>
<div>Feb 3 12:15:20 network2 Keepalived_vrrp[16194]: VRRP_Instance(VR_1) Entering BACKUP STATE</div>
<div>Feb 3 12:15:23 network2 Keepalived_vrrp[16194]: Netlink: filter function error</div>
<div>Feb 3 12:15:23 network2 Keepalived_vrrp[16194]: Netlink: filter function error</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: Interface queue is empty</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: No such interface, qg-18b1e1bc-10</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: No such interface, qr-01280b44-f7</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: Registering Kernel netlink reflector</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: Registering Kernel netlink command channel</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: Registering gratuitous ARP shared channel</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: Initializing ipvs 2.6</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: Opening file '/var/lib/neutron/ha_confs/c19a7d8b-5f93-4b1c-a507-6b3f380bd468/keepalived.conf'.</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: Configuration is using : 62190 Bytes</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: Using LinkWatch kernel netlink reflector...</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: cant do IP_DROP_MEMBERSHIP errno=Bad file descriptor (9)</div>
<div>Feb 3 12:15:24 network2 Keepalived_vrrp[16194]: VRRP_Instance(VR_1) Entering BACKUP STATE</div>
<div>Feb 3 12:15:31 network2 Keepalived_vrrp[16194]: VRRP_Instance(VR_1) Transition to MASTER STATE</div>
<div>Feb 3 12:15:33 network2 Keepalived_vrrp[16194]: VRRP_Instance(VR_1) Entering MASTER STATE</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: Interface queue is empty</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: No such interface, qg-18b1e1bc-10</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: No such interface, qr-01280b44-f7</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: Registering Kernel netlink reflector</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: Registering Kernel netlink command channel</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: Registering gratuitous ARP shared channel</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: Initializing ipvs 2.6</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: Opening file '/var/lib/neutron/ha_confs/c19a7d8b-5f93-4b1c-a507-6b3f380bd468/keepalived.conf'.</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: Configuration is using : 62302 Bytes</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: Using LinkWatch kernel netlink reflector...</div>
<div>Feb 3 12:21:30 network2 Keepalived_vrrp[16194]: cant do IP_DROP_MEMBERSHIP errno=Bad file descriptor (9)</div>
<div>Feb 3 12:21:32 network2 Keepalived_vrrp[16194]: VRRP_Instance(VR_1) Transition to MASTER STATE<br>
</div>
<div><br>
</div>
<div>/var/lib/neutron/ha_confs/c19a7d8b-5f93-4b1c-a507-6b3f380bd468/keepalived.conf<br>
</div>
<div>
<div>vrrp_instance VR_1 {</div>
<div> state BACKUP</div>
<div> interface ha-4c437c18-33</div>
<div> virtual_router_id 1</div>
<div> priority 50</div>
<div> garp_master_repeat 5</div>
<div> garp_master_refresh 10</div>
<div> nopreempt</div>
<div> advert_int 2</div>
<div> track_interface {</div>
<div> ha-4c437c18-33</div>
<div> }</div>
<div> virtual_ipaddress {</div>
<div> 169.254.0.1/24 dev ha-4c437c18-33</div>
<div> }</div>
<div> virtual_ipaddress_excluded {</div>
<div> 10.10.21.103/24 dev qr-01280b44-f7</div>
<div> 157.157.9.118/24 dev qg-18b1e1bc-10</div>
<div> 157.157.9.119/32 dev qg-18b1e1bc-10</div>
<div> fe80::f816:3eff:fe3f:d0b9/64 dev qr-01280b44-f7 scope link</div>
<div> fe80::f816:3eff:fe91:5199/64 dev qg-18b1e1bc-10 scope link</div>
<div> }</div>
<div> virtual_routes {</div>
<div> 0.0.0.0/0 via 157.157.9.1 dev qg-18b1e1bc-10</div>
<div> }</div>
<div>}<br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div>ovs-vsctl show | grep -a1 qr-01280b44-f7</div>
<div> type: internal</div>
<div> Port "qr-01280b44-f7"</div>
<div> tag: 52</div>
<div> Interface "qr-01280b44-f7"</div>
<div> type: internal<br>
</div>
<br>
</div>
<div>ovs-vsctl show | grep -a1 qg-18b1e1bc-10</div>
<div> type: internal</div>
<div> Port "qg-18b1e1bc-10"</div>
<div> tag: 2</div>
<div> Interface "qg-18b1e1bc-10"</div>
<div> type: internal<br>
</div>
<br>
</div>
<div><br>
</div>
<p><br>
</p>
<p><br>
</p>
<p>Network 2<br>
</p>
<div>Feb 3 12:15:20 network3 Keepalived[16329]: Starting VRRP child process, pid=16330</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: Interface queue is empty</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: No such interface, qg-18b1e1bc-10</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: Registering Kernel netlink reflector</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: Registering Kernel netlink command channel</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: Registering gratuitous ARP shared channel</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: Initializing ipvs 2.6</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: Opening file '/var/lib/neutron/ha_confs/c19a7d8b-5f93-4b1c-a507-6b3f380bd468/keepalived.conf'.</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: Configuration is using : 62880 Bytes</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: Using LinkWatch kernel netlink reflector...</div>
<div>Feb 3 12:15:20 network3 Keepalived_vrrp[16330]: VRRP_Instance(VR_1) Entering BACKUP STATE</div>
<div>Feb 3 12:15:23 network3 Keepalived_vrrp[16330]: Netlink: filter function error</div>
<div>Feb 3 12:15:23 network3 Keepalived_vrrp[16330]: Netlink: filter function error</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: Interface queue is empty</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: No such interface, qg-18b1e1bc-10</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: No such interface, qr-01280b44-f7</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: Registering Kernel netlink reflector</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: Registering Kernel netlink command channel</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: Registering gratuitous ARP shared channel</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: Initializing ipvs 2.6</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: Opening file '/var/lib/neutron/ha_confs/c19a7d8b-5f93-4b1c-a507-6b3f380bd468/keepalived.conf'.</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: Configuration is using : 62190 Bytes</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: Using LinkWatch kernel netlink reflector...</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: cant do IP_DROP_MEMBERSHIP errno=Bad file descriptor (9)</div>
<div>Feb 3 12:15:24 network3 Keepalived_vrrp[16330]: VRRP_Instance(VR_1) Entering BACKUP STATE</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: Interface queue is empty</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: No such interface, qg-18b1e1bc-10</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: No such interface, qr-01280b44-f7</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: Registering Kernel netlink reflector</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: Registering Kernel netlink command channel</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: Registering gratuitous ARP shared channel</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: Initializing ipvs 2.6</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: Opening file '/var/lib/neutron/ha_confs/c19a7d8b-5f93-4b1c-a507-6b3f380bd468/keepalived.conf'.</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: Configuration is using : 62302 Bytes</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: Using LinkWatch kernel netlink reflector...</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: cant do IP_DROP_MEMBERSHIP errno=Bad file descriptor (9)</div>
<div>Feb 3 12:21:30 network3 Keepalived_vrrp[16330]: VRRP_Instance(VR_1) Entering BACKUP STATE<br>
</div>
<p><br>
</p>
<p>/var/lib/neutron/ha_confs/c19a7d8b-5f93-4b1c-a507-6b3f380bd468/keepalived.conf<br>
</p>
<div>vrrp_instance VR_1 {</div>
<div> state BACKUP</div>
<div> interface ha-bd7e248e-96</div>
<div> virtual_router_id 1</div>
<div> priority 50</div>
<div> garp_master_repeat 5</div>
<div> garp_master_refresh 10</div>
<div> nopreempt</div>
<div> advert_int 2</div>
<div> track_interface {</div>
<div> ha-bd7e248e-96<br>
</div>
<div> }</div>
<div> virtual_ipaddress {</div>
<div> 169.254.0.1/24 dev ha-bd7e248e-96</div>
<div> }</div>
<div> virtual_ipaddress_excluded {</div>
<div> 10.10.21.103/24 dev qr-01280b44-f7</div>
<div> 157.157.9.118/24 dev qg-18b1e1bc-10</div>
<div> 157.157.9.119/32 dev qg-18b1e1bc-10</div>
<div> fe80::f816:3eff:fe3f:d0b9/64 dev qr-01280b44-f7 scope link</div>
<div> fe80::f816:3eff:fe91:5199/64 dev qg-18b1e1bc-10 scope link</div>
<div> }</div>
<div> virtual_routes {</div>
<div> 0.0.0.0/0 via 157.157.9.1 dev qg-18b1e1bc-10</div>
<div> }</div>
<div>}<br>
</div>
<p><br>
</p>
<div>ovs-vsctl show | grep -a1 qr-01280b44-f7<br>
</div>
<div> Port "qr-01280b44-f7"</div>
<div> tag: 51</div>
<div> Interface "qr-01280b44-f7"</div>
<div> type: internal<br>
</div>
<div><br>
</div>
<div>
<div>ovs-vsctl show | grep -a1 qg-18b1e1bc-10</div>
<div> type: internal</div>
<div> Port "qg-18b1e1bc-10"</div>
<div> tag: 1</div>
<div> Interface "qg-18b1e1bc-10"</div>
<div> type: internal<br>
</div>
</div>
<div><br>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<div class="_rp_z" style="right:10px; top:13px"><button type="button" class="o365button ms-font-m _rp_p" title="Draga skilaboð saman" style="border-width:0px; padding:0px; font-family:'Segoe UI','Segoe WP','Segoe UI WPC',Tahoma,Arial,sans-serif; font-size:14px; color:rgb(51,51,51); top:-3px; right:-3px">
<span class="owaimg wf wf-size-x16 wf-owa-chevrons-up-grey wf-family-owa ms-font-color-neutralSecondary" style="color:rgb(102,102,102); font-family:o365Icons!important; font-size:16px!important"></span>
</button></div>
</div>
<div tabindex="-1" style="font-family:'Segoe UI','Segoe WP','Segoe UI WPC',Tahoma,Arial,sans-serif; background-color:rgb(255,255,255)">
<div tabindex="-1">
<div tabindex="0">
<div class="_rp_H3" tabindex="-1" style="min-width:350px; clear:both">
<div tabindex="-1" class="_rp_w3 ms-border-color-neutralLight ShowReferenceAttachmentsLinks" style="border-color:rgb(234,234,234); min-height:70px; border-bottom-width:1px; border-bottom-style:solid; padding-bottom:30px">
<div class="_rp_x3" tabindex="-1" style="min-height:70px; min-width:200px; width:976.233px; overflow:hidden">
<div class="_rp_X" style="">
<div class="_rp_y1" tabindex="-1" style="padding-top:32px; outline:none">
<div><button type="button" class="_rp_01 ms-font-s ms-font-weight-semibold o365button ms-font-m" tabindex="0" style="border-width:0px; padding:0px; font-family:'Segoe UI Semibold','Segoe WP Semibold','Segoe UI WPC Semibold','Segoe UI','Segoe WP',Tahoma,Arial,sans-serif; font-size:12px; color:rgb(51,51,51); font-weight:bold; float:right; margin-left:10px; margin-top:4px">
</button>
<div class="_rp_l1" style="float:left; max-width:71px; margin:4px 10px 0px 0px"></div>
</div>
</div>
<div class="_rp_91" style="margin-top:15px; float:left; width:976.233px">
<div class="_rp_b1" id="ItemHeader.ToContainer" tabindex="-1" style="margin:0px 0px 6px; clear:both; width:auto">
<div class="rpHighlightAllClass rpHighlightAllRecipientsClass rpHighlightToClass _rp_a1" style="overflow:hidden">
<div class="_rw_4" tabindex="0" style="line-height:18px">
<div class="_rw_3" style="top:0px; bottom:0px; display:inline"><span class="_rw_5" style="display:inline-block; white-space:nowrap; font-size:0px; vertical-align:top; height:18px"><span class="_rw_2" tabindex="-1" style="border-style:none; display:table-cell; padding-right:8px">
<div class="_pe_7 _pe_k _pe_8" tabindex="-1" style="outline:none; overflow:hidden; width:165.556px; display:table; vertical-align:middle">
<span class="_pe_b _pe_k _pe_41 bidi _pe_D ms-font-color-black ms-font-color-themePrimary-hover allowTextSelection" style="unicode-bidi:embed; direction:ltr; vertical-align:middle; display:table-cell; width:165.556px; overflow:hidden; font-size:12px; line-height:normal"><br>
</span></div>
</span></span></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>