<div dir="ltr">We were hoping that upgrading to Kilo might magically fix this, but we've still seen it occurring, although it seems to be happening less. Is it a database constraint that's supposed to stop this being possible ? I'm wondering if somehow through multiple upgrades we're missing something in the database. <br></div><div class="gmail_extra"><br><div class="gmail_quote">On 25 November 2015 at 00:21, Assaf Muller <span dir="ltr"><<a href="mailto:amuller@redhat.com" target="_blank">amuller@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">On Tue, Nov 24, 2015 at 5:26 PM, Matt Jarvis<br>
<<a href="mailto:matt.jarvis@datacentred.co.uk">matt.jarvis@datacentred.co.uk</a>> wrote:<br>
> Nope, the HA flag is definitely set to false. Here's another example :<br>
><br>
> root@osnet0:~# neutron l3-agent-list-hosting-router<br>
> be651d53-1dd2-46eb-8d57-7e2aafd6ff57<br>
><br>
> +--------------------------------------+--------+----------------+-------+<br>
><br>
> | id | host | admin_state_up | alive |<br>
><br>
> +--------------------------------------+--------+----------------+-------+<br>
><br>
> | 1be0209b-4750-4c8f-ade5-3a9dba640de3 | osnet2 | True | :-) |<br>
><br>
> | c821a370-b301-40c5-8b7b-25d147ffc904 | osnet1 | True | :-) |<br>
><br>
> +--------------------------------------+--------+----------------+-------+<br>
><br>
> root@osnet0:~# neutron router-show be651d53-1dd2-46eb-8d57-7e2aafd6ff57<br>
><br>
> +-----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+<br>
><br>
> | Field | Value<br>
> |<br>
><br>
> +-----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+<br>
><br>
> | admin_state_up | True<br>
> |<br>
><br>
> | distributed | False<br>
> |<br>
><br>
> | external_gateway_info | {"network_id":<br>
> "6751cb30-0aef-4d7e-94c3-ee2a09e705eb", "enable_snat": true,<br>
> "external_fixed_ips": [{"subnet_id": "2af591ca-48ac-42b7-afc6-e691b3aa4c8a",<br>
> "ip_address": "185.98.148.134"}]} |<br>
><br>
> | ha | False<br>
> |<br>
><br>
> | id | be651d53-1dd2-46eb-8d57-7e2aafd6ff57<br>
> |<br>
><br>
> | name | dpcbe-core<br>
> |<br>
><br>
> | routes |<br>
> |<br>
><br>
> | status | ACTIVE<br>
> |<br>
><br>
> | tenant_id | b28a8ac5bd7446adacfb60e1a3a3e723<br>
> |<br>
><br>
> +-----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+<br>
><br>
> It's also weird that we've only seen this when the environment has been<br>
> built using terraform. This particular customer re-creates the issue every<br>
> time they rebuild.<br>
<br>
</div></div>I don't know anything about Terraform so I can't help you there. I don't imagine<br>
there's any interesting errors/traces in the neutron-server logs?<br>
<div class="HOEnZb"><div class="h5"><br>
><br>
><br>
> On 24 November 2015 at 21:03, Assaf Muller <<a href="mailto:amuller@redhat.com">amuller@redhat.com</a>> wrote:<br>
>><br>
>> The HA routers feature we merged in Juno, and those are scheduled to<br>
>> multiple agents.<br>
>> If you source admin credentials and 'neutron router-show<br>
>> 951c8ec9-9a6c-4c6d-9d6d-049b3dee7f6f'<br>
>> is the 'HA' flag set to True? Otherwise, this is a really weird bug<br>
>> which I've never seen before.<br>
>><br>
>> On Tue, Nov 24, 2015 at 11:25 AM, Matt Jarvis<br>
>> <<a href="mailto:matt.jarvis@datacentred.co.uk">matt.jarvis@datacentred.co.uk</a>> wrote:<br>
>> > Hi All<br>
>> ><br>
>> > In the last week or so we've seen a couple of customer issues where a<br>
>> > router<br>
>> > is associated with more than one l3 agent, which obviously causes<br>
>> > significant connectivity weirdness.<br>
>> ><br>
>> > ❯ neutron l3-agent-list-hosting-router<br>
>> > 951c8ec9-9a6c-4c6d-9d6d-049b3dee7f6f<br>
>> ><br>
>> ><br>
>> > +--------------------------------------+--------+----------------+-------+<br>
>> ><br>
>> > | id | host | admin_state_up | alive<br>
>> > |<br>
>> ><br>
>> ><br>
>> > +--------------------------------------+--------+----------------+-------+<br>
>> ><br>
>> > | 48132c36-b6b1-40fa-b9d9-5474f4f27c3a | osnet0 | True | :-)<br>
>> > |<br>
>> ><br>
>> > | c821a370-b301-40c5-8b7b-25d147ffc904 | osnet1 | True | :-)<br>
>> > |<br>
>> ><br>
>> > +--------------------------------------+--------+----------------+———+<br>
>> ><br>
>> ><br>
>> > We've been unable to recreate it in testing, and the API doesn't let you<br>
>> > do<br>
>> > that. We think both customers are using Terraform, although that may be<br>
>> > irrelevant. Anyone seen this behaviour before ? We are running Juno BTW.<br>
>> ><br>
>> ><br>
>> > Matt<br>
>> ><br>
>> > --<br>
>> > Matt Jarvis<br>
>> > Head of Cloud Computing<br>
>> > DataCentred<br>
>> > Office: (+44)0161 8703985<br>
>> > Mobile: (+44)07983 725372<br>
>> > Email: <a href="mailto:matt.jarvis@datacentred.co.uk">matt.jarvis@datacentred.co.uk</a><br>
>> > Website: <a href="http://www.datacentred.co.uk" rel="noreferrer" target="_blank">http://www.datacentred.co.uk</a><br>
>> ><br>
>> > DataCentred Limited registered in England and Wales no. 05611763<br>
>> > _______________________________________________<br>
>> > OpenStack-operators mailing list<br>
>> > <a href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a><br>
>> > <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
>> ><br>
><br>
><br>
><br>
><br>
> --<br>
> Matt Jarvis<br>
> Head of Cloud Computing<br>
> DataCentred<br>
> Office: <a href="tel:%28%2B44%290161%208703985" value="+441618703985">(+44)0161 8703985</a><br>
> Mobile: <a href="tel:%28%2B44%2907983%20725372" value="+447983725372">(+44)07983 725372</a><br>
> Email: <a href="mailto:matt.jarvis@datacentred.co.uk">matt.jarvis@datacentred.co.uk</a><br>
> Website: <a href="http://www.datacentred.co.uk" rel="noreferrer" target="_blank">http://www.datacentred.co.uk</a><br>
><br>
> DataCentred Limited registered in England and Wales no. 05611763<br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr">Matt Jarvis<div>Head of Cloud Computing<br>DataCentred</div><div>Office: (+44)0161 8703985<br>Mobile: (+44)07983 725372</div><div>Email: <a href="mailto:matt.jarvis@datacentred.co.uk" target="_blank">matt.jarvis@datacentred.co.uk</a></div><div>Website: <a href="http://www.datacentred.co.uk" target="_blank">http://www.datacentred.co.uk</a></div></div></div>
</div>
<br>
<span style="color:rgb(34,34,34);font-family:arial,sans-serif;background-color:rgb(255,255,255)">DataCentred Limited registered in England and Wales no. 05611763</span>