Open Stack

On 5/16/19 8:29 PM, Yi Yang (杨燚)-云服务集团 wrote:
> Thanks Brian, your explanation clarified something, but I don't get the answer if we can have multiple compute nodes are configured to dvr_snat, for this case, SNAT IPs are obviously different. Why do we want to use network node if compute node can do everything?

Hi Yi,

There will only be one DVR SNAT IP allocated for a router on the 
external network, and only one router scheduled using it, so having 
dvr_snat mode on a compute node doesn't mean that North/South router 
will be local, only the East/West portion might be.

Typically people choose to place these on separate systems since the 
requirements of the role are different - network node could have fewer 
cores and a 10G nic for higher bandwidth, compute node could have lots 
of cores for instances but maybe a 1G nic.  There's no reason you can't 
run dvr_snat everywhere, I would just say it's not common.

-Brian


> -----邮件原件-----
> 发件人: Brian Haley [mailto:haleyb.dev at gmail.com]
> 发送时间: 2019年5月16日 21:46
> 收件人: Yi Yang (杨燚)-云服务集团 <yangyi01 at inspur.com>
> 抄送: openstack-discuss at lists.openstack.org
> 主题: Re: [DVR config] Can we use drv_snat agent_mode in every compute node?
> 
> Hi Yi,
> 
> I'm a little confused by the question, comments inline.
> 
> On 5/15/19 11:47 PM, Yi Yang (杨燚)-云服务集团 wrote:
>> Hi, folks
>>
>> I saw somebody discussed distributed SNAT, but finally they didn’t
>> make agreement on how to implement distributed SNAT, my question is
>> can we use dvr_snat agent_mode in compute node? I understand dvr_snat
>> only does snat but doesn’t do east west routing, right? Can we set
>> dvr_snat and dvr in one compute node at the same time? It is
>> equivalent to distributed SNAT if we can set drv_snat in every compute
>> node, isn’t right? I know Opendaylight can do SNAT in compute node in
>> distributed way, but one external router only can run in one compute node.
> 
> Distributed SNAT is not available in neutron, there was a spec proposed recently though, https://review.opendev.org/#/c/658414
> 
> Regarding the agent_mode setting for L3, only one mode can be set at a time.  Typically 'dvr_snat' is used on network nodes and 'dvr' on compute nodes because it leads to less resource usage (i.e. namespaces).
>    The centralized part of the router hosting the default SNAT IP address will only be scheduled to one of the agents in 'dvr_snat' mode.  All the DVR modes can do East/West routing when an instance is scheduled to the node, and two can do North/South - 'dvr_snat' using the default SNAT IP, and 'dvr' using a floating IP.  'dvr_no_external' can only do East/West.
> 
> Hopefully that clarifies things.
> 
> -Brian
> 
>> I also see https://wiki.openstack.org/wiki/Dragonflow is trying to
>> implement distributed SNAT, what are technical road blocks for
>> distributed SNAT in openstack dvr? Do we have any good way to remove
>> these road blocks?
>>
>> Thank you in advance and look forward to getting your replies and insights.
>>
>> Also attached official drv configuration guide for your reference.
>>
>> https://docs.openstack.org/neutron/stein/configuration/l3-agent.html
>>
>> |agent_mode|¶
>> <https://docs.openstack.org/neutron/stein/configuration/l3-agent.html#
>> DEFAULT.agent_mode>
>>
>> Type
>>
>> string
>>
>> Default
>>
>> legacy
>>
>> Valid Values
>>
>> dvr, dvr_snat, legacy, dvr_no_external
>>
>> The working mode for the agent. Allowed modes are: ‘legacy’ - this
>> preserves the existing behavior where the L3 agent is deployed on a
>> centralized networking node to provide L3 services like DNAT, and SNAT.
>> Use this mode if you do not want to adopt DVR. ‘dvr’ - this mode
>> enables DVR functionality and must be used for an L3 agent that runs
>> on a compute host. ‘dvr_snat’ - this enables centralized SNAT support
>> in conjunction with DVR. This mode must be used for an L3 agent
>> running on a centralized node (or in single-host deployments, e.g. devstack).
>> ‘dvr_no_external’ - this mode enables only East/West DVR routing
>> functionality for a L3 agent that runs on a compute host, the
>> North/South functionality such as DNAT and SNAT will be provided by
>> the centralized network node that is running in ‘dvr_snat’ mode. This
>> mode should be used when there is no external network connectivity on
>> the compute host.
>>