Open Stack

On Tue, 2015-01-20 at 17:41 +0100, Tomasz Napierala wrote:
>[...]
> How this was measured? VM to VM? Compute to compute? 
iperf between compute/ceph-compute/ceph nodes.

> In any case, what is your deployment configuration, especially VLAND or GRE, networking gear, etc.
We have almost default setup from clean fuel 6.0, vlan based.
We are doing iperf based on 82599ES 10-Gigabit SFP+ interfaces (used in
our setup only for storage network) connected by fibre through Arista
7150.

Results on centos 6.5 deployed from fuel:
 0.0-10.0 sec  3.09 GBytes  2.65 Gbits/sec

Results on centos 6.5 from official site:
 0.0-10.0 sec  10.9 GBytes  9.38 Gbits/sec

In both cases tests were done with default tcp window size - 19.3KByte.
In both cases default mtu was with value 1500.

Commands used in test (after adding iperf tool from rpm):
  on one node:
    iperf -s -p 8777 
  on other node:
    iperf -c ip_address_of_server_in_storage_network -p 8777 -t 10

(port 8777 is one of passed as ACCEPT in iptables setup from fuel)

Differences are in kernel (from centos or from mirantis), values
in /etc/sysctl.conf (plain or from mirantis) and probably in cgroups
settings.

Probably in ~30 minutes we also will have results on plain centos with
mirantis kernel, and on fuel deployed centos with plain centos kernel
(2.6.32 in both cases, but with different patchset subnumber).

-- 
  Regards,
  jell