Gentoo Archives: gentoo-cluster

From: t35t0r <t35t0r@×××××.com>
To: gentoo-cluster@l.g.o
Subject: [gentoo-cluster] Why don't I get a performance increase with the linux bonding driver in balance-alb mode in a "local network" configuration?
Date: Sat, 14 Feb 2009 06:40:30
Message-Id: 6b75ae110902132240y2294fd96g12a4b374f2d9e7c2@mail.gmail.com
1 I've got the following system:
2
3 Linux server 2.6.26 #5 SMP Fri Feb 6 12:18:54 CST 2009 ppc64 PPC970FX,
4 altivec supported RackMac3,1 GNU/Linux
5
6 Setup on a cisco gig switch with both gigabit NICs in the following setup:
7
8 % cat /proc/net/bonding/bond0
9 Ethernet Channel Bonding Driver: v3.2.5 (March 21, 2008)
10
11 Bonding Mode: adaptive load balancing
12 Primary Slave: None
13 Currently Active Slave: eth0
14 MII Status: up
15 MII Polling Interval (ms): 100
16 Up Delay (ms): 0
17 Down Delay (ms): 0
18
19 Slave Interface: eth0
20 MII Status: up
21 Link Failure Count: 0
22 Permanent HW addr: 00:0d:93:9e:2b:ca
23
24 Slave Interface: eth1
25 MII Status: up
26 Link Failure Count: 0
27 Permanent HW addr: 00:0d:93:9e:2b:cb
28
29 Both eth0 and eth1 are running at 1000Mb/s full according to ethtool.
30 I start netserver (from netperf) on the server and then run netperf on
31 four other singlegigabit connected clients on the same switch with:
32
33 netperf -l 45 -t TCP_STREAM -H server
34
35 but I get the following outputs:
36
37 client 1:
38
39 Recv Send Send
40 Socket Socket Message Elapsed
41 Size Size Size Time Throughput
42 bytes bytes bytes secs. 10^6bits/sec
43
44 87380 16384 16384 45.04 405.68
45
46 client 2:
47
48 Recv Send Send
49 Socket Socket Message Elapsed
50 Size Size Size Time Throughput
51 bytes bytes bytes secs. 10^6bits/sec
52
53 87380 16384 16384 45.01 216.07
54
55 client 3:
56
57 Recv Send Send
58 Socket Socket Message Elapsed
59 Size Size Size Time Throughput
60 bytes bytes bytes secs. 10^6bits/sec
61
62 87380 16384 16384 45.87 143.93
63
64 client 4:
65
66 Recv Send Send
67 Socket Socket Message Elapsed
68 Size Size Size Time Throughput
69 bytes bytes bytes secs. 10^6bits/sec
70
71 87380 16384 16384 45.05 164.05
72
73 adding those up gives me:
74
75 $ echo "405.68+216.07+143.93+164.05" | bc -l
76 929.73
77
78 Not more than 1gbps. Shouldn't I be able to get >> 1gbps with balance-alb mode?

Replies