Thanks for the quick response Andi. If I ran 2 instances of netperf and I would get about half the bandwidth compared to running 1 instance of it. What's the difference between bonding mode0(round robin) and mode2 (XOR) ? I just played with setting one server from mode2 to mode0 and I am getting better numbers now, with 2 instances of netperf giving a sum of about 1200Mb/sec bandwidth, compared to 940Mb/sec before with the server configured with mode2 bonding. Running one netperf now gives about 650 to 800 Mb/sec. Is that the kind of numbers one should expect from typical gige switches? Thanks, adrian -----Original Message----- From: Andi Kleen [mailto:ak@suse.de] Sent: Monday, March 08, 2004 3:23 AM To: Adrian Wu Cc: suse-amd64@suse.com Subject: Re: [suse-amd64] ethernet bonding on SLES8 SP2 kernel 2.4.19-256 On Sun, Mar 07, 2004 at 03:53:14PM -0800, Adrian Wu wrote: > Hi all, > > I am building an opteron cluster. To increase node bandwidth, I am bonding 2 on-board ethernet nics in link aggregation (ie load-balancing) mode, mode 2. Although this was apparently done correctly, the bandwidth I got using netperf doesn't show anywhere near twice the performance compared to one nic. Use multiple TCP streams instead of a single one. Load balancing a single connection over multiple links would lead to reordered packets, which most protocols - including TCP - do not really like. Bounding avoids that by hashing connections to specific interfaces. -Andi -- Check the List-Unsubscribe header to unsubscribe For additional commands, email: suse-amd64-help@suse.com