From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1QywKl-0006uK-Tu for garchives@archives.gentoo.org; Thu, 01 Sep 2011 01:44:48 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 0527321C101; Thu, 1 Sep 2011 01:44:38 +0000 (UTC) Received: from mail-bw0-f53.google.com (mail-bw0-f53.google.com [209.85.214.53]) by pigeon.gentoo.org (Postfix) with ESMTP id 52C5C21C046 for ; Thu, 1 Sep 2011 01:43:34 +0000 (UTC) Received: by bkbzs8 with SMTP id zs8so1784755bkb.40 for ; Wed, 31 Aug 2011 18:43:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=SxLkSSAoD4/T62iItqqNTPoXrIMArR0ppmtmdZuZmwg=; b=WgrK8LmGhnxEnGz7wN48/VYj4cTdIkJ4x/rDSpSdE8Dq3sgmderzRAEM2cbOr2SJmL KEFvs/h5xWqyC0efS5KF5Sx05O6S/hTGg9TuRxieKmKyW8sOnA0RgQBS+sCnFz7BXBc1 5fYG97MiiMFNYqq1yTMKlUxHNF2b9r+76Y5EA= Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Received: by 10.204.4.138 with SMTP id 10mr598758bkr.374.1314841413427; Wed, 31 Aug 2011 18:43:33 -0700 (PDT) Received: by 10.204.37.140 with HTTP; Wed, 31 Aug 2011 18:43:33 -0700 (PDT) In-Reply-To: References: Date: Wed, 31 Aug 2011 21:43:33 -0400 Message-ID: Subject: Re: [gentoo-user] 10 G eth (10000) on Gentoo From: Michael Mol To: gentoo-user@lists.gentoo.org Content-Type: text/plain; charset=UTF-8 X-Archives-Salt: X-Archives-Hash: 4ce07190da5b7353e715b0bc7d7dc6fd On Wed, Aug 31, 2011 at 7:58 PM, Adam Carter wrote: >> I just might have an opportunity to setup a Gentoo >> System using 10 G ethernet (fiber). The .39 >> kernel lists this hardware [1]. >> >> Does anyone have any experience with this hardware? >> Does it work? Did you make any bandwidth measurements? >> What type of fiber (mulimode/singlemode) (ST/SC) did you >> use? >> >> Any comments? Is the kernel a bottleneck or your application? > > Intel are active in linux kernel development and their linux drivers > seem to be very good. > > When testing Intel copper gig interfaces on an intel firewall (HP > DL380G5 8 core box), I was able to send a core to 100% with ~330Mb of > small packets. The limiting factor appears to be packet rate, and the > consequent processing of interrupts (1 irq to 1 core). I don't think > that a 10Gig interface would pass any more than that due to similar > limitations. > > Tweaking the e1000 driver options RxDescriptors, TxDescriptors and > RxIntDelay pushed it up to ~350Mb. MSI was enabled so no interrupt > sharing. > > So if you're running normal sized packets, you should be ok. Otherwise > you way want to look at what irqbalance can do for you (I didn't try > it at the time). > > Also don't forget stuff like Large Receive Offload in your kernel. I've overheard IRC conversations that discussed multi-queue network cards in the context of multi-core systems. My educated guess, based on what you mention, is that each queue in the card would ping a different interrupt. Each interrupt might be handled by a different core, so you'd see a scaleable improvement there. -- :wq