From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1Qyugt-0001xF-ET for garchives@archives.gentoo.org; Wed, 31 Aug 2011 23:59:31 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 305CB21C151; Wed, 31 Aug 2011 23:59:22 +0000 (UTC) Received: from mail-vw0-f53.google.com (mail-vw0-f53.google.com [209.85.212.53]) by pigeon.gentoo.org (Postfix) with ESMTP id B0C9621C036 for ; Wed, 31 Aug 2011 23:58:31 +0000 (UTC) Received: by vws13 with SMTP id 13so1232264vws.40 for ; Wed, 31 Aug 2011 16:58:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=4RBvwzAI5Iy34wBThIvMBtgbI/3+3tfcJaesAm0GAvg=; b=ZARuqaDvV0eh4FLs5FuuUfFL89pfALn0uFNyt57+i+xvdahcxZL2ukcMGLQlsNrgc+ n3NIj3CNnfyDjmp82zJqr2L0F13LU5vSkA7UJXcSVmH3wDFGRQFJ2o1berUNoDqwQXMM WwFtDgg7JuV4oPB9/6PkJJ54kba6fsr1wtDmI= Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Received: by 10.52.22.237 with SMTP id h13mr1005124vdf.228.1314835111161; Wed, 31 Aug 2011 16:58:31 -0700 (PDT) Received: by 10.220.178.194 with HTTP; Wed, 31 Aug 2011 16:58:31 -0700 (PDT) In-Reply-To: References: Date: Thu, 1 Sep 2011 09:58:31 +1000 Message-ID: Subject: Re: [gentoo-user] 10 G eth (10000) on Gentoo From: Adam Carter To: gentoo-user@lists.gentoo.org Content-Type: text/plain; charset=ISO-8859-1 X-Archives-Salt: X-Archives-Hash: 0726d62e793ecfa4cbdd0a064688eedf > I just might have an opportunity to setup a Gentoo > System using 10 G ethernet (fiber). The .39 > kernel lists this hardware [1]. > > Does anyone have any experience with this hardware? > Does it work? Did you make any bandwidth measurements? > What type of fiber (mulimode/singlemode) (ST/SC) did you > use? > > Any comments? Is the kernel a bottleneck or your application? Intel are active in linux kernel development and their linux drivers seem to be very good. When testing Intel copper gig interfaces on an intel firewall (HP DL380G5 8 core box), I was able to send a core to 100% with ~330Mb of small packets. The limiting factor appears to be packet rate, and the consequent processing of interrupts (1 irq to 1 core). I don't think that a 10Gig interface would pass any more than that due to similar limitations. Tweaking the e1000 driver options RxDescriptors, TxDescriptors and RxIntDelay pushed it up to ~350Mb. MSI was enabled so no interrupt sharing. So if you're running normal sized packets, you should be ok. Otherwise you way want to look at what irqbalance can do for you (I didn't try it at the time). Also don't forget stuff like Large Receive Offload in your kernel.