[gentoo-server] Can someone confirm? tg3 MTU issues.

[gentoo-server] Can someone confirm? tg3 MTU issues.

[Brett Curtis]

 have tried everything possible short of testing a different network card
 because I do not have one. I have delt with IMB support but since I run
 gentoo they are not much if any help at all. I compiled the drivers they
 provide with the same results. I tried booting from gentoo live disk.. I am
 running out of ideas. I have tried doing this on different network switches
 differnt cables... and still nothing.

 I can not lower the mtu on *any* on my Broadcom Corporation NetXtreme nics.
 I
 have 5 of these boxes! Same results on all.

 my test is this:
 
 ping -s 5000 somehost.inmy.lan

 works as expected.

 ifconfig eth0 mtu 1492
 ping -s 5000 somehost.inmy.lan

 nothing.. and of course I set my mtu back to 1500 everything works fine.

 I have done this same test with machines with different nics and everything
 works.

 I am building 2.6.20 now in hopes it may fix something.

 Any ideas?

 Thanks

-- 

Created with VIM & mutt.

  Our comedies are not to be laughed at. -Samuel Goldwyn

-- 
gentoo-server@gentoo.org mailing list

[gentoo-server] Re: Can someone confirm? tg3 MTU issues.

[Brett Curtis]

[-- Attachment #1: Type: text/plain, Size: 3058 bytes --]

Sorry to double post but I should have included this info.

mtu == 1500 for the following

ping -s 5000 172.17.187.220

tcpdump run on 172.17.187.220

tcpdump -n -i eth0 host 172.17.187.221

10:17:53.618060 IP 172.17.187.221 > 172.17.187.220: icmp
10:17:53.618062 IP 172.17.187.221 > 172.17.187.220: icmp
10:17:53.618065 IP 172.17.187.221 > 172.17.187.220: icmp
10:17:53.618095 IP 172.17.187.220 > 172.17.187.221: icmp 1480: echo reply
seq 4
10:17:53.618099 IP 172.17.187.220 > 172.17.187.221: icmp
10:17:53.618100 IP 172.17.187.220 > 172.17.187.221: icmp

now I lower the mtu

ifconfig eth0 mtu 1492
ping -s 5000 172.17.187.220

tcpdump run on 172.17.187.220

tcpdump -n -i eth0 host 172.17.187.221

10:20:03.185397 IP 172.17.187.221 > 172.17.187.220: icmp
10:20:03.185400 IP 172.17.187.221 > 172.17.187.220: icmp
10:20:03.185402 IP 172.17.187.221 > 172.17.187.220: icmp
10:20:03.185433 IP 172.17.187.220 > 172.17.187.221: icmp 1480: echo reply
seq 4
10:20:03.185436 IP 172.17.187.220 > 172.17.187.221: icmp
10:20:03.185438 IP 172.17.187.220 > 172.17.187.221: icmp
10:20:03.185440 IP 172.17.187.220 > 172.17.187.221: icmp

So as you can see they are the same however the reply never comes back as
proved by this tcpdump.

tcpdump run on 172.17.187.221
tcpdump -n -i eth0 host 172.17.187.22

10:24:51.105366 IP 172.17.187.221 > 172.17.187.220: icmp
10:24:51.105369 IP 172.17.187.221 > 172.17.187.220: icmp
10:24:51.105371 IP 172.17.187.221 > 172.17.187.220: icmp
10:24:51.105652 IP 172.17.187.220 > 172.17.187.221: icmp
10:24:52.105450 IP 172.17.187.221 > 172.17.187.220: ICMP echo request, id
42519, seq 3, length 1472
10:24:52.105455 IP 172.17.187.221 > 172.17.187.220: icmp
10:24:52.105456 IP 172.17.187.221 > 172.17.187.220: icmp
10:24:52.105458 IP 172.17.187.221 > 172.17.187.220: icmp
10:24:52.105669 IP 172.17.187.220 > 172.17.187.221: icmp
10:24:53.105545 IP 172.17.187.221 > 172.17.187.220: ICMP echo request, id
42519, seq 4, length 1472



On 2/6/07, Brett Curtis <dashnu.mutt@gmail.com> wrote:
>
> have tried everything possible short of testing a different network card
> because I do not have one. I have delt with IMB support but since I run
> gentoo they are not much if any help at all. I compiled the drivers they
> provide with the same results. I tried booting from gentoo live disk.. I
> am
> running out of ideas. I have tried doing this on different network
> switches
> differnt cables... and still nothing.
>
> I can not lower the mtu on *any* on my Broadcom Corporation NetXtreme
> nics.
> I
> have 5 of these boxes! Same results on all.
>
> my test is this:
>
> ping -s 5000 somehost.inmy.lan
>
> works as expected.
>
> ifconfig eth0 mtu 1492
> ping -s 5000 somehost.inmy.lan
>
> nothing.. and of course I set my mtu back to 1500 everything works fine.
>
> I have done this same test with machines with different nics and
> everything
> works.
>
> I am building 2.6.20 now in hopes it may fix something.
>
> Any ideas?
>
> Thanks
>
> --
>
> Created with VIM & mutt.
>
>   Our comedies are not to be laughed at. -Samuel Goldwyn
>
>

[-- Attachment #2: Type: text/html, Size: 5601 bytes --]

Re: [gentoo-server] Can someone confirm? tg3 MTU issues.

[frilled]

Hi there,
>  ifconfig eth0 mtu 1492
>  ping -s 5000 somehost.inmy.lan
>
>  nothing.. and of course I set my mtu back to 1500 everything works fine.
>
>  I have done this same test with machines with different nics and everything
>  works.
>   
I'm running about 15 servers on tg3 drivers with kernels ranging from
2.6.17 to 2.6.19. I just tested it on one machine with 2.6.19 and it
works as expected.

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Can someone confirm? tg3 MTU issues.

[Brett Curtis]

Ok, this is great. In saying that do you have any idea what I should look at?

Again same tests on any of my servers running different nics work fine
connected to the same switch. I have the latest nic firmware from ibm... I
guess it could be something else ibm specific?

These are the two cards I am having issues with.

Broadcom Corporation NetXtreme BCM5721
Broadcom Corporation NetXtreme BCM5703X

I probably should have noted that seeing the tg3 supports a wide range of
nics ..
Could you test on a machine using one of these cards or did you already?

thanks for the response.

On 07:12 Wed 07 Feb     , frilled wrote:
> Hi there,
> >  ifconfig eth0 mtu 1492
> >  ping -s 5000 somehost.inmy.lan
> >
> >  nothing.. and of course I set my mtu back to 1500 everything works fine.
> >
> >  I have done this same test with machines with different nics and everything
> >  works.
> >   
> I'm running about 15 servers on tg3 drivers with kernels ranging from
> 2.6.17 to 2.6.19. I just tested it on one machine with 2.6.19 and it
> works as expected.
> 
> -- 
> gentoo-server@gentoo.org mailing list

-- 

Created with VIM & mutt.

Man belongs wherever he wants to go.
		-- Wernher von Braun

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Can someone confirm? tg3 MTU issues.

[frilled]

Hi there,

> Ok, this is great. In saying that do you have any idea what I should look at?
>   
Sorry - if I had I'd have said it. Possibly really specific to some
hardware? It worked on BCM5751 and BCM5703X here. I could test a BCM5701
(that would be glass, I think), but that'd need some  time, since wiring
glass isn't really an easy thing to do here right now.

But the BCM5703X is the one giving you problems, and it works for me.
Those are actually the copper gbit cards in all our HP ProLiants.
Hmm. Very strange indeed. Your best guess might be a network tester
(like Fluke), I think. Does the switch log anything interesting to syslog?

Regards,

frilled

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] [Changed] Can someone confirm? tg3 IBM Xseries MTU issues.

[Brett Curtis]

Well thanks for testing this out for me. I appreciate it.

Also I changed the title in hopes to grab someone with an IBM xseries who
could test..

Also does anyone recommend another list I could post to in hopes of figuring
this out?

comments in line:

> On 14:36 Wed 07 Feb     , frilled wrote:
> Hi there,
> 
> > Ok, this is great. In saying that do you have any idea what I should look at?
> >   
> Sorry - if I had I'd have said it. Possibly really specific to some
> hardware? 

Yea I am truly at a lose right now and have no idea what it could be.

> It worked on BCM5751 and BCM5703X here. I could test a BCM5701
> (that would be glass, I think), but that'd need some  time, since wiring
> glass isn't really an easy thing to do here right now.
> 
> But the BCM5703X is the one giving you problems, and it works for me.
> Those are actually the copper gbit cards in all our HP ProLiants.
> Hmm. Very strange indeed. Your best guess might be a network tester
> (like Fluke), I think.

I will be looking into this.

> Does the switch log anything interesting to syslog?

This particular switch is a un-managed netgear Gigabit switch.. It does not
log to anything I have set up... But again other machines connect to this
switch work as expected.

> 
> Regards,
> 
> frilled

Thanks Again,
Brett

> 
> -- 
> gentoo-server@gentoo.org mailing list

-- 

Created with VIM & mutt.

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Can someone confirm? tg3 MTU issues.

[kashani]

Brett Curtis wrote:
> Ok, this is great. In saying that do you have any idea what I should look at?
> 
> Again same tests on any of my servers running different nics work fine
> connected to the same switch. I have the latest nic firmware from ibm... I
> guess it could be something else ibm specific?
> 
> These are the two cards I am having issues with.
> 
> Broadcom Corporation NetXtreme BCM5721
> Broadcom Corporation NetXtreme BCM5703X
> 
> I probably should have noted that seeing the tg3 supports a wide range of
> nics ..
> Could you test on a machine using one of these cards or did you already?
> 
> thanks for the response.

I'm seeing the same behavior on my Dell SC servers BCM5751 and BCM5721. 
2.6.17-gentoo-r4 in both cases. I might have a newer kernel I can try 
later. One thing to note is that both of these are PCI Express.

Oddly changing to MTU 1492 on the e1000 chips (82541GI) locks the 
interface for about 20-30 seconds before it responds again after which 
the ping -s 5000 does work. 2.6.19-gentoo-r5 on those servers and the 
Intel is PCI Express as well.

kashani

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Can someone confirm? tg3 MTU issues.

[Brett Curtis]

Hello
On 11:25 Wed 07 Feb     , kashani wrote:
> Brett Curtis wrote:
> >Ok, this is great. In saying that do you have any idea what I should look 
> >at?
> >
> >Again same tests on any of my servers running different nics work fine
> >connected to the same switch. I have the latest nic firmware from ibm... I
> >guess it could be something else ibm specific?
> >
> >These are the two cards I am having issues with.
> >
> >Broadcom Corporation NetXtreme BCM5721
> >Broadcom Corporation NetXtreme BCM5703X
> >
> >I probably should have noted that seeing the tg3 supports a wide range of
> >nics ..
> >Could you test on a machine using one of these cards or did you already?
> >
> >thanks for the response.
> 
> I'm seeing the same behavior on my Dell SC servers BCM5751 and BCM5721. 
> 2.6.17-gentoo-r4 in both cases.
> I might have a newer kernel I can try 
> later. One thing to note is that both of these are PCI Express.
> 

I have tried almost every kernel from 2.6.12 up to 20 still with no luck. All
of my nics that are failing when lowering the mtu are also on PCI Express.

> Oddly changing to MTU 1492 on the e1000 chips (82541GI) locks the 
> interface for about 20-30 seconds before it responds again after which 
> the ping -s 5000 does work. 2.6.19-gentoo-r5 on those servers and the 
> Intel is PCI Express as well.

Works fine with my intel nic. (82546EB) again also on PCI Express.


> 
> kashani

Thanks, I wonder where I should go now.. Wonder if its a tg3 kernel bug.
> 
> -- 
> gentoo-server@gentoo.org mailing list

-- 

Created with VIM & mutt.

I came home the other night and tried to open the door with my car keys...and 
the building started up.  So I took it out for a drive.  A cop pulled me over 
for speeding.  He asked me where I live... "Right here".
-- Steven Wright

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Can someone confirm? tg3 MTU issues.

[Matthias Bethke]

[-- Attachment #1: Type: text/plain, Size: 751 bytes --]

Hi Brett,
on Wednesday, 2007-02-07 at 08:11:19, you wrote:
> These are the two cards I am having issues with.
> 
> Broadcom Corporation NetXtreme BCM5721
> Broadcom Corporation NetXtreme BCM5703X

Seems I'm having the same problems with the latter chip. Early last year
I tried to enable jumbo frames on our ProLiant ML370 and some
workstations and didn't succeed. As it was just a nice-to-have I didn't
investigate any further and just switched back to MTU 1500, but now this
sounds very familiar. It was kernel 2.6.12-hardened or something back
then, I'll check again one of these days.

cheers!
	Matthias
-- 
I prefer encrypted and signed messages. KeyID: FAC37665
Fingerprint: 8C16 3F0A A6FC DF0D 19B0  8DEF 48D9 1700 FAC3 7665

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-server] Can someone confirm? tg3 MTU issues.

[Christian Affolter]

Hi!

>> These are the two cards I am having issues with.
>>
>> Broadcom Corporation NetXtreme BCM5721
>> Broadcom Corporation NetXtreme BCM5703X
> 
> Seems I'm having the same problems with the latter chip. Early last year
> I tried to enable jumbo frames on our ProLiant ML370 and some
> workstations and didn't succeed. As it was just a nice-to-have I didn't
> investigate any further and just switched back to MTU 1500, but now this
> sounds very familiar. It was kernel 2.6.12-hardened or something back
> then, I'll check again one of these days.
I've expected the same issue with the former NIC (NetXtreme BCM5721) 
while trying to increase the MTU value higher than 1500.
The Broadcom support confirmed that this NIC doesn't support jumbo frames :(

regards	
Chris
-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Can someone confirm? tg3 MTU issues.

[Matthias Bethke]

[-- Attachment #1: Type: text/plain, Size: 529 bytes --]

Hi Christian,
on Wednesday, 2007-02-21 at 20:15:02, you wrote:
> I've expected the same issue with the former NIC (NetXtreme BCM5721) while trying to increase the MTU value higher than 1500.
> The Broadcom support confirmed that this NIC doesn't support jumbo frames :(

Grmpf...ok, no use checking then. Looks like time to get a decent
ethernet card. Thanks for the info!

cheers!
	Matthias
-- 
I prefer encrypted and signed messages. KeyID: FAC37665
Fingerprint: 8C16 3F0A A6FC DF0D 19B0  8DEF 48D9 1700 FAC3 7665

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]