hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David B. Ritch" <david.ri...@gmail.com>
Subject Re: Slowdown with Hadoop Sort benchmark when using Jumbo frames?
Date Fri, 29 Jan 2010 12:29:42 GMT
Have you looked at packet loss and retransmission rates?  When frames
are larger, a lost bit requires retransmission of more data.  It may be
that this happens under heavy load, such as when you're doing a large
transfer, but has less impact when testing individual file transfers.


On 1/29/2010 3:52 AM, stephen mulcahy wrote:
> Allen Wittenauer wrote:
>> We're working on a patch that monkeys with the TCP buffers because we're
>> seeing slow downs with big transfers as well.  It might be related...
> Kewl. Happy to test it out if our cluster hasn't moved into production
> at thate stage. Just drop me a mail.
> -stephen

View raw message