hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alex Kozlov <ale...@cloudera.com>
Subject Re: BUG: Anyone use block size more than 2GB before?
Date Thu, 21 Oct 2010 20:30:57 GMT
Hmm, this is interesting: how did it manage to keep the blocks local?  Why
performance was better?

On Thu, Oct 21, 2010 at 11:43 AM, Owen O'Malley <omalley@apache.org> wrote:

> The block sizes were 2G. The input format made splits that were more than a
> block because that led to better performance.
>
> -- Owen
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message