hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Setting a larger block size at runtime in the DFSClient
Date Tue, 12 Apr 2011 14:08:59 GMT
Hey Jason,

On Tue, Apr 12, 2011 at 7:06 PM, Jason Rutherglen
<jason.rutherglen@gmail.com> wrote:
> Are there performance implications to setting the block size to 1 GB
> or higher (via the DFSClient.create method)?

You'll be streaming 1 complete GB per block to a DN with that value
(before the next block gets scheduled on another), shouldn't be any
differences beyond that.

Harsh J

View raw message