hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron Kimball <aa...@cloudera.com>
Subject Re: newbie question
Date Mon, 10 Aug 2009 18:42:35 GMT
You can set it on a per-file basis if you'd like the control. The data
structures associated with files allow these to be individually controlled.
But there's also a  create() call that only accepts the Path to open as an
argument. This uses the configuration file defaults. This use case is
considerably more common in user applications.

- Aaron

On Mon, Aug 10, 2009 at 11:15 AM, hadooprcoks <hadooprocks@gmail.com> wrote:

> Hi,I was looking at the FileSystem API and have couple of quick questions
> for experts.
> In the FileSystem.create() call two of the parameters are bufferSize and
> blockSize.
>
> I understand they correspond to io.file.buffer.size and dfs.block.size
> properties in the config files.
>
> My question is - do we expect that applications can provide different
> values
> for them on a per file basis or usually its a cluster wide setting ?
>
> Thanks
> -Vineet
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message