hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: hdfs write partially
Date Mon, 28 Apr 2014 05:29:52 GMT
Packets are chunks of the input you try to pass to the HDFS writer. What
problem are you exactly facing (or, why are you trying to raise up the
client's write packet size)?


On Mon, Apr 28, 2014 at 8:52 AM, <tdhkx@126.com> wrote:

> Hello everyone,
>
>
>
> Since the default dfs.client-write-packet-size is 64K and it can't be
> bigger than 16M.
>
> So if write bigger than 16M a time, how to make sure it doesn't write
> partially ?
>
>
>
> Does anyone knows how to fix this?
>
>
>
> Thanks a lot.
>
>
>
> --
>
> Ken Huang
>



-- 
Harsh J

Mime
View raw message