hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: issues with decrease the default.block.size
Date Fri, 10 May 2013 05:27:59 GMT
Are you looking to decrease it to get more parallel map tasks out of
the small files? Are you currently CPU bound on processing these small

On Thu, May 9, 2013 at 9:12 PM, YouPeng Yang <yypvsxf19870706@gmail.com> wrote:
> hi ALL
>      I am going to setup a new hadoop  environment, .Because  of  there  are
> lots of small  files, I would  like to change  the  default.block.size to
> 16MB
> other than adopting the ways to merge  the files into large  enough (e.g
> using  sequencefiles).
>     I want to ask are  there  any bad influences or issues?
> Regards

Harsh J

View raw message