hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dhruba Borthakur <dhr...@gmail.com>
Subject Re: Reason to store 64 block file in a sub directory?
Date Mon, 11 Oct 2010 21:59:19 GMT
The number is just an adhoc number. The policy is not to put too many block
files in the same directory because some local filesystems behave badly if
the number of files in the same directory exceed a certain value.

-dhruba


On Mon, Oct 11, 2010 at 1:15 PM, Thanh Do <thanhdo@cs.wisc.edu> wrote:

> Hi all,
>
> can anyone explain to me while do HDFS has the policy
>  to store 64 block files in a single sub directory?
> and if the number of block files increase,
> it just simply creates another subdir and put the block files there.
>
> Thanks
> Thanh
>



-- 
Connect to me at http://www.facebook.com/dhruba

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message