hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thanh Do <than...@cs.wisc.edu>
Subject Re: Reason to store 64 block file in a sub directory?
Date Tue, 12 Oct 2010 00:38:50 GMT
Thanks guys,

That makes more sense to me now.

On Mon, Oct 11, 2010 at 4:59 PM, Dhruba Borthakur <dhruba@gmail.com> wrote:

> The number is just an adhoc number. The policy is not to put too many block
> files in the same directory because some local filesystems behave badly if
> the number of files in the same directory exceed a certain value.
>
> -dhruba
>
>
> On Mon, Oct 11, 2010 at 1:15 PM, Thanh Do <thanhdo@cs.wisc.edu> wrote:
>
> > Hi all,
> >
> > can anyone explain to me while do HDFS has the policy
> >  to store 64 block files in a single sub directory?
> > and if the number of block files increase,
> > it just simply creates another subdir and put the block files there.
> >
> > Thanks
> > Thanh
> >
>
>
>
> --
> Connect to me at http://www.facebook.com/dhruba
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message