hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zhong Wang <wangzhong....@gmail.com>
Subject Re: Cluster size for Linux file system
Date Thu, 10 Sep 2009 02:22:26 GMT
On Wed, Sep 9, 2009 at 1:31 AM, CubicDesign <cubicdesign@gmail.com> wrote:
> Which is the best disk cluster size for a Linux partition (let's say ext3)
> when using Hadoop on top of it?
> The default size is 4KB. It will Hadoop get an advantage if I format the
> disk cluster to 8 or 16KB, or even more?

I have not tested but some report point out that if the under
filesystem with a block size of 64KB (ext2), the performance will
increase 10% - 20%, because it promote sequence read/ write rate.


View raw message