hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Edward Capriolo <edlinuxg...@gmail.com>
Subject Re: Optimal Filesystem (and Settings) for HDFS
Date Mon, 18 May 2009 18:33:32 GMT
Do not forget 'tune2fs -m 2'. By default this value gets set at 5%.
With 1 TB disks we got 33 GB more usable space. Talk about instant
savings!

On Mon, May 18, 2009 at 1:31 PM, Alex Loddengaard <alex@cloudera.com> wrote:
> I believe Yahoo! uses ext3, though I know other people have said that XFS
> has performed better in various benchmarks.  We use ext3, though we haven't
> done any benchmarks to prove its worth.
>
> This question has come up a lot, so I think it'd be worth doing a benchmark
> and writing up the results.  I haven't been able to find a detailed analysis
> / benchmark writeup comparing various filesystems, unfortunately.
>
> Hope this helps,
>
> Alex
>
> On Mon, May 18, 2009 at 8:54 AM, Bob Schulze <b.schulze@ecircle.com> wrote:
>
>> We are currently rebuilding our cluster - has anybody recommendations on
>> the underlaying file system? Just standard Ext3?
>>
>> I could imagine that the block size could be larger than its default...
>>
>> Thx for any tips,
>>
>>        Bob
>>
>>
>

Mime
View raw message