hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stas Oskin <stas.os...@gmail.com>
Subject Re: Recommended file-system for DataNode
Date Fri, 09 Oct 2009 00:40:36 GMT
Hi Jason.

Brtfs is cool, I read that it has a 10% better performance then any other FS
coming next to it.

Can you post here the results of any your findings?

Regards.

2009/10/8 Jason Venner <jason.hadoop@gmail.com>

> Busy datanodes become bound by the metadata lookup times for the directory
> and inode entries required to open a block.
> Anything that optimizes that will help substantially.
>
> We are thinking of playing with brtfs, and using a small SSD for our file
> system metadata, and the spinning disks for the block storage.
>
>
> On Thu, Oct 8, 2009 at 10:26 AM, Tom Wheeler <tomwheel@gmail.com> wrote:
>
> > As an aside, there's a short article comparing the two in the latest
> > edition of Linux Journal.  It was hardly scientific, but the main
> > points were:
> >
> >  - XFS is faster than ext3, especially for large files
> >  - XFS is currently unsupported on Red Hat Enterprise, but apparently
> > will be soon.
> >
> > On Thu, Oct 8, 2009 at 12:12 PM, Stas Oskin <stas.oskin@gmail.com>
> wrote:
> > > Thanks for the info, question is whether XFS performance justifies
> > switching
> > > from the more common Ext3?
> >
> > --
> > Tom Wheeler
> > http://www.tomwheeler.com/
> >
>
>
>
> --
> Pro Hadoop, a book to guide you from beginner to hadoop mastery,
> http://www.amazon.com/dp/1430219424?tag=jewlerymall
> www.prohadoopbook.com a community for Hadoop Professionals
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message