hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stas Oskin <stas.os...@gmail.com>
Subject Re: Recommended file-system for DataNode
Date Thu, 08 Oct 2009 17:12:48 GMT
Hi.

Thanks for the info, question is whether XFS performance justifies switching
from the more common Ext3?

JBOD is a great approach indeed.

Regards.

2009/10/8 Jason Venner <jason.hadoop@gmail.com>

> I have used xfs pretty extensively, it seemed to be somewhat faster than
> ext3.
>
> The only trouble we had related to some machines running the PAE 32 bit
> kernels, where we the filesystems lockup. That is an obscure use case
> however.
> Running JBOD with your dfs.data.dir listing a directory on each device
> speeds things up, as does keeping other users off of the disks/machine.
>
>
> On Thu, Oct 8, 2009 at 4:37 AM, Stas Oskin <stas.oskin@gmail.com> wrote:
>
> > Hi.
> >
> > I'm using the stock Ext3 as the most tested one, but I wonder, has
> someone
> > ever tried, or even using there days in production another file system,
> > like
> > JFS, XFS or even maybe Ext4?
> >
> > I'm exploring way to boost the performance of DataNodes, and this seems
> as
> > one of possible venues.
> >
> > Thanks for any info!
> >
>
>
>
> --
> Pro Hadoop, a book to guide you from beginner to hadoop mastery,
> http://www.amazon.com/dp/1430219424?tag=jewlerymall
> www.prohadoopbook.com a community for Hadoop Professionals
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message