hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Loughran <ste...@apache.org>
Subject Re: Cluster Machines
Date Fri, 06 Nov 2009 12:04:21 GMT
Allen Wittenauer wrote:
> On 11/3/09 2:29 PM, "John Martyniak" <john@beforedawnsolutions.com> wrote:

>> So I take your point about the drives and Hadoop/HDFS being able to
>> handle what was necessary.  Since I don't have a pool, I should make
>> two volumes on one physical drive, something like 750 GB and 750 GB
>> and dedicate one for HDFS and one for MR.
> Waaaaaaaaaaaaaaay too much for MR.  But that's the idea.  We're currently
> toying with 100GB for MR.  Which is still -very- high.  [But we really don't
> know our workload that well..... soooo :) ]

Anyone been monitoring how much temp spaces the MR consumes, and got 
some stats to share?

View raw message