hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Wittenauer <awittena...@linkedin.com>
Subject Re: Cluster Machines
Date Fri, 06 Nov 2009 16:53:03 GMT

On 11/6/09 4:04 AM, "Steve Loughran" <stevel@apache.org> wrote:
> Anyone been monitoring how much temp spaces the MR consumes, and got
> some stats to share?

It is so tied to how well tuned and the actual workload, that I'm not sure
stats are all that useful.  I went with 100gb mainly because I knew that one
of the biggest jobs at Yahoo! would consume that much.  In reality, LI could
probably get by with 10x less, esp since we have 8 drives instead of Y!'s 4.

View raw message