hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Venner <jason.had...@gmail.com>
Subject Re: Question about mapred.child.java.opts
Date Tue, 15 Sep 2009 02:35:16 GMT
For streaming, you just need enough space to the run the child that forks
and handles the streaming mapper/reducer and enough space to handle sorting
the date with out the task getting stuck in GC hell.

On Fri, Sep 11, 2009 at 12:30 PM, Mayuran Yogarajah <
mayuran.yogarajah@casalemedia.com> wrote:

> Is there any sense in setting mapred.child.java.opts to a high value
> if all we're using is Hadoop streaming ? We've set it to 512MB but
> I don't know if it even matters..
> thanks

Pro Hadoop, a book to guide you from beginner to hadoop mastery,
www.prohadoopbook.com a community for Hadoop Professionals

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message