hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark <static.void....@gmail.com>
Subject Hadoop heap and other memory settings
Date Wed, 09 Mar 2011 17:47:51 GMT
How should I be configuring the heap and memory settings for my cluster?

Currently the only settings we use are:

HADOOP_HEAPSIZE=8192 (in hadoop-env.sh)
mapred.child.java.opts=8192 (in mapred-site.xml)

I have a feeling they settings are completely off. The only reason we 
increased it this high is because the mappers were throwing heap 
exceptions when running our FPGrowth job.

Should all the configuration go in hadoop-env.sh?

Thanks for any pointers

View raw message