hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keren Ouaknine <ker...@gmail.com>
Subject memory configuration
Date Mon, 14 May 2012 09:57:17 GMT
Hello,

I keep on getting a memory error, these are my configuration and their
respective errors:
Few questions: why is physical memory set to 1.0GB when I actually have 47G
on these machines.
virtual memory is also limited to 2.1, even when I define the heap to be
higher?

Trying to get some clarity, these are the experiments I made:
scenario 1:
HADOOP_HEAPSIZE=2000 and  mapred.child.java.opts is set to 2048
Error:
Current usage: 585.0mb of 1.0gb physical memory used; 2.4gb of 2.1gb
virtual memory used. Killing container.

scenario 2:
HADOOP_HEAPSIZE=3000 and  mapred.child.java.opts is set to 1536
Error:
Current usage: 1.1gb of 1.0gb physical memory used; 1.9gb of 2.1gb virtual
memory used. Killing container.

Few questions, if you have a clue about the memory settings above, and can
advise for best configuration that would be very helpful.
Thanks!!

Thanks,
Keren

-- 
Keren Ouaknine
Web: www.kereno.com

Mime
View raw message