hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "WritingYarnApps" by ChrisRiccomini
Date Wed, 21 Sep 2011 23:01:00 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "WritingYarnApps" page has been changed by ChrisRiccomini:
http://wiki.apache.org/hadoop/WritingYarnApps?action=diff&rev1=11&rev2=12

  
  You can debug the application master by running it directly (instead of the multi-step client
job submission approach). The only thing to note is you will need to comment out the code
that does the app master's registration to the resource manager and likely use a different
fail count on each run to generate a different attempt id. 
  
+ '''My container is being killed by the Node Manager'''
+ 
+ This is likely due to high memory usage exceeding your requested container memory size.
There are a number of reasons that can cause this. First, look at the process tree that the
node manager dumps when it kills your container. The two things you're interested in are physical
memory and virtual memory. 
+ 
+ If you have exceeded physical memory limits your app is using too much physical memory.
If you're running a java app, you can use -hprof to look at what is taking up space in the
heap. 
+ 
+ If you have exceeded virtual memory, things are slightly more complicated. Have a look at
this ticket for some debugging advice: https://issues.apache.org/jira/browse/MAPREDUCE-3065
+ 
  === Useful Links ===
  
   * https://issues.apache.org/jira/secure/attachment/12486023/MapReduce_NextGen_Architecture.pdf

Mime
View raw message