hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Payne <eric.payne1...@yahoo.com.INVALID>
Subject Re: yarn uses nodes non symetrically
Date Wed, 18 Nov 2015 23:02:38 GMT
Nicolae It depends on how big your AM container is compared to the task containers. By default,
the AM container size is 1.5GB and the map/reduce containers are 1GB. You can adjust these
by setting yarn.app.mapreduce.am.resource.mb, mapreduce.map.memory.mb, and mapreduce.map.memory.mb.
If you make them smaller, make sure you also adjust the -Xmx values for the mapreduce.*.java.opts
properties as well.Thanks,
-Eric
 


      From: Nicolae Marasoiu <nicolae.marasoiu@adswizz.com>
 To: "user@hadoop.apache.org" <user@hadoop.apache.org> 
 Sent: Tuesday, November 17, 2015 8:01 AM
 Subject: yarn uses nodes non symetrically
   
 #yiv7260601419 #yiv7260601419 -- P {margin-top:0;margin-bottom:0;}#yiv7260601419 Hi,
My nodes are identical, and the yarn-site.xml are identical too.However, between slaves, one
is used to the full but the other, around half, meaning: one gets 4 containers, the other
gets 3 (and one of them is the app master which is quite idle), and I don't know why.
Thanks,Nicu

   

Mime
View raw message