hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Lilley <john.lil...@redpoint.net>
Subject Scheduler question
Date Mon, 09 Sep 2013 00:21:51 GMT
Do the Hadoop 2.0 YARN scheduler(s) deal with situations like the following?
Hadoop cluster of 10 nodes, with 8GB each available for containers.  There is only one queue.
Application A requests 100 4GB containers.  It initially, or after a little while, gets 20
containers.
Later, application B requests 1 8GB container.
Suppose that App-A's containers each take a few minutes.  At some point one will complete.
 When that happens, will the scheduler immediately allocate another 4GB container to App-A?
 If so will App-B ever get its container until App-A is almost done?
Thanks
John


Mime
View raw message