hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: JobTracker scheduling when there is no locality optimization.
Date Fri, 07 Dec 2012 22:25:56 GMT
It is currently 'random' (based on incoming tasktracker heartbeat order and
availability of slots). MR2 and MR1 with CapacityScheduler can utilize
memory resource request parameters in the job config to schedule based
on memory-constraints, which is the highest you could do at the moment
(CPU based scheduling is arriving soon for YARN, though).

On Sat, Dec 8, 2012 at 3:39 AM, Jay Vyas <jayunit100@gmail.com> wrote:
> How does the JobTracker schedule / assign tasks to open TaskTrackers when
> there is no locality constraints (i.e. when some non file input format,
> such as DBInputFormat is used).... Is it random? Or can it optimize for IO?
> --
> Jay Vyas
> http://jayunit100.blogspot.com

Harsh J

View raw message