hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vinod Kumar Vavilapalli <vino...@hortonworks.com>
Subject Re: hadoop task assigner
Date Fri, 07 Dec 2012 21:06:33 GMT

In 1.0 line, you should look at JobTracker side, specifically JobInProgress.java.

Thanks,
+Vinod

On Dec 7, 2012, at 8:28 AM, Jay Vyas wrote:

> Hi : Where are the hooks in hadoop for the implementation of locality?  I assume that
Mappers are blind to locality - they read directly via their Context objects, whatever splits
they are given. 
> 
> But the MapperContext is created by some kind of "smart", locality aware Task assignment
class.
> 
> What is this class and where is it? In particular, im interested in seeing how to implement
it for different InputFormat mechanisms
> 
> Thanks!!!!!!!!!!!!!
> 
> -- 
> Jay Vyas
> http://jayunit100.blogspot.com


Mime
View raw message