hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Vyas <jayunit...@gmail.com>
Subject hadoop task assigner
Date Fri, 07 Dec 2012 16:28:04 GMT
Hi : Where are the hooks in hadoop for the implementation of locality?  I
assume that Mappers are blind to locality - they read directly via their
Context objects, whatever splits they are given.

But the MapperContext is created by some kind of "smart", locality aware
Task assignment class.

What is this class and where is it? In particular, im interested in seeing
how to implement it for different InputFormat mechanisms

Thanks!!!!!!!!!!!!!

-- 
Jay Vyas
http://jayunit100.blogspot.com

Mime
View raw message