hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rakesh kothari <rkothari_...@hotmail.com>
Subject Mapper processing gzipped file
Date Tue, 18 Jan 2011 23:36:37 GMT

Hi,

There is a gzipped file that needs to be processed by a Map-only hadoop job. If the size of
this file is more than the space reserved for non-dfs use on the tasktracker host processing
this file and if it's a non data local map task, would this job eventually fail ? Is hadoop
jobtracker smart enough to not schedule the task on such nodes ?

Thanks,
-Rakesh
 		 	   		  
Mime
View raw message