hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mapred Learn <mapred.le...@gmail.com>
Subject Re: how to use mapred.min.split.size option ?
Date Wed, 25 May 2011 14:08:31 GMT
Resending ====>


> Hi,
> I have few input splits that are few MB in size.
> I want to submit 1 GB of input to every mapper. Does anyone know how can I do it ?
> Currently each mapper gets one input split that results in many small map-output files.
>  
> I tried setting -Dmapred.map.min.split.size=<number> , but still it does not take
effect.
>  
> Thanks,
> -JJ

Mime
View raw message