hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravikant Dindokar <ravikant.i...@gmail.com>
Subject Re: Only one reducer working
Date Fri, 26 Jun 2015 17:17:48 GMT
set the value directly in code. Given a JobConf instance job, call

job.setNumReduceTasks(100);


This worked for me

Thanks

On Fri, Jun 26, 2015 at 9:07 PM, Ravikant Dindokar <ravikant.iisc@gmail.com>
wrote:

> text file with tab separated values
>
> On Fri, Jun 26, 2015 at 7:35 PM, Krishna Kalyan <krishnakalyan3@gmail.com>
> wrote:
>
>> What is the file format?.
>>
>> Thanks,
>> Krishna
>> On 26 Jun 2015 7:33 pm, "Ravikant Dindokar" <ravikant.iisc@gmail.com>
>> wrote:
>>
>>> Hi Hadoop User,
>>>
>>> I am processing 23 GB file on 21 nodes.
>>>
>>> I have tried both options :
>>>
>>> mapreduce.job.reduces=50
>>>
>>> &
>>>
>>> mapred.tasktracker.reduce.tasks.maximum=5
>>> in mapred-site.xml
>>>
>>> but still only one reducer is running.
>>>
>>> Any configuration setting still to be corrected?
>>>
>>> Thanks
>>> Ravikant
>>>
>>
>

Mime
View raw message