hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adam Kawa <kawa.a...@gmail.com>
Subject Re: issue about running example job use custom mapreduce var
Date Tue, 10 Dec 2013 23:16:38 GMT
Accidentally, I clicked "Sent" by a mistake. Plase try:

hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar terasort
*-Dmapreduce.job.reduces=34* /alex/terasort/1G-input
/alex/terasort/1G-output


2013/12/11 Adam Kawa <kawa.adam@gmail.com>

> Please try
>
>
>
> 2013/12/10 ch huang <justlooks@gmail.com>
>
>> hi,maillist:
>>                 i try assign reduce number in commandline but seems not
>> useful,i run tera sort like this
>>
>> # hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar
>> terasort /alex/terasort/1G-input /alex/terasort/1G-output
>> -Dmapreduce.job.reduces=34
>>
>> so default mapred-site.xml assign reducer number is 16,i try run it with
>> 34 reducers,but the job run still as 16 reducers number,why?
>>
>> here is some output:
>>
>>         Job Counters
>>                 Launched map tasks=1
>>                 Launched reduce tasks=16
>>                 Rack-local map tasks=1
>>                 Total time spent by all maps in occupied slots (ms)=2318
>>                 Total time spent by all reduces in occupied slots
>> (ms)=99714
>>
>
>

Mime
View raw message