hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: fixing the mapper percentage viewer
Date Thu, 20 Oct 2011 04:33:29 GMT
Er, I meant to type mapreduce-user, not -dev :)

On Thu, Oct 20, 2011 at 10:00 AM, Harsh J <harsh@cloudera.com> wrote:
> Hello Mark,
>
> Moving to mapreduce-dev@ (bcc'd common-user@).
>
> You need to control whatever calls Reporter#setProgress(…). Mostly its
> just the RecordReader implementation doing it via
> RecordReader#getProgress(…).
>
> Counters are not part of the progress reports.
>
> On Thu, Oct 20, 2011 at 3:35 AM, Mark question <markq2011@gmail.com> wrote:
>> Hi all,
>>
>>  I'm written a custom mapRunner, but it seems to have ruined the percentage
>> shown for maps on console. I want to know which part of code is responsible
>> for adjusting the percentage of maps ... Is it the following in MapRunner:
>>
>>        if(incrProcCount) {
>>
>>          reporter.incrCounter(SkipBadRecords.COUNTER_GROUP,
>>
>>              SkipBadRecords.COUNTER_MAP_PROCESSED_RECORDS, 1);
>>
>>
>> Thank you,
>> Mark
>>
>
>
>
> --
> Harsh J
>



-- 
Harsh J

Mime
View raw message