hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: fixing the mapper percentage viewer
Date Thu, 20 Oct 2011 04:30:43 GMT
Hello Mark,

Moving to mapreduce-dev@ (bcc'd common-user@).

You need to control whatever calls Reporter#setProgress(…). Mostly its
just the RecordReader implementation doing it via
RecordReader#getProgress(…).

Counters are not part of the progress reports.

On Thu, Oct 20, 2011 at 3:35 AM, Mark question <markq2011@gmail.com> wrote:
> Hi all,
>
>  I'm written a custom mapRunner, but it seems to have ruined the percentage
> shown for maps on console. I want to know which part of code is responsible
> for adjusting the percentage of maps ... Is it the following in MapRunner:
>
>        if(incrProcCount) {
>
>          reporter.incrCounter(SkipBadRecords.COUNTER_GROUP,
>
>              SkipBadRecords.COUNTER_MAP_PROCESSED_RECORDS, 1);
>
>
> Thank you,
> Mark
>



-- 
Harsh J

Mime
View raw message