hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sharad Agarwal <shara...@yahoo-inc.com>
Subject Re: how to figure out the range of a split that failed?
Date Tue, 06 Jul 2010 03:43:16 GMT
to be precise you have to write on error stream ->
for map:
reporter:counter:SkippingTaskCounters,MapProcessedRecords,<count>

for reduce:
reporter:counter:SkippingTaskCounters,ReduceProcessedGroups,<count>

edward choi wrote:
> Thanks for the response. I went to the web page you told me and 
> several other pages that I found.
> I am still not sure if I got it right.
> If I am trying to increment COUNTER_MAP_PROCESS_RECORDS using Hadoop 
> Streaming, is the example below the way to do it? (assuming that I am 
> using c++)
>
> example:
> cerr << "reporter:counter:counters,linecount,1" << endl;
>
>


Mime
View raw message