hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sharad Agarwal <shara...@yahoo-inc.com>
Subject Re: how to figure out the range of a split that failed?
Date Thu, 01 Jul 2010 11:50:04 GMT
edward choi wrote:
>
>
> Then I noticed that you have to set 
> "mapred.skip.map.auto.incr.proc.count=false" and increment 
> COUNTER_MAP_PROCESSED_RECORDS in your own application. I guess that 
> you can do this in your example, but I don't know how to do it using 
> my way of Hadoop Streaming. Could you enlighten me please?
>
You can refer
http://hadoop.apache.org/common/docs/r0.20.0/streaming.html#How+do+I+update+counters+in+streaming+applications%3F


for knowing how to increment counter in streaming.


Sharad

Mime
View raw message