hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jim Donofrio <donofrio...@gmail.com>
Subject how to increment counters inside of InputFormat/RecordReader in mapreduce api?
Date Mon, 30 Jul 2012 06:11:57 GMT
In the mapred api getRecordReader was passed a Reporter which could then 
get passed to the RecordReader to allow a RecordReader to increment 
counters for different types of records, bad records, etc. In the new 
mapreduce api createRecordReader only gets the InputSplit and 
TaskAttemptContext, both have no access to counters.

Is there really no way to increment counters inside of a RecordReader or 
InputFormat in the mapreduce api?

View raw message