hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacobo Coll (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-16493) MapReduce counters not updated with ScanMetrics
Date Wed, 24 Aug 2016 10:35:21 GMT
Jacobo Coll created HBASE-16493:

             Summary: MapReduce counters not updated with ScanMetrics 
                 Key: HBASE-16493
                 URL: https://issues.apache.org/jira/browse/HBASE-16493
             Project: HBase
          Issue Type: Bug
          Components: mapreduce
    Affects Versions: 1.1.0, 1.0.0, 2.0.0
            Reporter: Jacobo Coll

ScanMetrics were introduced in the [HBASE-4145]. These metrics were able to work even in a
parallel environment such as MapReduce.
The TableRecordReader creates a Scanner with a copy of the given "scan", called "currentScan".
The ScanMetrics are captured by the Scanner and modifies the given Scan instance, "currentScan".
The TableRecordReader, after reading the last value, updates the job counters to aggregate

But since [HBASE-13030], the TableRecordReader reads the scanMetrics from the object "scan"
instead of using the "currentScan"

This message was sent by Atlassian JIRA

View raw message