hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nick Dimiduk (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-13166) Review MR counters
Date Fri, 06 Mar 2015 19:19:38 GMT
Nick Dimiduk created HBASE-13166:
------------------------------------

             Summary: Review MR counters
                 Key: HBASE-13166
                 URL: https://issues.apache.org/jira/browse/HBASE-13166
             Project: HBase
          Issue Type: Task
          Components: mapreduce
    Affects Versions: 0.98.4
            Reporter: Nick Dimiduk


I was diagnosing a slow CopyTable job recently. It seems we're not exposing through hadoop
counters as many statistics as we might. For example, HDFS gives things like bytes read, we
apparently do not. This task is to review the counters exposed -- assume you don't have access
to debug logs to understand what happened -- and ensure our coverage on the key points. This
particular job appears to be moving data between two tables, both of which have poorly distributed
region splits.

Perhaps there's follow-on to make things work better with uneven region sizes, leveraging
some of the region size goodness added in HBASE-10413.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message