hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios
Date Fri, 07 Aug 2015 17:36:46 GMT
Ming Ma created HDFS-8874:
-----------------------------

             Summary: Add DN metrics for balancer and other block movement scenarios
                 Key: HDFS-8874
                 URL: https://issues.apache.org/jira/browse/HDFS-8874
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Ming Ma
            Assignee: Chris Trezzo


For balancer, mover and migrator (HDFS-8789), we want to know how close it is to the DN's
throttling thresholds. Although DN has existing metrics such as {{BytesWritten}}, {{BytesRead}},
{{CopyBlockOpNumOps}} and {{ReplaceBlockOpNumOps}}, there is no metrics to indicate the number
of bytes moved.

We can add {{ReplaceBlockBytesWritten}} and {{CopyBlockBytesRead}} to account for the bytes
moved in ReplaceBlock and CopyBlock operations. In addition, we can also add throttling metrics
for {{DataTransferThrottler}} and {{BlockBalanceThrottler}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message