hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Íñigo Goiri (JIRA) <j...@apache.org>
Subject [jira] [Commented] (HDFS-14045) Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN
Date Thu, 15 Nov 2018 18:28:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-14045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16688480#comment-16688480
] 

Íñigo Goiri commented on HDFS-14045:
------------------------------------

Thanks [~yangjiandan] for taking care of the comments.
[^HDFS-14045.011.patch] LGTM.
The new tests run OK here:
https://builds.apache.org/job/PreCommit-HDFS-Build/25531/testReport/org.apache.hadoop.hdfs.server.datanode/TestDataNodeMetrics/
And the failed ones are unrelated as you mentioned.

+1 and committing today if nobody has concerns.

> Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports
of Active/Standby NN
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-14045
>                 URL: https://issues.apache.org/jira/browse/HDFS-14045
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Jiandan Yang 
>            Assignee: Jiandan Yang 
>            Priority: Major
>         Attachments: HDFS-14045.001.patch, HDFS-14045.002.patch, HDFS-14045.003.patch,
HDFS-14045.004.patch, HDFS-14045.005.patch, HDFS-14045.006.patch, HDFS-14045.007.patch, HDFS-14045.008.patch,
HDFS-14045.009.patch, HDFS-14045.010.patch, HDFS-14045.011.patch
>
>
> Currently DataNode uses same metrics to measure rpc latency of NameNode, but Active and
Standby usually have different performance at the same time, especially in large cluster.
For example, rpc latency of Standby is very long when Standby is catching up editlog. We may
misunderstand the state of HDFS. Using different metrics for Active and standby can help us
obtain more precise metric data.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message