hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaobing Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10917) Collect peer performance statistics on DataNode.
Date Fri, 02 Dec 2016 00:40:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713564#comment-15713564
] 

Xiaobing Zhou commented on HDFS-10917:
--------------------------------------

Posted v000 patch.
* added these peer metrics:
** sendPacketDownstreamTimeNanos
** sendAckToUpstreamTimeNanos
** writeDataToDiskTimeNanos
** syncWriterOsCacheTimeNanos
** flushOrSyncBlockTimeNanos
** writeChecksumToDiskTimeNanos

Will add tests for syncWriterOsCacheTimeNanos and writeDataToDiskTimeNanos in upcoming patches.

> Collect peer performance statistics on DataNode.
> ------------------------------------------------
>
>                 Key: HDFS-10917
>                 URL: https://issues.apache.org/jira/browse/HDFS-10917
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>    Affects Versions: 2.8.0
>            Reporter: Xiaobing Zhou
>            Assignee: Xiaobing Zhou
>         Attachments: HDFS-10917.000.patch
>
>
> DataNodes already detect if replication pipeline operations are slow and log warnings.
For the purpose of analysis, performance metrics are desirable. This proposes adding them
on DataNodes. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message