hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaoyu Yao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10959) Adding per disk IO statistics in DataNode.
Date Fri, 16 Dec 2016 21:17:58 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xiaoyu Yao updated HDFS-10959:
------------------------------
    Attachment: HDFS-10959.00.patch

Attach a patch that add per volume io stats and metrics based on ProfilingFileIoEvens.java.
It is off by default to minimize the impact on datanode normal IO. When needed, this can be
enabled with the following for profiling datanode IO perf. 
{code}
    <property>
        <name>dfs.datanode.fileio.events.class</name>      <value>org.apache.hadoop.hdfs.server.datanode.ProfilingFileIoEvents</value>
        <description>Profiling File IO Events on datanode volumes and expose metrics.</description>
    </property>
{code}

> Adding per disk IO statistics in DataNode.
> ------------------------------------------
>
>                 Key: HDFS-10959
>                 URL: https://issues.apache.org/jira/browse/HDFS-10959
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Xiaoyu Yao
>            Assignee: Xiaoyu Yao
>         Attachments: HDFS-10959.00.patch
>
>
> This ticket is opened to support per disk IO statistics in DataNode based on HDFS-10930.
The statistics added will make it easier to implement HDFS-4169 "Add per-disk latency metrics
to DataNode".



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message