hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11461) DataNode Disk Outlier Detection
Date Sun, 26 Feb 2017 05:10:45 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884542#comment-15884542

Allen Wittenauer commented on HDFS-11461:

bq. detect outliers among them

How do you determine if the disk traffic is actually from HDFS or from something else?  Isn't
this data better collected at the system level rather than from Hadoop?

> DataNode Disk Outlier Detection
> -------------------------------
>                 Key: HDFS-11461
>                 URL: https://issues.apache.org/jira/browse/HDFS-11461
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs
>            Reporter: Hanisha Koneru
>            Assignee: Hanisha Koneru
>         Attachments: HDFS-11461.000.patch
> Similar to how DataNodes collect peer performance statistics, we can collect disk performance
statistics per datanode and detect outliers among them, if any.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message