hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11461) DataNode Disk Outlier Detection
Date Sun, 26 Feb 2017 05:10:45 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884542#comment-15884542
] 

Allen Wittenauer commented on HDFS-11461:
-----------------------------------------

bq. detect outliers among them

How do you determine if the disk traffic is actually from HDFS or from something else?  Isn't
this data better collected at the system level rather than from Hadoop?

> DataNode Disk Outlier Detection
> -------------------------------
>
>                 Key: HDFS-11461
>                 URL: https://issues.apache.org/jira/browse/HDFS-11461
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs
>            Reporter: Hanisha Koneru
>            Assignee: Hanisha Koneru
>         Attachments: HDFS-11461.000.patch
>
>
> Similar to how DataNodes collect peer performance statistics, we can collect disk performance
statistics per datanode and detect outliers among them, if any.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message