hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.
Date Fri, 09 Oct 2015 05:58:27 GMT

    [ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949936#comment-14949936
] 

Hudson commented on YARN-3943:
------------------------------

FAILURE: Integrated in Hadoop-Hdfs-trunk #2412 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2412/])
YARN-3943. Use separate threshold configurations for disk-full detection (jlowe: rev 8d226225d030253152494bda32708377ad0f7af7)
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DirectoryCollection.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LocalDirsHandlerService.java
* hadoop-yarn-project/CHANGES.txt
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestDirectoryCollection.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java


> Use separate threshold configurations for disk-full detection and disk-not-full detection.
> ------------------------------------------------------------------------------------------
>
>                 Key: YARN-3943
>                 URL: https://issues.apache.org/jira/browse/YARN-3943
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>            Reporter: zhihai xu
>            Assignee: zhihai xu
>            Priority: Critical
>             Fix For: 2.8.0
>
>         Attachments: YARN-3943.000.patch, YARN-3943.001.patch, YARN-3943.002.patch
>
>
> Use separate threshold configurations to check when disks become full and when disks
become good. Currently the configuration "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage"
and "yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb" are used to check both
when disks become full and when disks become good. It will be better to use two configurations:
one is used when disks become full from not-full and the other one is used when disks become
not-full from full. So we can avoid oscillating frequently.
> For example: we can set the one for disk-full detection higher than the one for disk-not-full
detection.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message