hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1781) NM should allow users to specify max disk utilization for local disks
Date Sat, 08 Mar 2014 01:09:44 GMT

    [ https://issues.apache.org/jira/browse/YARN-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924614#comment-13924614
] 

Hudson commented on YARN-1781:
------------------------------

SUCCESS: Integrated in Hadoop-trunk-Commit #5287 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/5287/])
YARN-1781. Modified NodeManagers to allow admins to specify max disk utilization for local
disks so as to be able to offline full disks. Contributed by Varun Vasudev. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1575463)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DirectoryCollection.java
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LocalDirsHandlerService.java
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestDirectoryCollection.java


> NM should allow users to specify max disk utilization for local disks
> ---------------------------------------------------------------------
>
>                 Key: YARN-1781
>                 URL: https://issues.apache.org/jira/browse/YARN-1781
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>             Fix For: 2.4.0
>
>         Attachments: apache-yarn-1781.0.patch, apache-yarn-1781.1.patch, apache-yarn-1781.2.patch,
apache-yarn-1781.3.patch, apache-yarn-1781.4.patch
>
>
> This is related to YARN-257(it's probably a sub task?). Currently, the NM does not detect
full disks and allows full disks to be used by containers leading to repeated failures. YARN-257
deals with graceful handling of full disks. This ticket is only about detection of full disks
by the disk health checkers.
> The NM should allow users to set a maximum disk utilization for local disks and mark
disks as bad once they exceed that utilization. At the very least, the NM should at least
detect full disks.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message