hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bibin A Chundatt (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-9557) Application fails in diskchecker when ReadWriteDiskValidator is configured.
Date Mon, 03 Jun 2019 13:07:01 GMT

    [ https://issues.apache.org/jira/browse/YARN-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854573#comment-16854573
] 

Bibin A Chundatt commented on YARN-9557:
----------------------------------------

Thank you [~BilwaST] for patch.

Latest patch looks good to  me. Will wait for a day before committing.

> Application fails in diskchecker when ReadWriteDiskValidator is configured.
> ---------------------------------------------------------------------------
>
>                 Key: YARN-9557
>                 URL: https://issues.apache.org/jira/browse/YARN-9557
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 3.1.1
>         Environment: Configure:
> <property>
>  <name>yarn.nodemanager.disk-validator</name>
>  <value>read-write</value>
>  </property>
>            Reporter: Anuruddh Nayak
>            Assignee: Bilwa S T
>            Priority: Critical
>         Attachments: YARN-9557-001.patch, YARN-9557-002.patch, YARN-9557-003.patch
>
>
> Application fails to execute successfully when ReadWriteDiskValidator is configured.
> {code:java}
> <property>
> <name>yarn.nodemanager.disk-validator</name>
> <value>read-write</value>
> </property>
> {code}
> {noformat}
> Exception thrown while starting Container:
> java.io.IOException: org.apache.hadoop.util.DiskChecker$DiskErrorException: Disk Check
failed!
>  at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:200)
>  at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:180)
>  at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:1233)
>  Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException: Disk Check failed!
>  at org.apache.hadoop.util.ReadWriteDiskValidator.checkStatus(ReadWriteDiskValidator.java:82)
>  at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.download(ContainerLocalizer.java:255)
>  at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.localizeFiles(ContainerLocalizer.java:312)
>  at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:198)
>  ... 2 more
>  Caused by: org.apache.hadoop.util.DiskChecker$DiskErrorException: /opt/HA/AN0805/nmlocal/usercache/dsperf/appcache/application_1557736108162_0009/filecache/11
is not a directory!
>  at org.apache.hadoop.util.ReadWriteDiskValidator.checkStatus(ReadWriteDiskValidator.java:50)
> {noformat}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message