hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yufei Gu (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (YARN-5288) Resource Localization fails due to leftover files
Date Mon, 20 Mar 2017 18:14:42 GMT

     [ https://issues.apache.org/jira/browse/YARN-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yufei Gu reassigned YARN-5288:
------------------------------

    Assignee:     (was: Yufei Gu)

> Resource Localization fails due to leftover files
> -------------------------------------------------
>
>                 Key: YARN-5288
>                 URL: https://issues.apache.org/jira/browse/YARN-5288
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 2.9.0
>            Reporter: Yufei Gu
>
> NM restart didn't clean up all user cache. The leftover files can cause resource localization
failure.
> {code}
> 2016-06-14 23:09:12,717 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:

> java.io.IOException: Rename cannot overwrite non empty destination directory /data/5/yarn/nm/usercache/xxx/filecache/4567
>         at org.apache.hadoop.fs.AbstractFileSystem.renameInternal(AbstractFileSystem.java:716)
>         at org.apache.hadoop.fs.FilterFs.renameInternal(FilterFs.java:236)
>         at org.apache.hadoop.fs.AbstractFileSystem.rename(AbstractFileSystem.java:659)
>         at org.apache.hadoop.fs.FileContext.rename(FileContext.java:912)
>         at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:364)
>         at org.apache.hadoop.yarn.util.FSDownload.call(FSDownload.java:60)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message