hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1783) yarn application does not make any progress even when no other application is running when RM is being restarted in the background
Date Sat, 08 Mar 2014 11:16:40 GMT

    [ https://issues.apache.org/jira/browse/YARN-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13924799#comment-13924799
] 

Hudson commented on YARN-1783:
------------------------------

SUCCESS: Integrated in Hadoop-Yarn-trunk #503 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/503/])
YARN-1783. Fixed a bug in NodeManager's status-updater that was losing completed container
statuses when NodeManager is forced to resync by the ResourceManager. Contributed by Jian
He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1575437)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdater.java
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeStatusUpdaterImpl.java
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/MockNodeStatusUpdater.java
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeManagerResync.java
* /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeStatusUpdater.java


> yarn application does not make any progress even when no other application is running
when RM is being restarted in the background
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-1783
>                 URL: https://issues.apache.org/jira/browse/YARN-1783
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.4.0
>            Reporter: Arpit Gupta
>            Assignee: Jian He
>            Priority: Critical
>             Fix For: 2.4.0
>
>         Attachments: YARN-1783.1.patch, YARN-1783.2.patch, YARN-1783.3.patch, YARN-1783.4.patch
>
>
> Noticed that during HA tests some tests took over 3 hours to run when the test failed.
> Looking at the logs i see the application made no progress for a very long time. However
if i look at application log from yarn it actually ran in 5 mins
> I am seeing same behavior when RM was being restarted in the background and when both
RM and AM were being restarted. This does not happen for all applications but a few will hit
this in the nightly run.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message