hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nishan Shetty (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2258) Aggregation of MR job logs failing when Resourcemanager switches
Date Tue, 08 Jul 2014 04:15:35 GMT

    [ https://issues.apache.org/jira/browse/YARN-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054500#comment-14054500
] 

Nishan Shetty commented on YARN-2258:
-------------------------------------

Successful flow
{code}
"ftp(1):/home/testos/install/hadoop/logs/yarn-testos-nodemanager-HOST-10-18-40-153.log.1"(1032483,114):2014-07-06
22:01:52,928 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Application application_1404662892762_0022 transitioned from NEW to INITING
"ftp(1):/home/testos/install/hadoop/logs/yarn-testos-nodemanager-HOST-10-18-40-153.log.1"(1032499,114):2014-07-06
22:01:52,974 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Application application_1404662892762_0022 transitioned from INITING to RUNNING
"ftp(1):/home/testos/install/hadoop/logs/yarn-testos-nodemanager-HOST-10-18-40-153.log.1"(1033850,114):2014-07-06
22:02:56,905 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Application application_1404662892762_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
"ftp(1):/home/testos/install/hadoop/logs/yarn-testos-nodemanager-HOST-10-18-40-153.log.1"(1033853,114):2014-07-06
22:02:57,048 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Application application_1404662892762_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP
to FINISHED
{code}

Failed flow
{code}
"ftp(1):/home/testos/install/hadoop/logs/yarn-testos-nodemanager-HOST-10-18-40-153.log.1"(1074500,114):2014-07-06
22:37:03,775 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Application application_1404662892762_0056 transitioned from NEW to INITING
"ftp(1):/home/testos/install/hadoop/logs/yarn-testos-nodemanager-HOST-10-18-40-153.log.1"(1074502,114):2014-07-06
22:37:03,860 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application:
Application application_1404662892762_0056 transitioned from INITING to RUNNING
{code}



> Aggregation of MR job logs failing when Resourcemanager switches
> ----------------------------------------------------------------
>
>                 Key: YARN-2258
>                 URL: https://issues.apache.org/jira/browse/YARN-2258
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: log-aggregation, nodemanager
>    Affects Versions: 2.4.1
>            Reporter: Nishan Shetty
>
> 1.Install RM in HA mode
> 2.Run a job with more tasks
> 3.Induce RM switchover while job is in progress
> Observe that log aggregation fails for the job which is running when  Resourcemanager
switchover is induced.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message