hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohith (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1852) Application recovery throws InvalidStateTransitonException for FAILED and KILLED jobs
Date Wed, 19 Mar 2014 11:08:44 GMT

    [ https://issues.apache.org/jira/browse/YARN-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13940394#comment-13940394
] 

Rohith commented on YARN-1852:
------------------------------

Here is the exception stack trace..

For Killed application state=KILLED
{noformat}
2014-03-19 14:26:11,618 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl:
Recovering app: application_1394526371652_0004 with 1 attempts and final state = KILLED
2014-03-19 14:26:11,618 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger:
USER=root	OPERATION=Application Finished - Killed	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1394526371652_0003
2014-03-19 14:26:11,618 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl:
Recovering attempt: appattempt_1394526371652_0004_000001 with final state: KILLED
2014-03-19 14:26:11,618 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary:
appId=application_1394526371652_0003,name=Sleep job,user=root,queue=default,state=KILLED,trackingUrl=host-10-18-40-77:45020/cluster/app/application_1394526371652_0003,appMasterHost=N/A,startTime=1394526759247,finishTime=1394527194947,finalStatus=KILLED
2014-03-19 14:26:11,619 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService:
Unregistering app attempt : appattempt_1394526371652_0004_000001
2014-03-19 14:26:11,619 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl:
appattempt_1394526371652_0004_000001 State change from NEW to KILLED
2014-03-19 14:26:11,619 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl:
application_1394526371652_0004 State change from NEW to KILLED
2014-03-19 14:26:11,619 ERROR org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl:
Can't handle this event at current state
org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: ATTEMPT_KILLED
at KILLED
	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl.handle(RMAppImpl.java:632)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl.handle(RMAppImpl.java:82)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher.handle(ResourceManager.java:690)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher.handle(ResourceManager.java:674)
	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:173)
	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:106)
	at java.lang.Thread.run(Thread.java:662)
{noformat}

For failed application state=FAILED
{noformat}
2014-03-19 14:26:11,614 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl:
Recovering app: application_1394528000856_0003 with 2 attempts and final state = FAILED
2014-03-19 14:26:11,614 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary:
appId=application_1395139734891_0003,name=Sleep job,user=root,queue=d,state=FINISHED,trackingUrl=http://host-10-18-40-77:45020/proxy/application_1395139734891_0003/jobhistory/job/job_1395139734891_0003,appMasterHost=N/A,startTime=1395141914653,finishTime=1395141933121,finalStatus=SUCCEEDED
2014-03-19 14:26:11,614 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl:
Recovering attempt: appattempt_1394528000856_0003_000001 with final state: FAILED
2014-03-19 14:26:11,615 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl:
Recovering attempt: appattempt_1394528000856_0003_000002 with final state: FAILED
2014-03-19 14:26:11,615 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl:
appattempt_1394528000856_0003_000001 State change from NEW to FAILED
2014-03-19 14:26:11,615 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService:
Unregistering app attempt : appattempt_1394528000856_0003_000002
2014-03-19 14:26:11,615 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl:
appattempt_1394528000856_0003_000002 State change from NEW to FAILED
2014-03-19 14:26:11,616 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl:
application_1394528000856_0003 State change from NEW to FAILED
2014-03-19 14:26:11,616 ERROR org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl:
Can't handle this event at current state
org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: ATTEMPT_FAILED
at FAILED
	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl.handle(RMAppImpl.java:632)
	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl.handle(RMAppImpl.java:82)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher.handle(ResourceManager.java:690)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher.handle(ResourceManager.java:674)
	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:173)
	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:106)
	at java.lang.Thread.run(Thread.java:662)
{noformat}

> Application recovery throws InvalidStateTransitonException for FAILED and KILLED jobs
> -------------------------------------------------------------------------------------
>
>                 Key: YARN-1852
>                 URL: https://issues.apache.org/jira/browse/YARN-1852
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.3.0, 2.4.0
>            Reporter: Rohith
>            Assignee: Rohith
>            Priority: Minor
>
> Recovering for failed/killed application throw InvalidStateTransitonException.
> These are logged during recovery of applications.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message