hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1663) NPE in FifoScheduler.assignContainers
Date Tue, 28 Jan 2014 17:03:38 GMT

    [ https://issues.apache.org/jira/browse/YARN-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13884329#comment-13884329
] 

Steve Loughran commented on YARN-1663:
--------------------------------------

{code}
2014-01-28 16:56:00,665 [JUnit] INFO  client.HoyaClient (HoyaClient.java:executeClusterStart(905))
- Completed setting up app master command $JAVA_HOME/bin/java -Djava.net.preferIPv4Stack=true
-Djava.awt.headless=true -Xmx256M -ea -esa -Dhoya.cluster.name=test_killed_am -Dhoya.app.type=hbase
org.apache.hoya.yarn.appmaster.HoyaAppMaster create test_killed_am --debug --hoya-cluster-uri
hdfs://localhost:54401/user/stevel/.hoya/cluster/test_killed_am --rm localhost:54393 --fs
hdfs://localhost:54401/ 1><LOG_DIR>/hoyaam.txt 2><LOG_DIR>/hoyaam-err.txt

2014-01-28 16:56:00,667 [JUnit] INFO  client.HoyaClient (HoyaClient.java:executeClusterStart(948))
- Submitting application to Resource Manager
2014-01-28 16:56:00,704 [IPC Server handler 3 on 54394] INFO  resourcemanager.ClientRMService
(ClientRMService.java:submitApplication(326)) - Application with id 1 submitted by user stevel
2014-01-28 16:56:00,705 [AsyncDispatcher event handler] INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(823))
- Storing application with id application_1390928154802_0001
2014-01-28 16:56:00,706 [IPC Server handler 3 on 54394] INFO  resourcemanager.RMAuditLogger
(RMAuditLogger.java:logSuccess(140)) - USER=stevel	IP=127.0.0.1	OPERATION=Submit Application
Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1390928154802_0001
2014-01-28 16:56:00,706 [AsyncDispatcher event handler] INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(631))
- application_1390928154802_0001 State change from NEW to NEW_SAVING
2014-01-28 16:56:00,711 [AsyncDispatcher event handler] INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(596))
- Storing info for app: application_1390928154802_0001
2014-01-28 16:56:00,720 [AsyncDispatcher event handler] INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(631))
- application_1390928154802_0001 State change from NEW_SAVING to SUBMITTED
2014-01-28 16:56:00,721 [ResourceManager Event Processor] INFO  fifo.FifoScheduler (FifoScheduler.java:addApplication(368))
- Accepted application application_1390928154802_0001 from user: stevel, currently num of
applications: 1
2014-01-28 16:56:00,722 [ResourceManager Event Processor] FATAL resourcemanager.ResourceManager
(ResourceManager.java:run(552)) - Error in handling event type NODE_UPDATE to the scheduler
java.lang.NullPointerException
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.assignContainers(FifoScheduler.java:461)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.nodeUpdate(FifoScheduler.java:718)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:747)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:105)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:543)
	at java.lang.Thread.run(Thread.java:744)
2014-01-28 16:56:00,723 [ResourceManager Event Processor] INFO  resourcemanager.ResourceManager
(ResourceManager.java:run(556)) - Exiting, bbye..
2014-01-28 16:56:00,724 [AsyncDispatcher event handler] INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(631))
- application_1390928154802_0001 State change from SUBMITTED to ACCEPTED
2014-01-28 16:56:00,724 [AsyncDispatcher event handler] INFO  resourcemanager.ApplicationMasterService
(ApplicationMasterService.java:registerAppAttempt(568)) - Registering app attempt : appattempt_1390928154802_0001_000001

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

{code}

> NPE in FifoScheduler.assignContainers
> -------------------------------------
>
>                 Key: YARN-1663
>                 URL: https://issues.apache.org/jira/browse/YARN-1663
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 2.4.0
>         Environment: (starting AM client that is marked as wanting containers back on
restart)
>            Reporter: Steve Loughran
>            Priority: Minor
>
> NPE see in scheduler thread running in a MiniYARNCluster with the fifo scheduler
> {code}
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.assignContainers(FifoScheduler.java:461)
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.nodeUpdate(FifoScheduler.java:718)
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:747)
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:105)
> 	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:543)
> {code}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message