hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jerryjung (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-1828) Resource Manager is down when I request job on specific queue.
Date Thu, 13 Mar 2014 05:55:43 GMT

     [ https://issues.apache.org/jira/browse/YARN-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

jerryjung updated YARN-1828:
----------------------------

    Description: 
Resource Manager is down when I request job on specific queue.

jar ~/servers/hadoop-2.2.0-cdh5.0.0-beta-2/share/hadoop/mapreduce/hadoop-maprede-examples-2.2.0-cdh5.0.0-beta-2.jar
wordcount -Dmapreduce.job.queuename=jerry  


YARN log is below. 
==========================================================
2014-03-13 14:35:50,391 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
QueueName :::root.jerry
2014-03-13 14:35:50,391 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Queue Information :::null
2014-03-13 14:35:50,392 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager:
Error in handling event type APP_ATTEMPT_ADDED to the scheduler
java.lang.NullPointerException
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.assignToQueue(FairScheduler.java:671)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.addApplicationAttempt(FairScheduler.java:607)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1102)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:114)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:543)
	at java.lang.Thread.run(Thread.java:744)
2014-03-13 14:35:50,394 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager:
Exiting, bbye..

please fix the null pointer error about RM down for abnormal request.


  was:
Resource Manager is down when I request job on specific queue.

jar ~/servers/hadoop-2.2.0-cdh5.0.0-beta-2/share/hadoop/mapreduce/hadoop-maprede-examples-2.2.0-cdh5.0.0-beta-2.jar
wordcount -Dmapreduce.job.queuename=jerry  


YARN log is below. 
==========================================================
2014-03-13 14:35:50,391 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
QueueName :::root.jerry
2014-03-13 14:35:50,391 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Queue Information :::null
2014-03-13 14:35:50,392 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager:
Error in handling event type APP_ATTEMPT_ADDED to the scheduler
java.lang.NullPointerException
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.assignToQueue(FairScheduler.java:671)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.addApplicationAttempt(FairScheduler.java:607)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1102)
	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:114)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:543)
	at java.lang.Thread.run(Thread.java:744)
2014-03-13 14:35:50,394 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager:
Exiting, bbye..

I think queue is null.

queue = queueMgr.getLeafQueue(queueName, true); 

But queue info is normal.

======================
Queue Name : root.default 
Queue State : running 
Scheduling Info : Capacity: NaN, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0 
======================
Queue Name : root.hadoop 
Queue State : running 
Scheduling Info : Capacity: NaN, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0 
    ======================
    Queue Name : root.hadoop.hadoop_sub_queue 
    Queue State : running 
    Scheduling Info : Capacity: NaN, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0 
======================
Queue Name : root.jerry 
Queue State : running 
Scheduling Info : Capacity: NaN, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0 
    ======================
    Queue Name : root.jerry.jerry_sub_queue 
    Queue State : running 
    Scheduling Info : Capacity: NaN, MaximumCapacity: UNDEFINED, CurrentCapacity: 0.0 


> Resource Manager is down when I request job on specific queue.
> --------------------------------------------------------------
>
>                 Key: YARN-1828
>                 URL: https://issues.apache.org/jira/browse/YARN-1828
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.2.0
>         Environment: CDH-5.0.0-beta-2(Hadoop 2.2.0) version
>            Reporter: jerryjung
>            Priority: Blocker
>
> Resource Manager is down when I request job on specific queue.
> jar ~/servers/hadoop-2.2.0-cdh5.0.0-beta-2/share/hadoop/mapreduce/hadoop-maprede-examples-2.2.0-cdh5.0.0-beta-2.jar
wordcount -Dmapreduce.job.queuename=jerry  
> YARN log is below. 
> ==========================================================
> 2014-03-13 14:35:50,391 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
QueueName :::root.jerry
> 2014-03-13 14:35:50,391 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler:
Queue Information :::null
> 2014-03-13 14:35:50,392 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager:
Error in handling event type APP_ATTEMPT_ADDED to the scheduler
> java.lang.NullPointerException
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.assignToQueue(FairScheduler.java:671)
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.addApplicationAttempt(FairScheduler.java:607)
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1102)
> 	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:114)
> 	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:543)
> 	at java.lang.Thread.run(Thread.java:744)
> 2014-03-13 14:35:50,394 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager:
Exiting, bbye..
> please fix the null pointer error about RM down for abnormal request.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message