hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7575) NPE in scheduler UI when max-capacity is not configured
Date Fri, 08 Dec 2017 03:28:02 GMT

    [ https://issues.apache.org/jira/browse/YARN-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282989#comment-16282989

Hudson commented on YARN-7575:

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/13345/])
YARN-7575. NPE in scheduler UI when max-capacity is not configured. (wangda: rev 4db4a4a165d3936d59f5e67947c6bfbc9c3270a5)
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestAbsoluteResourceConfiguration.java
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java

> NPE in scheduler UI when max-capacity is not configured
> -------------------------------------------------------
>                 Key: YARN-7575
>                 URL: https://issues.apache.org/jira/browse/YARN-7575
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacity scheduler
>            Reporter: Eric Payne
>            Assignee: Sunil G
>             Fix For: YARN-5881
>         Attachments: YARN-7575-YARN-5881.001.patch
> I encountered the following while reviewing and testing branch YARN-5881.
> The design document from YARN-5881 says that for max-capacity:
> {quote}
> 3)  For each queue, we require:
>     a) if max-resource not set, it automatically set to parent.max-resource
> {quote}
> When I try leaving blank {{yarn.scheduler.capacity.< queue-path>.maximum-capacity}},
the RMUI scheduler page refuses to render. It looks like it's in {{CapacitySchedulerPage$
> {noformat}
> 2017-11-28 11:29:16,974 [qtp43473566-220] ERROR webapp.Dispatcher: error handling URI:
> java.lang.reflect.InvocationTargetException
> ...
>         at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderQueueCapacityInfo(CapacitySchedulerPage.java:164)
>         at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderLeafQueueInfoWithoutParition(CapacitySchedulerPage.java:129)
> {noformat}
> Also... A job will run in the leaf queue with no max capacity set and it will grow to
the max capacity of the cluster, but if I add resources to the node, the job won't grow any
more even though it has pending resources.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message