Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Thu, 9 Mar 2017 10:10:38 +0000 (UTC)
From: =?utf-8?Q?L=C3=A9opold_Boudard_=28JIRA=29?= <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13048476.1488797217000.20951.1489054238089@Atlassian.JIRA>
In-Reply-To: <JIRA.13048476.1488797217000@Atlassian.JIRA>
References: <JIRA.13048476.1488797217000@Atlassian.JIRA> <JIRA.13048476.1488797217277@jira-lw-us.apache.org>
Subject: [jira] [Commented] (YARN-6290) Capacity scheduler page broken
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
archived-at: Thu, 09 Mar 2017 10:10:43 -0000


    [ https://issues.apache.org/jira/browse/YARN-6290?page=3Dcom.atlassian.=
jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D15902=
828#comment-15902828 ]=20

L=C3=A9opold Boudard commented on YARN-6290:
---------------------------------------

[~seaokcs] Indeed, it's capacity scheduler that's being used here.

> Capacity scheduler page broken
> ------------------------------
>
>                 Key: YARN-6290
>                 URL: https://issues.apache.org/jira/browse/YARN-6290
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.7.3
>            Reporter: L=C3=A9opold Boudard
>
> Hello,
> I have an issue very similar to this one
> https://issues.apache.org/jira/browse/YARN-3478
> not being able to access to scheduler interface in yarn webapp.
> Except that traceback is bit different (NullPointerException and could be=
 be caused by stale queue configuration.
> I suspect QueueCapacitiesInfo.java initializing info object with null val=
ue for some reason.
> Below traceback:
> ```
> 2017-03-06 10:20:00,945 ERROR webapp.Dispatcher (Dispatcher.java:service(=
162)) - error handling URI: /cluster/scheduler
> java.lang.reflect.InvocationTargetException
> =09at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> =09at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImp=
l.java:62)
> =09at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcc=
essorImpl.java:43)
> =09at java.lang.reflect.Method.invoke(Method.java:497)
> =09at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:15=
3)
> =09at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> =09at com.google.inject.servlet.ServletDefinition.doService(ServletDefini=
tion.java:263)
> =09at com.google.inject.servlet.ServletDefinition.service(ServletDefiniti=
on.java:178)
> =09at com.google.inject.servlet.ManagedServletPipeline.service(ManagedSer=
vletPipeline.java:91)
> =09at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChai=
nInvocation.java:62)
> =09at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(Serv=
letContainer.java:900)
> =09at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(Serv=
letContainer.java:834)
> =09at org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebAppFilter=
.doFilter(RMWebAppFilter.java:178)
> =09at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(Serv=
letContainer.java:795)
> =09at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinitio=
n.java:163)
> =09at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChai=
nInvocation.java:58)
> =09at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFil=
terPipeline.java:118)
> =09at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113=
)
> =09at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servl=
etHandler.java:1212)
> =09at org.apache.hadoop.security.http.XFrameOptionsFilter.doFilter(XFrame=
OptionsFilter.java:57)
> =09at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servl=
etHandler.java:1212)
> =09at org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter.doF=
ilter(StaticUserWebFilter.java:109)
> =09at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servl=
etHandler.java:1212)
> =09at org.apache.hadoop.security.authentication.server.AuthenticationFilt=
er.doFilter(AuthenticationFilter.java:614)
> =09at org.apache.hadoop.security.authentication.server.AuthenticationFilt=
er.doFilter(AuthenticationFilter.java:573)
> =09at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servl=
etHandler.java:1212)
> =09at org.apache.hadoop.security.http.CrossOriginFilter.doFilter(CrossOri=
ginFilter.java:95)
> =09at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servl=
etHandler.java:1212)
> =09at org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(Http=
Server2.java:1294)
> =09at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servl=
etHandler.java:1212)
> =09at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45=
)
> =09at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servl=
etHandler.java:1212)
> =09at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45=
)
> =09at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(Servl=
etHandler.java:1212)
> =09at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java=
:399)
> =09at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.j=
ava:216)
> =09at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java=
:182)
> =09at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java=
:767)
> =09at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:45=
0)
> =09at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHa=
ndlerCollection.java:230)
> =09at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java=
:152)
> =09at org.mortbay.jetty.Server.handle(Server.java:326)
> =09at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:=
542)
> =09at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(Http=
Connection.java:928)
> =09at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
> =09at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> =09at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
> =09at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.=
java:410)
> =09at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool=
.java:582)
> Caused by: java.lang.NullPointerException
> =09at org.apache.hadoop.yarn.server.resourcemanager.webapp.dao.PartitionQ=
ueueCapacitiesInfo.getMaxAMLimitPercentage(PartitionQueueCapacitiesInfo.jav=
a:114)
> =09at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedu=
lerPage$LeafQueueInfoBlock.renderQueueCapacityInfo(CapacitySchedulerPage.ja=
va:155)
> =09at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedu=
lerPage$LeafQueueInfoBlock.renderLeafQueueInfoWithPartition(CapacitySchedul=
erPage.java:105)
> =09at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedu=
lerPage$LeafQueueInfoBlock.render(CapacitySchedulerPage.java:94)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:=
69)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBloc=
k.java:79)
> =09at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBloc=
k.java:43)
> =09at org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.=
java:117)
> =09at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$LI._(Hamlet.java:7702)
> =09at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedu=
lerPage$QueueBlock.render(CapacitySchedulerPage.java:294)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:=
69)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBloc=
k.java:79)
> =09at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBloc=
k.java:43)
> =09at org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.=
java:117)
> =09at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$LI._(Hamlet.java:7702)
> =09at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedu=
lerPage$QueuesBlock.render(CapacitySchedulerPage.java:454)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:=
69)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBloc=
k.java:79)
> =09at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlPage$Page.subView(HtmlPage.j=
ava:49)
> =09at org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.=
java:117)
> =09at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$TD._(Hamlet.java:845)
> =09at org.apache.hadoop.yarn.webapp.view.TwoColumnLayout.render(TwoColumn=
Layout.java:56)
> =09at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:82=
)
> =09at org.apache.hadoop.yarn.webapp.Controller.render(Controller.java:212=
)
> =09at org.apache.hadoop.yarn.server.resourcemanager.webapp.RmController.s=
cheduler(RmController.java:82)
> =09... 49 more
> ```
> (no other symptoms than gui not working)
> Could someone help with this issue? I keep investigating on my end.
> Thanks!


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org