ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sumit Mohanty (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-21471) ATS going down due to missing org.apache.spark.deploy.history.yarn.plugin.SparkATSPlugin
Date Fri, 14 Jul 2017 05:16:00 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-21471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16086874#comment-16086874
] 

Sumit Mohanty commented on AMBARI-21471:
----------------------------------------

This is because the following config property has a wrong value
{code}
<property>
      <name>yarn.timeline-service.entity-group-fs-store.group-id-plugin-classpath</name>
      <value>{&#34;HDP&#34;:&#34;/usr/hdp&#34;}/${hdp.version}/spark/hdpLib/*</value>
    </property>
{code}

This is because the stack advisor needs a logic to parse out the root path per stack.

> ATS going down due to missing org.apache.spark.deploy.history.yarn.plugin.SparkATSPlugin
> ----------------------------------------------------------------------------------------
>
>                 Key: AMBARI-21471
>                 URL: https://issues.apache.org/jira/browse/AMBARI-21471
>             Project: Ambari
>          Issue Type: Bug
>          Components: stacks
>    Affects Versions: 2.5.2
>            Reporter: Sumit Mohanty
>             Fix For: 2.5.2
>
>
> ATS is going down with
> {code}
> 2017-07-12 02:48:01,542 FATAL applicationhistoryservice.ApplicationHistoryServer (ApplicationHistoryServer.java:launchAppHistoryServer(177))
- Error starting ApplicationHistoryServer
> java.lang.RuntimeException: No class defined for org.apache.spark.deploy.history.yarn.plugin.SparkATSPlugin
>         at org.apache.hadoop.yarn.server.timeline.EntityGroupFSTimelineStore.loadPlugIns(EntityGroupFSTimelineStore.java:256)
>         at org.apache.hadoop.yarn.server.timeline.EntityGroupFSTimelineStore.serviceInit(EntityGroupFSTimelineStore.java:196)
>         at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
>         at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.serviceInit(ApplicationHistoryServer.java:111)
>         at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
>         at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.launchAppHistoryServer(ApplicationHistoryServer.java:174)
>         at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.main(ApplicationHistoryServer.java:184)
> Caused by: java.lang.ClassNotFoundException: org.apache.spark.deploy.history.yarn.plugin.SparkATSPlugin
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>         at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:197)
>         at org.apache.hadoop.util.ApplicationClassLoader.loadClass(ApplicationClassLoader.java:165)
>         at java.lang.Class.forName0(Native Method)
>         at java.lang.Class.forName(Class.java:348)
>         at org.apache.hadoop.yarn.server.timeline.EntityGroupFSTimelineStore.loadPlugIns(EntityGroupFSTimelineStore.java:243)
>         ... 7 more
> 2017-07-12 02:48:01,544 INFO  util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting
with status -1
> 2017-07-12 02:48:01,551 INFO  applicationhistoryservice.ApplicationHistoryServer (LogAdapter.java:info(45))
- SHUTDOWN_MSG:
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message