incubator-ambari-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edwards, Jonathan" <Jonathan.Edwa...@Staples.com>
Subject Re: Ambari and Hue
Date Wed, 11 Sep 2013 00:24:49 GMT
Can you check with the DEV? I see that several dependencies aren't satisfied with the Apache
JobTracker class - that is it doesn't seem to know about the PluginDispatcher.

Sent from my iPhone

On Sep 10, 2013, at 3:45 PM, "Satish Abburi" <satish.abburi@gmail.com<mailto:satish.abburi@gmail.com>>
wrote:


Hi Jonathan, we just went through this scenario recently and got this working. Here are the
quick steps…if you have more questions, let me know, i will hook up with the developer who
worked on this.


    1. Hue communicates with JobTracker using Thrift service to get the job details.

                                Hue --> Thrift --> JobTracker



2.       When the JobTracker starts, it will in-turn try to start the Thrift service.



3.       The thrift service, to get started, requires "org.apache.hadoop.thriftfs.ThriftJobTrackerPlugin"
class. This class is taken from the Cloudera distribution. (hue-plugins-2.3.0-cdh4.3.0.jar
located at /usr/lib/hadoop/lib/)

                                OR

                        We can also build this jar, in Horton by following the link:https://github.com/hortonworks/hortonworks-sandbox



4.       The above said class requires "JobTrackerPlugin" class which is not available in
the Horton distribution. So, need to  add this class to the library.

This class can be found at

http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/com.cloudera.hadoop/hadoop-core/0.20.2-320/org/apache/hadoop/mapred/JobTrackerPlugin.jav<http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/com.cloudera.hadoop/hadoop-core/0.20.2-320/org/apache/hadoop/mapred/JobTrackerPlugin.java>a



Thanks,
Satish

On Tue, Sep 10, 2013 at 2:34 PM, Edwards, Jonathan <Jonathan.Edwards@staples.com<mailto:Jonathan.Edwards@staples.com>>
wrote:
Fellow Ambari Users,

I've setup a Hortonworks cluster (HDP 1.3.2) using Ambari and have HDFS, MapRed, Hive, Hbase
all working nicely. I've gotten ambitious and manually installed Hue – and been able to
get it working, with the exception of JobTracker integration. The reason that I'm emailing
the Ambari user group is that the ultimate issue seems to be that, although properly configured
in the mapped-site.xml via Ambari and present in /usr/lib/hadoop/lib on the JobTracker node
managed by Ambari, the Thrift plugin isn't loading – I suspect that the jar isn't being
added to the class path by the startup commands issued from the Ambari server to the remote
agents. Is there a way to view what the configured class path is for the job tracker? Is there
a way to override the default behavior to include additional JobTracker plugin jars?

Regards,

Jonathan Edwards
Technical Architect
Senior Systems Engineering Consultant

Staples, Inc.
1 Environmental Way | Broomfield, CO 80021





Mime
View raw message