hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zhijie Shen <zs...@hortonworks.com>
Subject Re: No job shown in Hadoop resource manager web UI when running jobs in the cluster
Date Fri, 21 Feb 2014 19:55:22 GMT
Hi Richard,

Not sure how NPE happened on you command line, but I'd like to clarify
something here:
1. If you want to see mapreduce jobs, please use "mapred job". "hadoop job"
is deprecated. If you want to see all kinds of applications run by your
YARN cluster, please use "yarn application".

2. Job history server only shows the finished mapreduce jobs. There will be
another application history server that shows all completed applications
run by YARN, but it's not available on 2.2.

3. ResourceManager webUI is not the job history web UI. You should check
your yarn-site.xml to see what's the address of the RM webUI. It will list
all the applications that RM remembers.

- Zhijie

On Thu, Feb 20, 2014 at 7:04 PM, Chen, Richard <richard.chen@intel.com>wrote:

>  Dear group,
> I compiled hadoop 2.2.0 x64 and running it on a cluster. When I do hadoop
> job -list or hadoop job -list all, it throws a NPE like this:
> 14/01/28 17:18:39 INFO Configuration.deprecation: session.id is
> deprecated. Instead, use dfs.metrics.session-id
> 14/01/28 17:18:39 INFO jvm.JvmMetrics: Initializing JVM Metrics with
> processName=JobTracker, sessionId=
> Exception in thread "main" java.lang.NullPointerException
>     at org.apache.hadoop.mapreduce.tools.CLI.listJobs(CLI.java:504)
>     at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:312)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>     at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1237)
> and on hadoop webapp like jobhistory ( I turn on the jobhistory server).
> It shows no job was running and no job finishing although I was running
> jobs.
> Please help me to solve this problem.
> Thanks!!
> Richard Chen

Zhijie Shen
Hortonworks Inc.

NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

View raw message