hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Siddhi Mehta <smehtau...@gmail.com>
Subject Yarn Exception while getting JobStatus
Date Wed, 18 Sep 2013 19:37:39 GMT
Hey All,

I am running a Hadoop 2.0(cdh4.2.1) cluster.

>From the job client whenever we try to get the job status from the cluster
we run into the following IOException.
The exception has no message on the cause of the IOException.
Any ideas on what could be causing this issue.

 Looking at the code it seems like it fails while talking to the
jobhistoryserver.
The application where the job client runs has most of the ports blocked.
We opened a the following ports for the job client to talk to the
cluster(8030,8031,8032
8033,19888, 10020) but still see the exception.
Is there a defined list of ports on which a mapreduce client communicates
with the Hadoop Cluster

 Cause1: java.io.IOException
 Cause1-StackTrace:
        at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(
ClientServiceDelegate.java:317)
        at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(
ClientServiceDelegate.java:385)
        at org.apache.hadoop.mapred.YARNRunner.getJobStatus(
YARNRunner.java:487)
        at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:184)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:635)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:633)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(
UserGroupInformation.java:1408)
        at org.apache.hadoop.mapred.JobClient.getJobUsingCluster(
JobClient.java:633)
        at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:651)

Thanks,
Siddhi

Mime
View raw message