hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Get JobInProgress given jobId
Date Wed, 28 Nov 2012 18:12:11 GMT
Two things to check and address if not true:

1. Is your client application's hadoop jar same version as the server?
2. Is the port 54311 the proper JobTracker port?

On Wed, Nov 28, 2012 at 11:37 PM, Pedro Sá da Costa <psdc1978@gmail.com> wrote:
> Yes, I already did like you tell, but I get an error in the
> connection, and this doesn't make any sense.
>
> java.io.IOException: Call to localhost/127.0.0.1:54311 failed on local
> exception: java.io.EOFException
>         at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1075)
>         at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
>         at org.apache.hadoop.mapred.$Proxy1.getProtocolVersion(Unknown Source)
>         at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
>         at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
>         at org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:498)
>         at org.apache.hadoop.mapred.JobClient.init(JobClient.java:492)
>         at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:475)
>         at org.apache.hadoop.tools.JobProgression.status(JobProgression.java:38)
>         at org.apache.hadoop.tools.JobProgression.run(JobProgression.java:98)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>         at org.apache.hadoop.tools.JobProgression.main(JobProgression.java:69)
> Caused by: java.io.EOFException
>         at java.io.DataInputStream.readInt(DataInputStream.java:375)
>         at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:804)
>         at org.apache.hadoop.ipc.Client$Connection.run(Client.java:749)
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.lang.NullPointerException
>         at org.apache.hadoop.tools.JobProgression.status(JobProgression.java:45)
>         at org.apache.hadoop.tools.JobProgression.run(JobProgression.java:98)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>         at org.apache.hadoop.tools.JobProgression.main(JobProgression.java:69)
>
>
>
> On 28 November 2012 17:44, Harsh J <harsh@cloudera.com> wrote:
>> Mahesh,
>>
>> The JobTracker is not a user-end API, it is a service. You can't query
>> it for its private objects as simply as that, and hence what you've
>> suggested would not work.
>>
>> Pedro,
>>
>> To get a RunningJob instance from a String representing the JobID you
>> need the JobClient class, and you can do like so:
>>
>> JobClient jc = new JobClient(jobConf);
>> org.apache.hadoop.mapred.JobID jId =
>> org.apache.hadoop.mapred.JobID.forName(jobIdString);
>> RunningJob rJob = jc.getJob(jId);
>> // Play with the rJob object as you want.
>>
>> On Wed, Nov 28, 2012 at 10:59 PM, Pedro Sá da Costa <psdc1978@gmail.com> wrote:
>>> I have the jobId as a String, and from that I want to access the
>>> RunningJob API for that jobId. I think that it is only possible to
>>> access this API through the JobInProgress class, but maybe I'm wrong.
>>> Is this true?
>>>
>>>
>>> On 28 November 2012 17:24, Mahesh Balija <balijamahesh.mca@gmail.com> wrote:
>>>> Hi Pedro,
>>>>
>>>>           You can get the JobInProgress instance from JobTracker.
>>>>                  JobInProgress getJob(JobID jobid);
>>>>
>>>> Best,
>>>> Mahesh Balija,
>>>> Calsoft Labs.
>>>>
>>>> On Wed, Nov 28, 2012 at 10:41 PM, Pedro Sá da Costa <psdc1978@gmail.com>
>>>> wrote:
>>>>>
>>>>> I'm building a Java class and given a JobID, how can I get the
>>>>> JobInProgress? Can anyone give me an example?
>>>>>
>>>>> --
>>>>> Best regards,
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Best regards,
>>
>>
>>
>> --
>> Harsh J
>
>
>
> --
> Best regards,



-- 
Harsh J

Mime
View raw message