hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hemanth Yamijala <yhema...@thoughtworks.com>
Subject Re: hadoop cluster not working
Date Sun, 10 Mar 2013 14:01:36 GMT
Have you configured your JobTracker's IPC port as 54311. Sharing your
configuration may be helpful.

Thanks
Hemanth


On Sun, Mar 10, 2013 at 11:56 AM, mallik arjun <mallik.cloud@gmail.com>wrote:

> i have seen the logs and the reason for the error is
> 13/03/10 10:26:45 ERROR security.UserGroupInformation:
> PriviledgedActionException as:mallik cause:java.io.IOException: Call to
> localhost/127.0.0.1:54311 failed on local exception: java.io.IOException:
> Connection reset by peer
> Exception in thread "main" java.io.IOException: Call to localhost/
> 127.0.0.1:54311 failed on local exception: java.io.IOException:
> Connection reset by peer
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
>  at org.apache.hadoop.ipc.Client.call(Client.java:1075)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
>  at org.apache.hadoop.mapred.$Proxy2.getProtocolVersion(Unknown Source)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
>  at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
> at org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:480)
>  at org.apache.hadoop.mapred.JobClient.init(JobClient.java:474)
> at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:457)
>  at org.apache.hadoop.mapreduce.Job$1.run(Job.java:513)
> at java.security.AccessController.doPrivileged(Native Method)
>  at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>  at org.apache.hadoop.mapreduce.Job.connect(Job.java:511)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:499)
>  at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
> at MaxTemperature.main(MaxTemperature.java:31)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
>  at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Caused by: java.io.IOException: Connection reset by peer
> at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>  at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:218)
>  at sun.nio.ch.IOUtil.read(IOUtil.java:191)
> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:359)
>  at
> org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:55)
> at
> org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
>  at
> org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:155)
> at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:128)
>  at java.io.FilterInputStream.read(FilterInputStream.java:133)
> at
> org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:342)
>  at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
> at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
>  at java.io.DataInputStream.readInt(DataInputStream.java:387)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:804)
>  at org.apache.hadoop.ipc.Client$Connection.run(Client.java:749)
>
>
> On Sun, Mar 10, 2013 at 10:33 AM, mallik arjun <mallik.cloud@gmail.com>wrote:
>
>> both name node and job tracker are working well
>>
>>
>>
>> On Sun, Mar 10, 2013 at 10:25 AM, Jagat Singh <jagatsingh@gmail.com>wrote:
>>
>>> What is coming on
>>>
>>> localhost:50070
>>> localhost:50030
>>>
>>> Are you able to see console pages?
>>>
>>>
>>>
>>>
>>> On Sun, Mar 10, 2013 at 3:49 PM, mallik arjun <mallik.cloud@gmail.com>wrote:
>>>
>>>> i am not able to run that command and logs are empty
>>>>
>>>>
>>>> On Sun, Mar 10, 2013 at 8:56 AM, feng lu <amuseme.lu@gmail.com> wrote:
>>>>
>>>>> Hi
>>>>>
>>>>> Are you able to run the wordcount example in hadoop-*-examples.jar
>>>>> using this command.
>>>>>
>>>>> bin/hadoop jar hadoop-*-examples.jar wordcount [-m <#maps>] [-r
>>>>> <#reducers>] <in-dir> <out-dir>
>>>>>
>>>>> check your JobTracker and TaskTracker is start correctly. see the logs.
>>>>>
>>>>>
>>>>> On Sun, Mar 10, 2013 at 11:01 AM, mallik arjun <mallik.cloud@gmail.com
>>>>> > wrote:
>>>>>
>>>>>> it is the not the problem of MaxTemperature.jar,even the command
of
>>>>>> any >hadoop jar  xxx.jar  input output
>>>>>>
>>>>>> when i run the command , it is like [image: Inline image 1]
>>>>>>
>>>>>>
>>>>>> On Sun, Mar 10, 2013 at 8:03 AM, feng lu <amuseme.lu@gmail.com>wrote:
>>>>>>
>>>>>>> Hi mallik
>>>>>>>
>>>>>>> Do you submit the job to JobTrackter? like this code
>>>>>>> JobClient.runJob(conf) in your MaxTemperature.jar package.
>>>>>>>
>>>>>>> maybe you can refer to this tutorial. [0]
>>>>>>>
>>>>>>> [0] http://hadoop.apache.org/docs/r1.0.4/mapred_tutorial.html
>>>>>>>
>>>>>>>
>>>>>>> On Sun, Mar 10, 2013 at 10:05 AM, mallik arjun <
>>>>>>> mallik.cloud@gmail.com> wrote:
>>>>>>>
>>>>>>>> hai guys i am using hadoop version 1.0.3 , it was ran well
before.
>>>>>>>> even now  if use >hadoop fs -ls these commands well but
when i use the
>>>>>>>> commands like >hadoop jar /home/mallik/definite/MaxTemperature.jar
 input
>>>>>>>>  outputmap
>>>>>>>>
>>>>>>>> the cluster is not processing the job, what might be the
problem,
>>>>>>>> please help me, when i see logs,nothing in the logs. please
help me it is
>>>>>>>> very urget.
>>>>>>>>
>>>>>>>> thanks in advance.
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Don't Grow Old, Grow Up... :-)
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Don't Grow Old, Grow Up... :-)
>>>>>
>>>>
>>>>
>>>
>>
>

Mime
View raw message