hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Li Li <fancye...@gmail.com>
Subject Re: UserGroupInformation when running randomwriter test
Date Sat, 17 Nov 2012 15:33:01 GMT
I don't have root acount. I use netstat -lnp | grep java
tcp        0      0 10.81.33.22:9000            0.0.0.0:*
LISTEN      5590/java
tcp        0      0 10.81.33.22:9001            0.0.0.0:*
LISTEN      5782/java
tcp        0      0 0.0.0.0:50030               0.0.0.0:*
LISTEN      5782/java
tcp        0      0 0.0.0.0:50070               0.0.0.0:*
LISTEN      5590/java

it seems 50030 and 50070 port are bind to 0.0.0.0(all ip) but 9001 only
10.81.33.22. is it the problem?


On Sat, Nov 17, 2012 at 11:20 PM, Harsh J <harsh@cloudera.com> wrote:

> Are you sure that port 9001 is running the JobTracker service? Seems
> to me like you are trying to connect to the NameNode instead of the
> JobTracker.
>
> On Sat, Nov 17, 2012 at 3:29 PM, Li Li <fancyerii@gmail.com> wrote:
> > hi all
> >    I am trying to set up a hadoop cluster and run the random writer test
> >    hadoop jar /home/work/lili/hadoop-1.0.4/hadoop-examples-1.0.4.jar
> > randomwriter random-data
> >    but there is an exception. After this exception, the jobtracker is
> > crashed.
> >
> >
> > [work@db-fcr-dev00.db01 hadoop-1.0.4]$ hadoop jar
> > /home/work/lili/hadoop-1.0.4/hadoop-examples-1.0.4.jar randomwriter
> > random-data
> > Running 0 maps.
> > Job started: Sat Nov 17 17:50:37 CST 2012
> > 12/11/17 17:50:38 INFO mapred.JobClient: Cleaning up the staging area
> >
> hdfs://db-fcr-dev00.db01:9000/tmp/hadoop-work/mapred/staging/work/.staging/job_201211171750_0001
> > 12/11/17 17:50:38 ERROR security.UserGroupInformation:
> > PriviledgedActionException as:work cause:java.io.IOException: Call to
> > db-fcr-dev00.db01/xx.33.22:9001 failed on local exception:
> > java.io.EOFException
> > java.io.IOException: Call to db-fcr-dev00.db01/xx.33.22:9001 failed on
> local
> > exception: java.io.EOFException
> >         at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
> >         at org.apache.hadoop.ipc.Client.call(Client.java:1075)
> >         at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
> >         at org.apache.hadoop.mapred.$Proxy2.submitJob(Unknown Source)
> >         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:921)
> >         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:396)
> >         at
> >
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> >         at
> > org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> >         at
> org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
> >         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
> >         at
> > org.apache.hadoop.examples.RandomWriter.run(RandomWriter.java:272)
> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >         at
> > org.apache.hadoop.examples.RandomWriter.main(RandomWriter.java:283)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >         at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:597)
> >         at
> >
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> >         at
> > org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
> >         at
> > org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >         at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:597)
> >         at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> > Caused by: java.io.EOFException
> >         at java.io.DataInputStream.readInt(DataInputStream.java:375)
> >         at
> > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:804)
> >         at org.apache.hadoop.ipc.Client$Connection.run(Client.java:749)
> > [work@db-fcr-dev00.db01 hadoop-1.0.4]$ jps
> > 16663 NameNode
> > 17086 Jps
>
>
>
> --
> Harsh J
>

Mime
View raw message