hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vincenzo Gulisano <vincenzo.gulis...@gmail.com>
Subject Hadoop installation problems - help
Date Mon, 14 Sep 2009 14:43:26 GMT
Hi,
after a lot of unsuccessful attempts of running hadoop distributed file
system on my machine, I've located one possible error.
Maybe you have some ideas about what's going on.

Experiment:
What I'm doing is simply executing start-all.sh and hadoop dfsadmin -report

After the setup I can check that everything is working using:

jps
...
17421 NameNode
17519 DataNode
17611 SecondaryNameNode
17685 JobTracker
17778 TaskTracker
18425 Jps
...



AND

sudo netstat -plten | grep java
...
tcp        0      0 127.0.0.1:54310         0.0.0.0:* LISTEN      1062
      346907      17421/java      (namenode)
tcp        0      0 127.0.0.1:54311         0.0.0.0:* LISTEN      1062
      347480      17685/java      (job tracker)



2 things happen launching the application:
1) The program waits and nothing happens (99% of the times)
2) The program works but the report shows that the HDFS has some problems

Taking a look to the debug:

main:

  [1] java.lang.Object.wait (native method)
  [2] java.lang.Object.wait (Object.java:485)
  [3] org.apache.hadoop.ipc.Client.call (Client.java:725)
  [4] org.apache.hadoop.ipc.RPC$Invoker.invoke (RPC.java:220)
  [5] $Proxy0.getProtocolVersion (null)
  [6] org.apache.hadoop.ipc.RPC.getProxy (RPC.java:359)
  [7] org.apache.hadoop.hdfs.DFSClient.createRPCNamenode
(DFSClient.java:105)
  [8] org.apache.hadoop.hdfs.DFSClient.<init> (DFSClient.java:208)
  [9] org.apache.hadoop.hdfs.DFSClient.<init> (DFSClient.java:169)
  [10] org.apache.hadoop.hdfs.DistributedFileSystem.initialize
(DistributedFileSystem.java:82)
  [11] org.apache.hadoop.fs.FileSystem.createFileSystem
(FileSystem.java:1,384)
  [12] org.apache.hadoop.fs.FileSystem.access$200 (FileSystem.java:66)
  [13] org.apache.hadoop.fs.FileSystem$Cache.get (FileSystem.java:1,399)
  [14] org.apache.hadoop.fs.FileSystem.get (FileSystem.java:199)
  [15] org.apache.hadoop.fs.FileSystem.get (FileSystem.java:96)
  [16] org.apache.hadoop.fs.FsShell.init (FsShell.java:85)
  [17] org.apache.hadoop.hdfs.tools.DFSAdmin.run (DFSAdmin.java:777)
  [18] org.apache.hadoop.util.ToolRunner.run (ToolRunner.java:65)
  [19] org.apache.hadoop.util.ToolRunner.run (ToolRunner.java:79)
  [20] org.apache.hadoop.hdfs.tools.DFSAdmin.main (DFSAdmin.java:858)

IPC Client (47) connection to localhost/127.0.0.1:8020 from vincenzo:
  [1] sun.nio.ch.EPollArrayWrapper.epollWait (native method)
  [2] sun.nio.ch.EPollArrayWrapper.poll (EPollArrayWrapper.java:215)
  [3] sun.nio.ch.EPollSelectorImpl.doSelect (EPollSelectorImpl.java:65)
  [4] sun.nio.ch.SelectorImpl.lockAndDoSelect (SelectorImpl.java:69)
  [5] sun.nio.ch.SelectorImpl.select (SelectorImpl.java:80)
  [6] org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select
(SocketIOWithTimeout.java:332)
  [7] org.apache.hadoop.net.SocketIOWithTimeout.doIO
(SocketIOWithTimeout.java:157)
  [8] org.apache.hadoop.net.SocketInputStream.read
(SocketInputStream.java:155)
  [9] org.apache.hadoop.net.SocketInputStream.read
(SocketInputStream.java:128)
  [10] java.io.FilterInputStream.read (FilterInputStream.java:116)
  [11] org.apache.hadoop.ipc.Client$Connection$PingInputStream.read
(Client.java:276)
  [12] java.io.BufferedInputStream.fill (BufferedInputStream.java:218)
  [13] java.io.BufferedInputStream.read (BufferedInputStream.java:237)
  [14] java.io.DataInputStream.readInt (DataInputStream.java:370)
  [15] org.apache.hadoop.ipc.Client$Connection.receiveResponse
(Client.java:501)
  [16] org.apache.hadoop.ipc.Client$Connection.run (Client.java:446)

Have you any idea about why this can happen?

I've tries also to telnet the host:port and it works. I've tried all
possible addresses in the configuration (localhost / 127.0.0.1 / name /
name.domain ).

Any help is appreciated,
Thanks in advance

Vincenzo

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message