hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eli Finkelshteyn <iefin...@gmail.com>
Subject Netstat Shows Port 8020 Doesn't Seem to Listen
Date Mon, 09 Jan 2012 18:14:06 GMT
Hi,
I've been googling, but haven't been able to find an answer. I'm 
currently trying to setup Hadoop in pseudo-distributed mode as a first 
step. I'm using the Cloudera distro and installed everything through YUM 
on CentOS 5.7. I can run everything just fine from my one node itself 
(hadoop fs -ls /, test map-red jobs, etc...), but can't get a remote 
client to be able to connect to it. I'm pretty sure the cause of that 
has to do with the fact that port 8020 and port 8021 do not seem to be 
listening (when I do a netstat -a, they don't show up-- all the other 
Hadoop related ports like 50030 and 50070 do show up). I verified that 
the firewall allows connections over 8020 and 8021 for tcp, and can 
connect through my web browser to 50030 and 50070.

Looking at the namenode log, I see the following error which looks 
suspicious and related to me:

    2012-01-09 12:03:38,000 INFO org.apache.hadoop.ipc.Server: IPC
    Server listener on 8020: starting
    2012-01-09 12:03:38,009 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 0 on 8020: starting
    2012-01-09 12:03:39,187 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 2 on 8020: starting
    2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 3 on 8020: starting
    2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 4 on 8020: starting
    2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 5 on 8020: starting
    2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 6 on 8020: starting
    2012-01-09 12:03:39,189 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 1 on 8020: starting
    2012-01-09 12:03:39,189 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 7 on 8020: starting
    2012-01-09 12:03:39,189 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 8 on 8020: starting
    2012-01-09 12:03:39,246 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 9 on 8020: starting
    2012-01-09 12:03:39,258 WARN
    org.apache.hadoop.util.PluginDispatcher: Unable to load
    dfs.namenode.plugins plugins
    2012-01-09 12:03:40,254 INFO org.apache.hadoop.ipc.Server: IPC
    Server handler 8 on 8020, call
    addBlock(/var/lib/hadoop-0.20/cache/mapred/mapred/system/jobtracker.info,
    DFSClient_-1779116177, null) from 127.0.0.1:39785: error:
    java.io.IOException: File
    /var/lib/hadoop-0.20/cache/mapred/mapred/system/jobtracker.info
    could only be replicated to 0 nodes, instead of 1

Anyone have any idea what my problem might be?

Cheers,
Eli

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message