hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From A Df <abbey_dragonfor...@yahoo.com>
Subject cygwin not connecting to Hadoop server
Date Wed, 27 Jul 2011 16:25:05 GMT
Hi All:

I am have Hadoop 0.20.2 and I am using cygwin on Windows 7. I modified the files as shown
below for the Hadoop configuration.

conf/core-site.xml:

<configuration>
     <property>
         <name>fs.default.name</name>
         <value>hdfs://localhost:9100</value>
     </property>
</configuration>


conf/hdfs-site.xml:

<configuration>
     <property>
         <name>dfs.replication</name>
         <value>1</value>
     </property>
</configuration>


conf/mapred-site.xml:

<configuration>
     <property>
         <name>mapred.job.tracker</name>
         <value>localhost:9101</value>
     </property>
</configuration>

Then I have the PATH variable with
$PATH:/cygdrive/c/cygwin/bin:/cygdrive/c/cygwin/usr/bin

I added JAVA_HOME to the file in cygwin\home\Williams\hadoop-0.20.2\conf\hadoop-env.sh. 
My Java home is now at C:\Java\jdk1.6.0_26 so there is not space. I also turned off my firewall.

However, I get the error from the command line:

<CODE>
Williams@TWilliams-LTPC ~
$ pwd
/home/Williams

Williams@TWilliams-LTPC ~
$ cd hadoop-0.20.2

Williams@TWilliams-LTPC ~/hadoop-0.20.2
$ bin/start-all.sh
starting namenode, logging to /home/Williams/hadoop-0.20.2/bin/../logs/hadoop-Wi
lliams-namenode-TWilliams-LTPC.out
localhost: starting datanode, logging to /home/Williams/hadoop-0.20.2/bin/../log
s/hadoop-Williams-datanode-TWilliams-LTPC.out
localhost: starting secondarynamenode, logging to /home/Williams/hadoop-0.20.2/b
in/../logs/hadoop-Williams-secondarynamenode-TWilliams-LTPC.out
starting jobtracker, logging to /home/Williams/hadoop-0.20.2/bin/../logs/hadoop-
Williams-jobtracker-TWilliams-LTPC.out
localhost: starting tasktracker, logging to /home/Williams/hadoop-0.20.2/bin/../
logs/hadoop-Williams-tasktracker-TWilliams-LTPC.out

Williams@TWilliams-LTPC ~/hadoop-0.20.2
$ bin/hadoop fs -put conf input
11/07/27 17:11:28 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 0 time(s).
11/07/27 17:11:30 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 1 time(s).
11/07/27 17:11:32 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 2 time(s).
11/07/27 17:11:34 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 3 time(s).
11/07/27 17:11:36 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 4 time(s).
11/07/27 17:11:38 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 5 time(s).
11/07/27 17:11:40 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 6 time(s).
11/07/27 17:11:43 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 7 time(s).
11/07/27 17:11:45 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 8 time(s).
11/07/27 17:11:47 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 9 time(s).
Bad connection to FS. command aborted.

Williams@TWilliams-LTPC ~/hadoop-0.20.2
$ bin/hadoop fs -put conf input
11/07/27 17:17:29 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 0 time(s).
11/07/27 17:17:31 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 1 time(s).
11/07/27 17:17:33 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 2 time(s).
11/07/27 17:17:35 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 3 time(s).
11/07/27 17:17:37 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 4 time(s).
11/07/27 17:17:39 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 5 time(s).
11/07/27 17:17:41 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 6 time(s).
11/07/27 17:17:44 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 7 time(s).
11/07/27 17:17:46 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 8 time(s).
11/07/27 17:17:48 INFO ipc.Client: Retrying connect to server: localhost/127.0.0
.1:9100. Already tried 9 time(s).
Bad connection to FS. command aborted.

Williams@TWilliams-LTPC ~/hadoop-0.20.2
$ ping 127.0.0.1:9100
Ping request could not find host 127.0.0.1:9100. Please check the name and try a
gain.
</CODE>

I am not sure why the ip address seem to have localhost/127.0.0.1 which seems to be repeating
itself. The conf files are fine. I also know that when Hadoop is running there is a web interface
to check but do the default ones work from cygwin which are:
    * NameNode - http://localhost:50070/
    * JobTracker - http://localhost:50030/

I wanted to give the cygwin a try once more before just switching to a cloudera hadoop vmware.
I was hoping that it would not have so many problems just to get it working on Windows! Thanks
again.

Cheers,
A Df
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message