hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "boris starchev" <bstarc...@ru.acad.bg>
Subject Failed to run the Quickstart guide for Pseudo-distributed operation
Date Wed, 09 Jul 2008 11:18:45 GMT
I was following the Hadoop 0.17.0 quickstart guide (Windows and Cygwin).

First of all:

1)in C:\cygwin\home\bstarchev change hadoop-env.sh and copy in
C:\hadoop-0.17.0\conf
echo 'export JAVA_HOME=/cygdrive/c/"Program Files"/Java/jdk1.5.0_12' >>
hadoop-env.sh

2)in C:\cygwin\home\bstarchev create hadoop-site.xml and copy in
C:\hadoop-0.17.0\conf
echo '<?xml version="1.0"?>' 						> hadoop-site.xml
echo '<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>' 	>>
hadoop-site.xml
echo '<!-- Put site-specific property overrides in this file. -->' 	>>
hadoop-site.xml
echo " <configuration>" 						>> hadoop-site.xml
echo "   <property>" 							>> hadoop-site.xml
echo "     <name>fs.default.name</name>" 				>> hadoop-site.xml
echo "     <value>localhost:9000</value>" 				>> hadoop-site.xml
echo "   </property>" 							>> hadoop-site.xml
echo "   <property>" 							>> hadoop-site.xml
echo "     <name>mapred.job.tracker</name>" 				>> hadoop-site.xml
echo "     <value>localhost:9001</value>" 				>> hadoop-site.xml
echo "   </property>" 							>> hadoop-site.xml
echo "   <property>" 							>> hadoop-site.xml
echo "     <name>dfs.replication</name>" 				>> hadoop-site.xml
echo "     <value>1</value>" 						>> hadoop-site.xml
echo "   </property>" 							>> hadoop-site.xml
echo " </configuration>" 						>> hadoop-site.xml

3)
bstarchev@bis-laptop ~
$ cd /cygdrive/c/hadoop-0.17.0

bstarchev@bis-laptop /cygdrive/c/hadoop-0.17.0
$ bin/hadoop namenode -format
08/07/09 13:22:51 INFO dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = bis-laptop/192.168.85.56
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 0.17.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/bran
ch-0.17 -r 656523; compiled by 'hadoopqa' on Thu May 15 07:22:55 UTC 2008
************************************************************/
08/07/09 13:22:53 INFO fs.FSNamesystem:
fsOwner=bstarchev,None,root,Administrato
rs,Users,SophosUser
08/07/09 13:22:53 INFO fs.FSNamesystem: supergroup=supergroup
08/07/09 13:22:53 INFO fs.FSNamesystem: isPermissionEnabled=true
08/07/09 13:22:53 INFO dfs.Storage: Storage directory
\tmp\hadoop-bstarchev\dfs\
name has been successfully formatted.
08/07/09 13:22:53 INFO dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at bis-laptop/192.168.85.56
************************************************************/


bstarchev@bis-laptop /cygdrive/c/hadoop-0.17.0
$ bin/start-all.sh
starting namenode, logging to
/cygdrive/c/hadoop-0.17.0/bin/../logs/hadoop-bstar
chev-namenode-bis-laptop.out
: no address associated with name localhost
: no address associated with name localhost
starting jobtracker, logging to
/cygdrive/c/hadoop-0.17.0/bin/../logs/hadoop-bst
archev-jobtracker-bis-laptop.out
: no address associated with name localhost


bstarchev@bis-laptop /cygdrive/c/hadoop-0.17.0
$ bin/hadoop dfs -put conf input
08/07/09 13:27:16 WARN fs.FileSystem: "localhost:9000" is a deprecated
filesyste
m name. Use "hdfs://localhost:9000/" instead.
08/07/09 13:27:17 WARN fs.FileSystem: "localhost:9000" is a deprecated
filesyste
m name. Use "hdfs://localhost:9000/" instead.
08/07/09 13:27:17 WARN fs.FileSystem: "localhost:9000" is a deprecated
filesyste
m name. Use "hdfs://localhost:9000/" instead.
08/07/09 13:27:17 WARN fs.FileSystem: "localhost:9000" is a deprecated
filesyste
m name. Use "hdfs://localhost:9000/" instead.
08/07/09 13:27:17 INFO dfs.DFSClient:
org.apache.hadoop.ipc.RemoteException: jav
a.io.IOException: File /user/bstarchev/input/commons-logging.properties
could on
ly be replicated to 0 nodes, instead of 1
        at
org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSNamesystem.ja
va:1145)
        at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:300)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.
java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
sorImpl.java:25)
..........................................

4)
If I changed two rows in hadoop-site.xml to:
echo "     <name>fs.default.name</name>" 				>> hadoop-site.xml
echo "     <value>hdfs://localhost:9000</value>" 			>> hadoop-site.xml
delete c:/temp (with DFS) and repeat.
The results are:

bstarchev@bis-laptop /cygdrive/c/hadoop-0.17.0
$ bin/hadoop namenode -format
08/07/09 14:08:26 INFO dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = bis-laptop/192.168.85.56
STARTUP_MSG:   args = [-format]
STARTUP_MSG:   version = 0.17.0
STARTUP_MSG:   build =
http://svn.apache.org/repos/asf/hadoop/core/branches/bran
ch-0.17 -r 656523; compiled by 'hadoopqa' on Thu May 15 07:22:55 UTC 2008
************************************************************/
08/07/09 14:08:27 INFO fs.FSNamesystem:
fsOwner=bstarchev,None,root,Administrato
rs,Users,SophosUser
08/07/09 14:08:27 INFO fs.FSNamesystem: supergroup=supergroup
08/07/09 14:08:27 INFO fs.FSNamesystem: isPermissionEnabled=true
08/07/09 14:08:27 INFO dfs.Storage: Storage directory
\tmp\hadoop-bstarchev\dfs\
name has been successfully formatted.
08/07/09 14:08:27 INFO dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at bis-laptop/192.168.85.56
************************************************************/

bstarchev@bis-laptop /cygdrive/c/hadoop-0.17.0
$ bin/start-all.sh
starting namenode, logging to
/cygdrive/c/hadoop-0.17.0/bin/../logs/hadoop-bstar
chev-namenode-bis-laptop.out
: no address associated with name localhost
: no address associated with name localhost
starting jobtracker, logging to
/cygdrive/c/hadoop-0.17.0/bin/../logs/hadoop-bst
archev-jobtracker-bis-laptop.out
: no address associated with name localhost

bstarchev@bis-laptop /cygdrive/c/hadoop-0.17.0
$ bin/hadoop dfs -put conf input
08/07/09 14:09:21 INFO dfs.DFSClient:
org.apache.hadoop.ipc.RemoteException: jav
a.io.IOException: File /user/bstarchev/input/commons-logging.properties
could on
ly be replicated to 0 nodes, instead of 1
        at
org.apache.hadoop.dfs.FSNamesystem.getAdditionalBlock(FSNamesystem.ja
va:1145)
        at org.apache.hadoop.dfs.NameNode.addBlock(NameNode.java:300)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.
java:39)

Any suggestions?
Thanks in advance!
Boris Starchev Teacher

Mime
View raw message