hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jasmine \(Xuanjing\) Huang" <xjhu...@cs.umass.edu>
Subject Can't start fully-distributed operation of Hadoop in Sun Grid Engine
Date Sat, 25 Apr 2009 23:28:45 GMT
Hi, there,

My hadoop system (version: 0.18.3) works well under standalone and 
pseudo-distributed operation. But if I try to run hadoop in 
fully-distributed mode in Sun Grid Engine, Hadoop always failed -- in fact, 
the jobTracker and TaskzTracker can be started, but the namenode and 
secondary namenode cannot be started. Could anyone help me with it?

My SGE scripts looks like:

#!/bin/bash
#$ -cwd
#$ -S /bin/bash
#$ -l long=TRUE
#$ -v JAVA_HOME=/usr/java/latest
#$ -v HADOOP_HOME=*********
#$ -pe hadoop 6
PATH="$HADOOP_HOME/bin:$PATH"
hadoop fs -put ********
hadoop jar *****
hadoop fs -get *********

Then the output looks like:
Exception in thread "main" java.lang.NumberFormatException: For input 
string: ""
        at 
java.lang.NumberFormatException.forInputString(NumberFormatException.
java:48)
        at java.lang.Integer.parseInt(Integer.java:468)
        at java.lang.Integer.parseInt(Integer.java:497)
        at 
org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:144)
        at org.apache.hadoop.dfs.NameNode.getAddress(NameNode.java:116)
        at 
org.apache.hadoop.dfs.DistributedFileSystem.initialize(DistributedFil
eSystem.java:66)
        at 
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1339
)
        at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:56)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1351)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:213)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:118)
        at org.apache.hadoop.fs.FsShell.init(FsShell.java:88)
        at org.apache.hadoop.fs.FsShell.run(FsShell.java:1703)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.fs.FsShell.main(FsShell.java:1852)

And the log of NameNode looks like
2009-04-25 17:27:17,032 INFO org.apache.hadoop.dfs.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = ************
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.18.3
************************************************************/
2009-04-25 17:27:17,147 ERROR org.apache.hadoop.dfs.NameNode: 
java.lang.NumberFormatException: For i
nput string: ""
        at 
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
        at java.lang.Integer.parseInt(Integer.java:468)
        at java.lang.Integer.parseInt(Integer.java:497)
        at 
org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:144)
        at org.apache.hadoop.dfs.NameNode.getAddress(NameNode.java:116)
        at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:136)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
        at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:830)
        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:839)

2009-04-25 17:27:17,149 INFO org.apache.hadoop.dfs.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at ***************

Best,
Jasmine


Mime
View raw message