hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mpiller <m...@themidnightcoders.com>
Subject local mode with S3 configuration
Date Wed, 19 Aug 2009 13:19:50 GMT

Hi,

I tried searching the forum for an answer and could not find it..

I am running Hadoop in the local mode - very basic single-server setup. I
set the configuration to use s3n, that is I have properties fs.default.name,
fs.s3n.awsAccessKeyId and fs.s3n.awsSecretAccessKey configured in
hadoop-site.xml. What is not clear to me is how my namenode should be
configured. My configuration file includes the following:

<property>
  <name>mapred.job.tracker</name>
  <value>localhost:47111</value>
</property>

<property>
  <name>dfs.replication</name>
  <value>2</value>
</property>

and I see an exception in the namenode log file (where XXXXXX is the name of
my S3 bucket):

2009-08-19 07:44:56,593 ERROR
org.apache.hadoop.hdfs.server.namenode.NameNode:
java.net.UnknownHostException: Invalid hostname for server: XXXXXX
	at org.apache.hadoop.ipc.Server.bind(Server.java:179)
	at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:234)
	at org.apache.hadoop.ipc.Server.<init>(Server.java:960)
	at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:465)
	at org.apache.hadoop.ipc.RPC.getServer(RPC.java:427)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:153)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:208)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:194)
	at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:859)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:868)

My questions are:

- do I need a namenode if I use S3 for input/output?
- If I do, what should it be set to?


Regards,
Mark
-- 
View this message in context: http://www.nabble.com/local-mode-with-S3-configuration-tp25043948p25043948.html
Sent from the HBase User mailing list archive at Nabble.com.


Mime
View raw message