hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shrijeet Paliwal <shrij...@rocketfuel.com>
Subject Re: DFS error
Date Fri, 08 Oct 2010 17:10:29 GMT
David,
Your namenode is not configured (its not mentioned in what you sent). Add
this in core-site.xml

<property>
  <name>fs.default.name</name>
  <value>hdfs://localhost:8020</value>
  <description>The name of the default file system.  A URI whose
  scheme and authority determine the FileSystem implementation.  The
  uri's scheme determines the config property (fs.SCHEME.impl) naming
  the FileSystem implementation class.  The uri's authority is used to
  determine the host, port, etc. for a filesystem.</description>
</property>
</configuration>

PS: hive-user may not be the right mailing list for general hadoop issues..
I think this one would be right :
http://hadoop.apache.org/mailing_lists.html

On Fri, Oct 8, 2010 at 11:50 PM, David Lary <davidlary@gmail.com> wrote:

> Please can someone help.
>
> Tried to set up pseudo-distributed mode for DFS. When I do start-dfs.sh I
> get the error message below, and am not sure what it means. Any help would
> be most appreciated.
>
> Thanks
>
> David
>
> $ start-dfs.sh
> starting namenode, logging to
> /Users/davidlary/hadoop-0.20.2/bin/../logs/hadoop-davidlary-namenode-129.110.31.40.out
> localhost: starting datanode, logging to
> /Users/davidlary/hadoop-0.20.2/bin/../logs/hadoop-davidlary-datanode-129.110.31.40.out
> localhost: starting secondarynamenode, logging to
> /Users/davidlary/hadoop-0.20.2/bin/../logs/hadoop-davidlary-secondarynamenode-129.110.31.40.out
> localhost: Exception in thread "main" java.lang.NullPointerException
> localhost:      at
> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:134)
> localhost:      at
> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:156)
> localhost:      at
> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:160)
> localhost:      at
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(SecondaryNameNode.java:131)
> localhost:      at
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.<init>(SecondaryNameNode.java:115)
> localhost:      at
> org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.main(SecondaryNameNode.java:469)
>
>
> The conf/hdfs-site.xml file contains:
>
> <?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <!-- Put site-specific property overrides in this file. -->
> <configuration>
>        <property>
>                <name>dfs.replication</name>
>                <value>1</value>
>        </property>
> </configuration>
>
> and the mapred-site.xml file contains:
>
> <?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <!-- Put site-specific property overrides in this file. -->
> <configuration>
>
>        <property>
>                <name>mapred.job.tracker</name>
>                <value>localhost:8021</value>
>        </property>
>
>        <property>
>                <name>mapred.local.dir</name>
>                <value>/mapred/local/</value>
>                <final>true</final>
>        </property>
>
>        <property>
>                <name>mapred.system.dir</name>
>                <value>/mapred/system/</value>
>                <final>true</final>
>        </property>
>
>        <property>
>                <name>mapred.tasktracker.map.tasks.maximum</name>
>                <value>15</value>
>                <final>true</final>
>        </property>
>
>        <property>
>                <name>mapred.tasktracker.reduce.tasks.maximum</name>
>                <value>15</value>
>                <final>true</final>
>        </property>
>
>        <property>
>                <name>mapred.child.java.opts</name>
>                <value>-Xmx800m</value>
>        </property>
>
> </configuration>
>
>
>

Mime
View raw message