hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jpe30 <jpotte...@gmail.com>
Subject Re: Datanode Setup
Date Wed, 15 Apr 2009 19:09:55 GMT

That helps a lot actually.  I will try setting up my hosts file tomorrow and
make the other changes you suggested.

Thanks!



Mithila Nagendra wrote:
> 
> Hi,
> The replication factor has to be set to 1. Also for you dfs and job
> tracker
> configuration you should insert the name of the node rather than the i.p
> address.
> 
> For instance:
>  <value>192.168.1.10:54310</value>
> 
> can be:
> 
>  <value>master:54310</value>
> 
> The nodes can be renamed by renaming them in the hosts files in /etc
> folder.
> It should look like the following:
> 
> # Do not remove the following line, or various programs
> # that require network functionality will fail.
> 127.0.0.1       localhost.localdomain   localhost       node01
> 192.168.0.1     node01
> 192.168.0.2     node02
> 192.168.0.3     node03
> 
> Hope this helps
> Mithila
> 
> On Wed, Apr 15, 2009 at 9:40 PM, jpe30 <jpotter05@gmail.com> wrote:
> 
>>
>> I'm setting up a Hadoop cluster and I have the name node and job tracker
>> up
>> and running.  However, I cannot get any of my datanodes or tasktrackers
>> to
>> start.  Here is my hadoop-site.xml file...
>>
>>
>>
>> <?xml version="1.0"?>
>> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>>
>> <!-- Put site-specific property overrides in this file. -->
>>
>> <configuration>
>>
>> <property>
>>  <name>hadoop.tmp.dir</name>
>>  <value>/home/hadoop/h_temp</value>
>>  <description>A base for other temporary directories.</description>
>> </property>
>>
>> <property>
>>  <name>dfs.data.dir</name>
>>  <value>/home/hadoop/data</value>
>> </property>
>>
>> <property>
>>  <name>fs.default.name</name>
>>   <value>192.168.1.10:54310</value>
>>  <description>The name of the default file system.  A URI whose
>>   scheme and authority determine the FileSystem implementation.  The
>>  uri's scheme determines the config property (fs.SCHEME.impl) naming
>>  the FileSystem implementation class.  The uri's authority is used to
>>   determine the host, port, etc. for a filesystem.</description>
>>  <final>true</final>
>> </property>
>>
>> <property>
>>  <name>mapred.job.tracker</name>
>>   <value>192.168.1.10:54311</value>
>>  <description>The host and port that the MapReduce job tracker runs
>>   at.  If "local", then jobs are run in-process as a single map
>>  and reduce task.
>>   </description>
>> </property>
>>
>> <property>
>>  <name>dfs.replication</name>
>>  <value>0</value>
>>   <description>Default block replication.
>>   The actual number of replications can be specified when the file is
>> created.
>>  The default is used if replication is not specified in create time.
>>   </description>
>> </property>
>>
>> </configuration>
>>
>>
>> and here is the error I'm getting...
>>
>>
>>
>>
>> 2009-04-15 14:00:48,208 INFO org.apache.hadoop.dfs.DataNode: STARTUP_MSG:
>> /************************************************************
>> STARTUP_MSG: Starting DataNode
>> STARTUP_MSG:   host = java.net.UnknownHostException: myhost: myhost
>> STARTUP_MSG:   args = []
>> STARTUP_MSG:   version = 0.18.3
>> STARTUP_MSG:   build =
>> https://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.18 -r
>> 736250;
>> compiled by 'ndaley' on Thu Jan 22 23:12:0$
>> ************************************************************/
>> 2009-04-15 14:00:48,355 ERROR org.apache.hadoop.dfs.DataNode:
>> java.net.UnknownHostException: myhost: myhost
>>        at java.net.InetAddress.getLocalHost(InetAddress.java:1353)
>>        at org.apache.hadoop.net.DNS.getDefaultHost(DNS.java:185)
>>        at org.apache.hadoop.dfs.DataNode.startDataNode(DataNode.java:249)
>>         at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:223)
>>         at
>> org.apache.hadoop.dfs.DataNode.makeInstance(DataNode.java:3071)
>>        at
>> org.apache.hadoop.dfs.DataNode.instantiateDataNode(DataNode.java:3026)
>>        at
>> org.apache.hadoop.dfs.DataNode.createDataNode(DataNode.java:3034)
>>        at org.apache.hadoop.dfs.DataNode.main(DataNode.java:3156)
>>
>> 2009-04-15 14:00:48,356 INFO org.apache.hadoop.dfs.DataNode:
>> SHUTDOWN_MSG:
>> /************************************************************
>> SHUTDOWN_MSG: Shutting down DataNode at java.net.UnknownHostException:
>> myhost: myhost
>> ************************************************************/
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Datanode-Setup-tp23064660p23064660.html
>> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>>
>>
> 
> 

-- 
View this message in context: http://www.nabble.com/Datanode-Setup-tp23064660p23065220.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.


Mime
View raw message