hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vaibhav negi <sssssssena...@gmail.com>
Subject Re: Hadoop Cluster Configuration
Date Wed, 28 Jul 2010 08:44:02 GMT
Hi,

I am using hadoop versoion 0.20 . I am trying set up hadoop cluster. What
are the configurations for name node? What are the configurations for data
node?

In documentation all configurations  are given, but, it is not mentioned
what needs to be configured for which node.


Vaibhav Negi


On Wed, Jul 28, 2010 at 1:32 PM, Hemanth Yamijala <yhemanth@gmail.com>wrote:

> Vaibhav,
>
> > While setting hadoop cluster, does configuration files
> (conf/core-site.xml,
> > conf/mapred-site.xml,conf/hdfs-site.xml) in every node(name node and data
> > nodes)  needs to be configured in the same manner?
>
> This is a complicated question to answer :-). There are certain
> configuration variables that need to be defined to be the same between
> the master and the slaves and some that don't need to be. Pre Hadoop
> 0.21, there is no easy way other than documentation for the variables
> (hopefully) to determine if this is the case or not. I think in Hadoop
> 0.21 and since, we have tried to adopt a convention to include the
> daemon name to specify which variables are used by which daemons. And
> those that are cluster-wide, that need to be the same throughout all
> the nodes will have something like 'cluster' in the name.
>
> Your best bet in any case is possibly to sift through the
> documentation of the variables you are interested in. Or else to post
> a query here.
>
> > How does configuration of name node differs from configuration of data
> > nodes?
>
> Not sure about this one.
>
> Thanks
> hemanth
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message