hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chao Huang <chaomhu...@gmail.com>
Subject New bie questions re: namenode and masters
Date Thu, 24 May 2012 11:30:06 GMT
Hello experts,

I'm new to hdfs/hadoop.  After reading the hdfs documents, I'm getting
confused by the differences between a namenode and a master server.  It's
my understanding that the namenode is responsible for managing metadata,
while the master-replica group (which is comprised by a number of
datanodes) stores the actual data blocks.  In the master-replica group, the
master server accepts read/write requests, and load balances (or routes)
read requests to the appropriate replica. In other words, we should
configure the namenode and master server on two different physical machines
in a production environment, right?  Is this a correct assumption?

One other question about HDFS cluster setup:

- requirements:  one namenode, replication factor = 3, in a production

how would the topology look like?  Can I configure as follows?

in conf/core-site.xml:
    fs.default.name = hdfs://machineAAA:54321/

in conf/masters:

in conf/slaves:

Can someone please confirm and/or comment?

Sorry for my new bie questions. Thanks for the help.


View raw message