hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Nauroth <cnaur...@hortonworks.com>
Subject Re: Rack-awareness in Hadoop-2.0.3-alpha
Date Wed, 22 May 2013 16:49:40 GMT
common-dev and hdfs-dev removed/bcc'd

Hi Mohammad,

Rack awareness is supported in 2.0.3-alpha.  The only potential problem I
see in your configuration is that topology.sh contains a definition for
HADOOP_CONF that points back at your hadoop-0.22.0/conf directory.  If that
directory doesn't contain the right topology.data file, then resolution to
a rack might not work as you expected.

If that doesn't fix the problem, then I have another suggestion: change
topology.sh to add some debugging statements that echo to a temp file the
arguments that the script has received, and the results it decides to
print.  This would show you exactly how Hadoop called your script and
exactly what rack your script replied back to Hadoop.  It might give you an
idea for what to investigate next.

Hope this helps,

Chris Nauroth

On Wed, May 22, 2013 at 6:29 AM, Mohammad Mustaqeem

> Is Hadoop-2.0.3-alpha does not support Rack-awarness?
> I am trying to make Hadoop cluster Rack-Aware for a week but I
> haven't succeed.
> What I am doing.
> I am adding following property in etc/hadoop/core-site.xml :
> <property>
> <name>net.topology.script.file.name</name>
> <value>/home/hadoop/hadoop-2.0.3-alpha/etc/hadoop/topology.sh</value>
> </property>
> The topology.sh and topology.data is attached with this mail.
> I want to tell you that once I used this property(
> topology.script.file.name) and files to make Hadoop-0.22.0 rack-aware but
> I am unable to do the same for Hadoop-2.0.3-alpha.
> What I am doing wrong?
> Please, somebody help me.
> --
> *With regards ---*
> *Mohammad Mustaqeem*,
> M.Tech (CSE)
> MNNIT Allahabad

View raw message