hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mag Gam <magaw...@gmail.com>
Subject Re: rack awareness help
Date Wed, 03 Mar 2010 12:11:49 GMT
hello jeff:

yes, I have looked at this page many times.

I guess I am a bit confused with this line, "The default
implementation of the same runs a script/command configured using
topology.script.file.name. If topology.script.file.name is not set,
the rack id /default-rack is returned for any passed IP address."

Do I have to write a script which will convert my IP address into a
unique rack? Once we get the unique id  hdfs will write according to
the id?

An example would be very helpful. There is only 1 paragraph about this
but its far too important not to have an example or two.

On Wed, Mar 3, 2010 at 12:37 AM, Jeff Hammerbacher <hammer@cloudera.com> wrote:
> Hey,
> Have you looked at
> http://hadoop.apache.org/common/docs/r0.20.0/cluster_setup.html#Hadoop+Rack+Awareness?
> If there's something lacking in that documentation, perhaps you can submit a
> patch with a more useful explanation.
> Regards,
> Jeff
> On Tue, Mar 2, 2010 at 7:43 PM, Mag Gam <magawake@gmail.com> wrote:
>> I have a 5 slave servers and I would like to be rackaware meaning each
>> server represents 1 rack resulting in 5 racks. I have looked around
>> for examples online but could not find anything concrete. Can someone
>> please show me an example on how to set this up?
>> TIA

View raw message