hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Topology script frequency
Date Wed, 20 Feb 2013 20:23:37 GMT
NN refers to the rack topology script/class when a new node joins
(i.e. it doesn't have the node's IP already in cache), when it starts
up, and (I think) also when you issue -refreshNodes.

The ideal way to "add" a node to the rack right now is to first update
the rack config at the NN, then boot the DN up.

On Thu, Feb 21, 2013 at 1:47 AM, Chris Embree <cembree@gmail.com> wrote:
> I've checked all of the documentation, books and google searches I can think
> of....
> I have a working topology script.  I have dynamic IP's.  I have an automated
> process to update the rack data when a datanode changes IP.
> What I don't have is any clue as to when the NN reads this script.  If I
> execute it right now with it'll return /dc1/rack3  When I run
> hadoop balancer I see /default/rack/
> I really don't want to have to restart the NN for IP changes to be noticed.
> Any brilliant insights?
> Thanks
> Chris

Harsh J

View raw message