hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Edward Capriolo <edlinuxg...@gmail.com>
Subject Re: problem with rack-awareness
Date Fri, 02 Jul 2010 18:35:30 GMT
On Fri, Jul 2, 2010 at 2:27 PM, Allen Wittenauer
<awittenauer@linkedin.com> wrote:
>
> On Jul 1, 2010, at 7:50 PM, elton sky wrote:
>
>> hello,
>>
>> I am trying to separate my 6 nodes onto 2 different racks.
>> For test purpose, I wrote a bash file which smply returns "rack0" all the
>> time. And I add property "topology.script.file.name" in core-site.xml.
>
> rack0 or /rack0?
>
> I think the leading / is required.
>
>
>>
>> When I restart by start-dfs.sh, the namenode could not find any datanode at
>> all. All datanodes are lost somehow. If I remove "topology.script.file.name"
>> from conf, things back to normal, i.e. all datanodes are under
>> "default-rack".
>>
>> I don't why datanode couldn't register to namenode when using rack. Any
>> ideas?
>
> It sounds like your topology script isn't returning the data in the correct format.

If you want a clear cut example refer to the hadoop wiki:

http://wiki.apache.org/hadoop/topology_rack_awareness_scripts

Mime
View raw message