hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Travis Crawford <traviscrawf...@gmail.com>
Subject Re: Unbalanced disks - need to take down whole HDFS?
Date Thu, 16 Dec 2010 14:44:26 GMT
On Dec 16, 2010, at 6:34 AM, Erik Forsberg <forsberg@opera.com> wrote:

> Hi!
> I have unbalanced disks on one of my nodes after a disk failure with
> disk replacements.
> http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F
> has a solution, but it starts with "Take down HDFS".
> Is that really necessary - shouldn't taking down just that datanode,
> moving around the blocks, then start the datanode be good enough, or
> will that mess up some datastructure in the namenode?

You're right - that should say take the DataNode down, move blocks
around, then restart the DataNode. You might be able to just replace
the disk and have them unbalanced for a while though. As data is
created and deleted things will naturally even out.


> Thanks,
> \EF
> --
> Erik Forsberg <forsberg@opera.com>
> Developer, Opera Software - http://www.opera.com/

View raw message