hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: rebalancing data on disks?
Date Mon, 31 Oct 2011 16:27:59 GMT
Which is why you need your HDFS shutdown before this is done.

See http://search-hadoop.com/m/fSof91EYbe9 and http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F

On 31-Oct-2011, at 8:39 PM, Tomasz Chmielewski wrote:

> On 31.10.2011 15:37, Jeff Bean wrote:
>> IIUC you can move the data block files from one disk to another until they are evenly
distributed. Give it a shot.
> 
> Just like that? Using "mv" command?
> 
> I.e. move /data2/hdfs/data/current/subdir44/* to /data3/hdfs/data/current/subdir44/
> 
> ?
> 
> 
> It's not atomic, so at some point, /data3/ would contain a file which is not a full copy
of the same file on /data2/; later, both /data2 and /data3 would contain identical file.
> 
> 
> -- 
> Tomasz Chmielewski
> http://wpkg.org
> 


Mime
View raw message