hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Can I move block data directly?
Date Mon, 08 Jul 2013 05:39:20 GMT
Yes, you could do this, but I'd place steps 3 and 5 as steps 1 and 2.
I'd also ensure the ownership of the block files are intact.

If balancer isn't cutting it out for you with stock defaults, you
should consider tuning that than doing these unsupported scenarios.

On Mon, Jul 8, 2013 at 9:10 AM, Azuryy Yu <azuryyyu@gmail.com> wrote:
> Hi Dear all,
>
> There are some unbalanced data nodes in my cluster, some nodes reached more
> than 95% disk usage.
>
> so Can I move some block data from one node to another node directly?
>
> such as: from n1 to n2:
>
> 1) scp /data/xxxx/blk_*   n2:/data/subdir11/
> 2) rm -rf data/xxxx/blk_*
> 3) hadoop-dameon.sh stop datanode (on n1)
> 4) hadoop-damon.sh start datanode(on n1)
> 5) hadoop-dameon.sh stop datanode (on n2)
> 6) hadoop-damon.sh start datanode(on n2)
>
> Am I right? Thanks for any input.
>
>



-- 
Harsh J

Mime
View raw message