Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of traviscrawford@gmail.com
 designates 209.85.213.176 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=references:from:in-reply-to:mime-version:date:message-id:subject:to
         :content-type;
        b=Y5JtGdESxDrq5AGS93ZVEMkVDNxVFhKFwYZM+kmPbBJZYYagBBQTpz6BYgwXob1qlT
         fgQkKdPw6XhpV40pwzLl+dE6Tsh+ebhVIv9zLEaPJdp7a4yL4WyWtGWwozLtd3VUGnMo
         RK+X4mIQfTEa7JqDB+4ikVgQdZm0K/K4pN49U=
References: <20101216153209.1266e5d3@toffel.linkoping.osa>
From: Travis Crawford <traviscrawford@gmail.com>
In-Reply-To: <20101216153209.1266e5d3@toffel.linkoping.osa>
Mime-Version: 1.0 (iPad Mail 8C148)
Date: Thu, 16 Dec 2010 06:44:26 -0800
Message-ID: <-8889666374499604158@unknownmsgid>
Subject: Re: Unbalanced disks - need to take down whole HDFS?
To: "hdfs-user@hadoop.apache.org" <hdfs-user@hadoop.apache.org>
Content-Type: text/plain; charset=ISO-8859-1

On Dec 16, 2010, at 6:34 AM, Erik Forsberg <forsberg@opera.com> wrote:

> Hi!
>
> I have unbalanced disks on one of my nodes after a disk failure with
> disk replacements.
>
> http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F
> has a solution, but it starts with "Take down HDFS".
>
> Is that really necessary - shouldn't taking down just that datanode,
> moving around the blocks, then start the datanode be good enough, or
> will that mess up some datastructure in the namenode?
>

You're right - that should say take the DataNode down, move blocks
around, then restart the DataNode. You might be able to just replace
the disk and have them unbalanced for a while though. As data is
created and deleted things will naturally even out.

--Travis


> Thanks,
> \EF
> --
> Erik Forsberg <forsberg@opera.com>
> Developer, Opera Software - http://www.opera.com/