Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-issues@hadoop.apache.org
Message-ID: <436508153.1250550374878.JavaMail.jira@brutus>
Date: Mon, 17 Aug 2009 16:06:14 -0700 (PDT)
From: "Tsz Wo (Nicholas), SZE (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Subject: [jira] Updated: (HDFS-457) better handling of volume failure in
 Data Node storage
In-Reply-To: <1817020889.1246388327191.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HDFS-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HDFS-457:
----------------------------------------

    Fix Version/s: 0.21.0
       Issue Type: Improvement  (was: Bug)
     Hadoop Flags: [Reviewed]

+1 patch looks good.

The diff between HDFS-457-3.patch and HDFS-457-2.patch is minor.  So I think we don't have to submit it to Hudson again for saving some cycles.

> better handling of volume failure in Data Node storage
> ------------------------------------------------------
>
>                 Key: HDFS-457
>                 URL: https://issues.apache.org/jira/browse/HDFS-457
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: data-node
>            Reporter: Boris Shkolnik
>            Assignee: Boris Shkolnik
>             Fix For: 0.21.0
>
>         Attachments: HDFS-457-1.patch, HDFS-457-2.patch, HDFS-457-2.patch, HDFS-457-2.patch, HDFS-457-3.patch, HDFS-457.patch, TestFsck.zip
>
>
> Current implementation shuts DataNode down completely when one of the configured volumes of the storage fails.
> This is rather wasteful behavior because it  decreases utilization (good storage becomes unavailable) and imposes extra load on the system (replication of the blocks from the good volumes). These problems will become even more prominent when we move to mixed (heterogeneous) clusters with many more volumes per Data Node.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.