From hdfs-issues-return-31486-apmail-hadoop-hdfs-issues-archive=hadoop.apache.org@hadoop.apache.org Sun Jan 1 12:15:53 2012 Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8E1CA921B for ; Sun, 1 Jan 2012 12:15:53 +0000 (UTC) Received: (qmail 35028 invoked by uid 500); 1 Jan 2012 12:15:53 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 34988 invoked by uid 500); 1 Jan 2012 12:15:53 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 34979 invoked by uid 99); 1 Jan 2012 12:15:53 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 01 Jan 2012 12:15:53 +0000 X-ASF-Spam-Status: No, hits=-2001.6 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 01 Jan 2012 12:15:52 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id B869B1333D3 for ; Sun, 1 Jan 2012 12:15:31 +0000 (UTC) Date: Sun, 1 Jan 2012 12:15:31 +0000 (UTC) From: "Philip Zeyliger (Commented) (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <956508813.56601.1325420131756.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HDFS-1362) Provide volume management functionality for DataNode MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13178150#comment-13178150 ] Philip Zeyliger commented on HDFS-1362: --------------------------------------- I will return to the office on January 17th. For urgent matters, please contact Aparna or Philip L. The week between Christmas and New Years', your best bet is Chris L. Thanks, -- Philip > Provide volume management functionality for DataNode > ---------------------------------------------------- > > Key: HDFS-1362 > URL: https://issues.apache.org/jira/browse/HDFS-1362 > Project: Hadoop HDFS > Issue Type: New Feature > Components: data-node > Affects Versions: 0.23.0 > Reporter: Wang Xu > Assignee: Wang Xu > Fix For: 0.24.0 > > Attachments: DataNode Volume Refreshment in HDFS-1362.pdf, HDFS-1362.4_w7001.txt, HDFS-1362.5.patch, HDFS-1362.6.patch, HDFS-1362.7.patch, HDFS-1362.8.patch, HDFS-1362.txt, Provide_volume_management_for_DN_v1.pdf > > > The current management unit in Hadoop is a node, i.e. if a node failed, it will be kicked out and all the data on the node will be replicated. > As almost all SATA controller support hotplug, we add a new command line interface to datanode, thus it can list, add or remove a volume online, which means we can change a disk without node decommission. Moreover, if the failed disk still readable and the node has enouth space, it can migrate data on the disks to other disks in the same node. > A more detailed design document will be attached. > The original version in our lab is implemented against 0.20 datanode directly, and is it better to implemented it in contrib? Or any other suggestion? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira