Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 672F3D832 for ; Mon, 17 Sep 2012 15:41:09 +0000 (UTC) Received: (qmail 33046 invoked by uid 500); 17 Sep 2012 15:41:08 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 32983 invoked by uid 500); 17 Sep 2012 15:41:08 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 32894 invoked by uid 99); 17 Sep 2012 15:41:08 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Sep 2012 15:41:08 +0000 Date: Tue, 18 Sep 2012 02:41:08 +1100 (NCT) From: "Junping Du (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <1752729194.88081.1347896468590.JavaMail.jiratomcat@arcas> In-Reply-To: <740418511.85756.1347822428737.JavaMail.jiratomcat@arcas> Subject: [jira] [Updated] (HDFS-3941) Backport HDFS-3498 and HDFS3601: update replica placement policy for new added "NodeGroup" layer topology MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-3941: ----------------------------- Description: With enabling additional layer of "NodeGroup", the replica placement policy used in BlockPlacementPolicyWithNodeGroup is updated to following rules: 0. No more than one replica is placed within a NodeGroup (*) 1. First replica on the local node. 2. Second and third replicas are within the same rack but remote rack with 1st replica. 3. Other replicas on random nodes with restriction that no more than two replicas are placed in the same rack, if there is enough racks. Also, this patch abstract Replica Removal Policy > Backport HDFS-3498 and HDFS3601: update replica placement policy for new added "NodeGroup" layer topology > --------------------------------------------------------------------------------------------------------- > > Key: HDFS-3941 > URL: https://issues.apache.org/jira/browse/HDFS-3941 > Project: Hadoop HDFS > Issue Type: New Feature > Components: name-node > Affects Versions: 1.0.0 > Reporter: Junping Du > Assignee: Junping Du > Attachments: HDFS-3941.patch > > > With enabling additional layer of "NodeGroup", the replica placement policy used in BlockPlacementPolicyWithNodeGroup is updated to following rules: > 0. No more than one replica is placed within a NodeGroup (*) > 1. First replica on the local node. > 2. Second and third replicas are within the same rack but remote rack with 1st replica. > 3. Other replicas on random nodes with restriction that no more than two replicas are placed in the same rack, if there is enough racks. > Also, this patch abstract Replica Removal Policy -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira