Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 28128 invoked from network); 29 Apr 2009 01:47:52 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 29 Apr 2009 01:47:52 -0000 Received: (qmail 91858 invoked by uid 500); 29 Apr 2009 01:47:51 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 91786 invoked by uid 500); 29 Apr 2009 01:47:51 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 91776 invoked by uid 99); 29 Apr 2009 01:47:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Apr 2009 01:47:51 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Apr 2009 01:47:50 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 5F5B4234C004 for ; Tue, 28 Apr 2009 18:47:30 -0700 (PDT) Message-ID: <1323703326.1240969650389.JavaMail.jira@brutus> Date: Tue, 28 Apr 2009 18:47:30 -0700 (PDT) From: "Konstantin Shvachko (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Updated: (HADOOP-5734) HDFS architecture documentation describes outdated placement policy In-Reply-To: <1404387338.1240534410415.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-5734: ---------------------------------------- Component/s: dfs > HDFS architecture documentation describes outdated placement policy > ------------------------------------------------------------------- > > Key: HADOOP-5734 > URL: https://issues.apache.org/jira/browse/HADOOP-5734 > Project: Hadoop Core > Issue Type: Bug > Components: dfs, documentation > Affects Versions: 0.20.0 > Reporter: Konstantin Boudnik > Assignee: Konstantin Boudnik > Priority: Minor > Fix For: 0.21.0 > > Attachments: HADOOP-5734.patch > > Time Spent: 2h > Remaining Estimate: 0h > > The "Replica Placement: The First Baby Steps" section of HDFS architecture document states: > "... > For the common case, when the replication factor is three, HDFS's placement policy is to put one replica on one node in the local rack, another on a different node in the local rack, and the last on a different node in a different rack. This policy cuts the inter-rack write traffic which generally improves write performance. > ..." > However, according to the ReplicationTargetChooser.chooseTarger()'s code the actual logic is to put the second replica on a different rack as well as the third replica. So you have two replicas located on a different nodes of remote rack and one (initial replica) on the local rack's node. Thus, the sentence should say something like this: > "For the common case, when the replication factor is three, HDFS's placement policy is to put one replica on one node in the local rack, another on a node in a different (remote) rack, and the last on a different node in the same remote rack. This policy cuts the inter-rack write traffic which generally improves write performance." -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.