Return-Path: X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 575B9706E for ; Thu, 29 Dec 2011 05:50:58 +0000 (UTC) Received: (qmail 69957 invoked by uid 500); 29 Dec 2011 05:50:57 -0000 Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org Received: (qmail 69361 invoked by uid 500); 29 Dec 2011 05:50:56 -0000 Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-dev@hadoop.apache.org Received: (qmail 69347 invoked by uid 99); 29 Dec 2011 05:50:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Dec 2011 05:50:54 +0000 X-ASF-Spam-Status: No, hits=-2001.3 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Dec 2011 05:50:52 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id F120212E5E8 for ; Thu, 29 Dec 2011 05:50:30 +0000 (UTC) Date: Thu, 29 Dec 2011 05:50:30 +0000 (UTC) From: "Harsh J (Resolved) (JIRA)" To: common-dev@hadoop.apache.org Message-ID: <1838008563.50555.1325137830989.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Resolved] (HADOOP-3211) Utility to enforce current replication policy on already exitsting blocks MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-3211. ----------------------------- Resolution: Not A Problem The balancer does this today. The BlockManager and its services do not, however. > Utility to enforce current replication policy on already exitsting blocks > ------------------------------------------------------------------------- > > Key: HADOOP-3211 > URL: https://issues.apache.org/jira/browse/HADOOP-3211 > Project: Hadoop Common > Issue Type: New Feature > Reporter: Robert Chansler > > If the replica placement policy changes, or if the cluster topology changes, existing block replicas will not be deliberately moved to implement the new policy or to reflect the new topology. The re-replicator and the re-balancer always implement the current policy, but a healthy block may never attract the attention of either of those facilities. > In practice, all replicas of a block have been found within a single rack (as allowed by the previous _random rack_ placement policy. The {{fsck}} facility reports such examples. > The re-placer utility could follow the model of the re-balancer. Or even be part of the re-balancer. > An alternative implementation would scan the {{fsck}} report for curious blocks, and rename a replica block file on the data node, so as to hide it. The re-replicator would be expected to create a new replica properly placed. (This is a fix up that any administrator could implement.) > (1761414) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira