Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 213821037B for ; Tue, 15 Oct 2013 21:25:59 +0000 (UTC) Received: (qmail 41401 invoked by uid 500); 15 Oct 2013 21:25:55 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 41323 invoked by uid 500); 15 Oct 2013 21:25:55 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 41157 invoked by uid 99); 15 Oct 2013 21:25:52 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Oct 2013 21:25:52 +0000 Date: Tue, 15 Oct 2013 21:25:52 +0000 (UTC) From: "Ravi Prakash (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-5346) Replication queues should not be initialized in the middle of IBR processing. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-5346: ------------------------------- Attachment: HDFS-5346.patch The patch with the same changes for trunk > Replication queues should not be initialized in the middle of IBR processing. > ----------------------------------------------------------------------------- > > Key: HDFS-5346 > URL: https://issues.apache.org/jira/browse/HDFS-5346 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode, performance > Affects Versions: 0.23.9, 2.3.0 > Reporter: Kihwal Lee > Assignee: Ravi Prakash > Fix For: 2.3.0, 0.23.10 > > Attachments: HDFS-5346.branch-23.patch, HDFS-5346.patch, HDFS-5346.patch > > > When initial block reports are being processed, checkMode() is called from incrementSafeBlockCount(). This causes the replication queues to be initialized in the middle of processing a block report in the IBR processing mode. If there are many block reports waiting to be processed, SafeModeMonitor won't be able to make name node leave the safe mode soon. It appears that the block report processing speed degrades considerably during this time. -- This message was sent by Atlassian JIRA (v6.1#6144)