Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@locus.apache.org Received: (qmail 19036 invoked from network); 23 Jan 2009 04:39:01 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 23 Jan 2009 04:39:01 -0000 Received: (qmail 95311 invoked by uid 500); 23 Jan 2009 01:52:20 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 95293 invoked by uid 500); 23 Jan 2009 01:52:20 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 95281 invoked by uid 99); 23 Jan 2009 01:52:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Jan 2009 17:52:20 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Jan 2009 01:52:20 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 991F4234C4A8 for ; Thu, 22 Jan 2009 17:51:59 -0800 (PST) Message-ID: <207880265.1232675519625.JavaMail.jira@brutus> Date: Thu, 22 Jan 2009 17:51:59 -0800 (PST) From: "Jim Kellerman (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Created: (HBASE-1148) Always flush HLog on root or meta region updates MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Always flush HLog on root or meta region updates ------------------------------------------------ Key: HBASE-1148 URL: https://issues.apache.org/jira/browse/HBASE-1148 Project: Hadoop HBase Issue Type: Bug Components: regionserver Affects Versions: 0.19.0, 0.19.1, 0.20.0 Reporter: Jim Kellerman Assignee: Jim Kellerman Priority: Critical Flushing an HLog does not currently guarantee that the updates will be visible (see HADOOP-4379), however in the case of root or meta region updates, this is critical. I was able to create a situation by killing both the root and meta region servers, from which the cluster recovered, but because of the missed edits, clients found the old parent region rather than the new child regions because the fact that the parent region had split was not in the HLog of the crashed region servers (the master knew because of the MSG_REGION_SPLIT message it received) but the clients read the meta table and because that change was lost, clients were trying to find the parent region. So, when a SequenceFile.Writer.sync() guarantees that what has been written will be visible to new readers, we need to modify HLog so that if it is writing an update to the root or meta regions, that it immediately flushes (syncs) the log file so that the changes will be visible when the log file is recovered. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.