Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 177527471 for ; Wed, 23 Nov 2011 03:25:05 +0000 (UTC) Received: (qmail 81344 invoked by uid 500); 23 Nov 2011 03:25:05 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 81314 invoked by uid 500); 23 Nov 2011 03:25:04 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 81305 invoked by uid 99); 23 Nov 2011 03:25:02 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Nov 2011 03:25:02 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Nov 2011 03:25:01 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 06C49982A5 for ; Wed, 23 Nov 2011 03:24:41 +0000 (UTC) Date: Wed, 23 Nov 2011 03:24:41 +0000 (UTC) From: "Hadoop QA (Commented) (JIRA)" To: issues@hbase.apache.org Message-ID: <1683547895.4976.1322018681029.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <658647882.4544.1322006079800.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-4853) HBASE-4789 does overzealous pruning of seqids MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-4853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155660#comment-13155660 ] Hadoop QA commented on HBASE-4853: ---------------------------------- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12504841/4853--no-prefix.txt against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/342//console This message is automatically generated. > HBASE-4789 does overzealous pruning of seqids > --------------------------------------------- > > Key: HBASE-4853 > URL: https://issues.apache.org/jira/browse/HBASE-4853 > Project: HBase > Issue Type: Bug > Reporter: stack > Priority: Critical > Attachments: 4853--no-prefix.txt, 4853.txt > > > Working w/ J-D on failing replication test turned up hole in seqids made by the patch over in hbase-4789. With this patch in place we see lots of instances of the suspicious: 'Last sequenceid written is empty. Deleting all old hlogs' > At a minimum, these lines need removing: > {code} > diff --git a/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLog.java b/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLog.java > index 623edbe..a0bbe01 100644 > --- a/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLog.java > +++ b/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLog.java > @@ -1359,11 +1359,6 @@ public class HLog implements Syncable { > // Cleaning up of lastSeqWritten is in the finally clause because we > // don't want to confuse getOldestOutstandingSeqNum() > this.lastSeqWritten.remove(getSnapshotName(encodedRegionName)); > - Long l = this.lastSeqWritten.remove(encodedRegionName); > - if (l != null) { > - LOG.warn("Why is there a raw encodedRegionName in lastSeqWritten? name=" + > - Bytes.toString(encodedRegionName) + ", seqid=" + l); > - } > this.cacheFlushLock.unlock(); > } > } > {code} > ... but above is no good w/o figuring why WALs are not being rotated off. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira