Return-Path: Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: (qmail 38741 invoked from network); 27 Oct 2010 13:46:45 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 27 Oct 2010 13:46:45 -0000 Received: (qmail 95671 invoked by uid 500); 27 Oct 2010 13:46:45 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 95100 invoked by uid 500); 27 Oct 2010 13:46:43 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 95091 invoked by uid 99); 27 Oct 2010 13:46:42 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Oct 2010 13:46:42 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Oct 2010 13:46:42 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o9RDkL2Q011744 for ; Wed, 27 Oct 2010 13:46:21 GMT Message-ID: <7231429.99401288187181436.JavaMail.jira@thor> Date: Wed, 27 Oct 2010 09:46:21 -0400 (EDT) From: "stack (JIRA)" To: issues@hbase.apache.org Subject: [jira] Updated: (HBASE-3155) HFile.appendMetaBlock() uses wrong comparator In-Reply-To: <19335504.85121288118841749.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-3155: ------------------------- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Thanks Nicolas. Committed. > HFile.appendMetaBlock() uses wrong comparator > --------------------------------------------- > > Key: HBASE-3155 > URL: https://issues.apache.org/jira/browse/HBASE-3155 > Project: HBase > Issue Type: Bug > Reporter: Nicolas Spiegelberg > Assignee: Nicolas Spiegelberg > Priority: Critical > Fix For: 0.90.0 > > Attachments: HBASE-3155.patch > > > We hit this exception last night... > 2010-10-26 01:20:20,056 INFO org.apache.hadoop.hbase.regionserver.StoreFile: Bloom added to HFile (...): 18752B, 13012/13601 (96%) > 2010-10-26 01:20:20,056 INFO org.apache.hadoop.hbase.regionserver.HRegion: aborted compaction on region 04,04c84c80,1286302852528.77d461b19c7f410041f1d03f4823ef8b. after 20mins, 43sec > 2010-10-26 01:20:20,056 ERROR org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction failed for region 04,04c84c80,1286302852528.77d461b19c7f410041f1d03f4823ef8b. > java.lang.ArrayIndexOutOfBoundsException: 17 > at org.apache.hadoop.hbase.util.Bytes.compareTo(Bytes.java:860) > at org.apache.hadoop.hbase.KeyValue$KeyComparator.compareRows(KeyValue.java:1888) > at org.apache.hadoop.hbase.KeyValue$KeyComparator.compare(KeyValue.java:1822) > at org.apache.hadoop.hbase.io.hfile.HFile$Writer.appendMetaBlock(HFile.java:476) > at org.apache.hadoop.hbase.regionserver.StoreFile$Writer.close(StoreFile.java:862) > at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:896) > at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:687) > at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:858) > at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:807) > The problem is that appendMetaBlock() is using the wrong comparator. although the variable is called 'rawComparator', it's actually a normal comparator (KeyComparator) that defaults to RawComparator if not specified. All meta sorting needs to be done using the actual Bytes.RAW_COMPARATOR. This happened because >=2 things were inserted into meta. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.