Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A65E49635 for ; Fri, 27 Apr 2012 22:35:13 +0000 (UTC) Received: (qmail 55838 invoked by uid 500); 27 Apr 2012 22:35:13 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 55760 invoked by uid 500); 27 Apr 2012 22:35:13 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 55752 invoked by uid 99); 27 Apr 2012 22:35:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Apr 2012 22:35:13 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Apr 2012 22:35:12 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id E7B4C4249AC for ; Fri, 27 Apr 2012 22:34:51 +0000 (UTC) Date: Fri, 27 Apr 2012 22:34:51 +0000 (UTC) From: "Elliott Clark (JIRA)" To: issues@hbase.apache.org Message-ID: <1900169257.4858.1335566091963.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <329069204.6279.1335464901190.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Assigned] (HBASE-5885) Invalid HFile block magic on Local file System MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark reassigned HBASE-5885: ------------------------------------ Assignee: Elliott Clark > Invalid HFile block magic on Local file System > ---------------------------------------------- > > Key: HBASE-5885 > URL: https://issues.apache.org/jira/browse/HBASE-5885 > Project: HBase > Issue Type: Bug > Affects Versions: 0.94.0, 0.96.0 > Reporter: Elliott Clark > Assignee: Elliott Clark > Priority: Blocker > Fix For: 0.94.0 > > Attachments: HBASE-5885-94-0.patch > > > ERROR: java.lang.RuntimeException: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=7, exceptions: > Thu Apr 26 11:19:18 PDT 2012, org.apache.hadoop.hbase.client.ScannerCallable@190a621a, java.io.IOException: java.io.IOException: Could not iterate StoreFileScanner[HFileScanner for reader reader=file:/tmp/hbase-eclark/hbase/TestTable/e2d1c846363c75262cbfd85ea278b342/info/bae2681d63734066957b58fe791a0268, compression=none, cacheConf=CacheConfig:enabled [cacheDataOnRead=true] [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false], firstKey=0000000001/info:data/1335463981520/Put, lastKey=0002588100/info:data/1335463902296/Put, avgKeyLen=30, avgValueLen=1000, entries=1215085, length=1264354417, cur=0000000248/info:data/1335463994457/Put/vlen=1000/ts=0] > at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:135) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:95) > at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:368) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:127) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3323) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3279) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3296) > at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2393) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364) > at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1376) > Caused by: java.io.IOException: Invalid HFile block magic: \xEC\xD5\x9D\xB4\xC2bfo > at org.apache.hadoop.hbase.io.hfile.BlockType.parse(BlockType.java:153) > at org.apache.hadoop.hbase.io.hfile.BlockType.read(BlockType.java:164) > at org.apache.hadoop.hbase.io.hfile.HFileBlock.(HFileBlock.java:254) > at org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderV2.readBlockDataInternal(HFileBlock.java:1779) > at org.apache.hadoop.hbase.io.hfile.HFileBlock$FSReaderV2.readBlockData(HFileBlock.java:1637) > at org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:327) > at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:555) > at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:651) > at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:130) > ... 12 more > Thu Apr 26 11:19:19 PDT 2012, org.apache.hadoop.hbase.client.ScannerCallable@190a621a, java.io.IOException: java.io.IOException: java.lang.IllegalArgumentException > at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1132) > at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1121) > at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2420) > at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364) > at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1376) > Caused by: java.lang.IllegalArgumentException > at java.nio.Buffer.position(Buffer.java:216) > at org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:630) > at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:130) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:95) > at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:406) > at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:127) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3323) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3279) > at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:3296) > at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2393) > ... 5 more > On latest 0.94 branch I spun up a new standalone hbase. Then I started a performance evaluation run hbase/bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation --nomapred randomWrite 10 > after that completed I tried a scan of TestTable. The scan got the above error. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira