Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 382081088F for ; Thu, 24 Oct 2013 22:20:04 +0000 (UTC) Received: (qmail 85590 invoked by uid 500); 24 Oct 2013 22:20:02 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 85515 invoked by uid 500); 24 Oct 2013 22:20:02 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 85502 invoked by uid 99); 24 Oct 2013 22:20:02 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Oct 2013 22:20:02 +0000 Date: Thu, 24 Oct 2013 22:20:01 +0000 (UTC) From: "Ted Yu (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HBASE-9836) Intermittent TestRegionObserverScannerOpenHook#testRegionObserverCompactionTimeStacking failure MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Ted Yu created HBASE-9836: ----------------------------- Summary: Intermittent TestRegionObserverScannerOpenHook#testRegionObserverCompactionTimeStacking failure Key: HBASE-9836 URL: https://issues.apache.org/jira/browse/HBASE-9836 Project: HBase Issue Type: Test Reporter: Ted Yu Assignee: Ted Yu Here were two recent examples: https://builds.apache.org/job/hbase-0.96-hadoop2/99/testReport/org.apache.hadoop.hbase.coprocessor/TestRegionObserverScannerOpenHook/testRegionObserverCompactionTimeStacking/ https://builds.apache.org/job/PreCommit-HBASE-Build/7616/testReport/junit/org.apache.hadoop.hbase.coprocessor/TestRegionObserverScannerOpenHook/testRegionObserverCompactionTimeStacking/ >From the second: {code} 2013-10-24 18:08:10,080 INFO [Priority.RpcServer.handler=1,port=58174] regionserver.HRegionServer(3672): Flushing testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf. ... 2013-10-24 18:08:10,544 INFO [Priority.RpcServer.handler=1,port=58174] regionserver.HRegion(1645): Finished memstore flush of ~128.0/128, currentsize=0.0/0 for region testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf. in 464ms, sequenceid=5, compaction requested=true 2013-10-24 18:08:10,546 DEBUG [Priority.RpcServer.handler=1,port=58174] regionserver.CompactSplitThread(319): Small Compaction requested: system; Because: Compaction through user triggered flush; compaction_queue=(0:0), split_queue=0, merge_queue=0 2013-10-24 18:08:10,547 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] compactions.RatioBasedCompactionPolicy(92): Selecting compaction from 2 store files, 0 compacting, 2 eligible, 10 blocking 2013-10-24 18:08:10,547 DEBUG [pool-1-thread-1] catalog.CatalogTracker(209): Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@4be179 2013-10-24 18:08:10,549 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] compactions.ExploringCompactionPolicy(112): Exploring compaction algorithm has selected 2 files of size 1999 starting at candidate #0 after considering 1 permutations with 1 in ratio 2013-10-24 18:08:10,551 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] regionserver.HStore(1329): e96920e43ea374ba1bd559df115870cf - A: Initiating major compaction 2013-10-24 18:08:10,551 INFO [RS:0;asf002:58174-smallCompactions-1382638090545] regionserver.HRegion(1294): Starting compaction on A in region testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf. 2013-10-24 18:08:10,551 INFO [RS:0;asf002:58174-smallCompactions-1382638090545] regionserver.HStore(982): Starting compaction of 2 file(s) in A of testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf. into tmpdir=hdfs://localhost:49506/user/jenkins/hbase/data/default/testRegionObserverCompactionTimeStacking/e96920e43ea374ba1bd559df115870cf/.tmp, totalSize=2.0k 2013-10-24 18:08:10,552 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] compactions.Compactor(168): Compacting hdfs://localhost:49506/user/jenkins/hbase/data/default/testRegionObserverCompactionTimeStacking/e96920e43ea374ba1bd559df115870cf/A/44f87b94732149c08f20bdba00dd7140, keycount=1, bloomtype=ROW, size=992.0, encoding=NONE, seqNum=3, earliestPutTs=1382638089528 2013-10-24 18:08:10,552 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] compactions.Compactor(168): Compacting hdfs://localhost:49506/user/jenkins/hbase/data/default/testRegionObserverCompactionTimeStacking/e96920e43ea374ba1bd559df115870cf/A/0b2e580cbda246718bbf64c21e81cd18, keycount=1, bloomtype=ROW, size=1007.0, encoding=NONE, seqNum=5, earliestPutTs=1382638090053 2013-10-24 18:08:10,564 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] util.FSUtils(305): DFS Client does not support most favored nodes create; using default create ... Potentially hanging thread: RS:0;asf002:58174-smallCompactions-1382638090545 java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:485) org.apache.hadoop.ipc.Client.call(Client.java:1099) org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:229) $Proxy9.complete(Unknown Source) sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:85) org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:62) $Proxy9.complete(Unknown Source) sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:597) org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:266) $Proxy15.complete(Unknown Source) org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.closeInternal(DFSClient.java:4121) org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.close(DFSClient.java:4022) org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:61) org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:86) org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.finishClose(AbstractHFileWriter.java:251) org.apache.hadoop.hbase.io.hfile.HFileWriterV2.close(HFileWriterV2.java:408) org.apache.hadoop.hbase.regionserver.StoreFile$Writer.close(StoreFile.java:984) org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:91) org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:103) org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:991) org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1300) org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:475) {code} Looks like the compaction was still running when assertion failed. -- This message was sent by Atlassian JIRA (v6.1#6144)