hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9836) Intermittent TestRegionObserverScannerOpenHook#testRegionObserverCompactionTimeStacking failure
Date Tue, 29 Oct 2013 20:11:26 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808387#comment-13808387
] 

Hudson commented on HBASE-9836:
-------------------------------

SUCCESS: Integrated in hbase-0.96 #166 (See [https://builds.apache.org/job/hbase-0.96/166/])
HBASE-9836 Fix flakey TestRegionObserverScannerOpenHook test (tedyu: rev 1536812)
* /hbase/branches/0.96/hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java


> Intermittent TestRegionObserverScannerOpenHook#testRegionObserverCompactionTimeStacking
failure
> -----------------------------------------------------------------------------------------------
>
>                 Key: HBASE-9836
>                 URL: https://issues.apache.org/jira/browse/HBASE-9836
>             Project: HBase
>          Issue Type: Test
>            Reporter: Ted Yu
>            Assignee: Ted Yu
>             Fix For: 0.98.0, 0.96.1
>
>         Attachments: 9836-v1.txt, 9836-v3.txt, 9836-v4.txt, 9836-v5.txt, 9836-v6.txt
>
>
> Here were two recent examples:
> https://builds.apache.org/job/hbase-0.96-hadoop2/99/testReport/org.apache.hadoop.hbase.coprocessor/TestRegionObserverScannerOpenHook/testRegionObserverCompactionTimeStacking/
> https://builds.apache.org/job/PreCommit-HBASE-Build/7616/testReport/junit/org.apache.hadoop.hbase.coprocessor/TestRegionObserverScannerOpenHook/testRegionObserverCompactionTimeStacking/
> From the second:
> {code}
> 2013-10-24 18:08:10,080 INFO  [Priority.RpcServer.handler=1,port=58174] regionserver.HRegionServer(3672):
Flushing testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf.
> ...
> 2013-10-24 18:08:10,544 INFO  [Priority.RpcServer.handler=1,port=58174] regionserver.HRegion(1645):
Finished memstore flush of ~128.0/128, currentsize=0.0/0 for region testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf.
in 464ms, sequenceid=5, compaction requested=true
> 2013-10-24 18:08:10,546 DEBUG [Priority.RpcServer.handler=1,port=58174] regionserver.CompactSplitThread(319):
Small Compaction requested: system; Because: Compaction through user triggered flush; compaction_queue=(0:0),
split_queue=0, merge_queue=0
> 2013-10-24 18:08:10,547 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] compactions.RatioBasedCompactionPolicy(92):
Selecting compaction from 2 store files, 0 compacting, 2 eligible, 10 blocking
> 2013-10-24 18:08:10,547 DEBUG [pool-1-thread-1] catalog.CatalogTracker(209): Stopping
catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@4be179
> 2013-10-24 18:08:10,549 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] compactions.ExploringCompactionPolicy(112):
Exploring compaction algorithm has selected 2 files of size 1999 starting at candidate #0
after considering 1 permutations with 1 in ratio
> 2013-10-24 18:08:10,551 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] regionserver.HStore(1329):
e96920e43ea374ba1bd559df115870cf - A: Initiating major compaction
> 2013-10-24 18:08:10,551 INFO  [RS:0;asf002:58174-smallCompactions-1382638090545] regionserver.HRegion(1294):
Starting compaction on A in region testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf.
> 2013-10-24 18:08:10,551 INFO  [RS:0;asf002:58174-smallCompactions-1382638090545] regionserver.HStore(982):
Starting compaction of 2 file(s) in A of testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf.
into tmpdir=hdfs://localhost:49506/user/jenkins/hbase/data/default/testRegionObserverCompactionTimeStacking/e96920e43ea374ba1bd559df115870cf/.tmp,
totalSize=2.0k
> 2013-10-24 18:08:10,552 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] compactions.Compactor(168):
Compacting hdfs://localhost:49506/user/jenkins/hbase/data/default/testRegionObserverCompactionTimeStacking/e96920e43ea374ba1bd559df115870cf/A/44f87b94732149c08f20bdba00dd7140,
keycount=1, bloomtype=ROW, size=992.0, encoding=NONE, seqNum=3, earliestPutTs=1382638089528
> 2013-10-24 18:08:10,552 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] compactions.Compactor(168):
Compacting hdfs://localhost:49506/user/jenkins/hbase/data/default/testRegionObserverCompactionTimeStacking/e96920e43ea374ba1bd559df115870cf/A/0b2e580cbda246718bbf64c21e81cd18,
keycount=1, bloomtype=ROW, size=1007.0, encoding=NONE, seqNum=5, earliestPutTs=1382638090053
> 2013-10-24 18:08:10,564 DEBUG [RS:0;asf002:58174-smallCompactions-1382638090545] util.FSUtils(305):
DFS Client does not support most favored nodes create; using default create
> ...
> Potentially hanging thread: RS:0;asf002:58174-smallCompactions-1382638090545
>   java.lang.Object.wait(Native Method)
>   java.lang.Object.wait(Object.java:485)
>   org.apache.hadoop.ipc.Client.call(Client.java:1099)
>   org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:229)
>   $Proxy9.complete(Unknown Source)
>   sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
>   sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   java.lang.reflect.Method.invoke(Method.java:597)
>   org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:85)
>   org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:62)
>   $Proxy9.complete(Unknown Source)
>   sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
>   sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>   java.lang.reflect.Method.invoke(Method.java:597)
>   org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:266)
>   $Proxy15.complete(Unknown Source)
>   org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.closeInternal(DFSClient.java:4121)
>   org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.close(DFSClient.java:4022)
>   org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:61)
>   org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:86)
>   org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.finishClose(AbstractHFileWriter.java:251)
>   org.apache.hadoop.hbase.io.hfile.HFileWriterV2.close(HFileWriterV2.java:408)
>   org.apache.hadoop.hbase.regionserver.StoreFile$Writer.close(StoreFile.java:984)
>   org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:91)
>   org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:103)
>   org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:991)
>   org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1300)
>   org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:475)
> {code}
> Looks like the compaction was still running when assertion failed.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message