hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liu Shaohui (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9526) LocalHBaseCluster.shutdown hangs for regionserver thread wait zk deleteMyEphemeralNode packet.
Date Mon, 16 Sep 2013 06:06:52 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13768093#comment-13768093
] 

Liu Shaohui commented on HBASE-9526:
------------------------------------

[~lhofhansl] Sorry, I have no idea about how it happens. 
It's hard to reproduce it in our ci env and i am trying to find some ideas from the code.

                
> LocalHBaseCluster.shutdown hangs for regionserver thread wait zk deleteMyEphemeralNode
packet. 
> -----------------------------------------------------------------------------------------------
>
>                 Key: HBASE-9526
>                 URL: https://issues.apache.org/jira/browse/HBASE-9526
>             Project: HBase
>          Issue Type: Test
>    Affects Versions: 0.94.3
>            Reporter: Liu Shaohui
>            Priority: Minor
>         Attachments: stack.log
>
>
> When LocalHBaseCluster is shutdowned, it will join all regionserver threads.
> Regionserver thread will try to delete EphemeralNode and wait zk packet, but the sendThread
has been not existed, so no one notify the regionserver thread. 
> {noformat}
> "RegionServer:0;10.237.14.236,43311,1378958529812" prio=10 tid=0x00007f0a9d020000 nid=0x18db
in Object.wait() [0x00007f0a8aa35000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:485)
>         at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1309)
>         - locked <0x000000008ece3de8> (a org.apache.zookeeper.ClientCnxn$Packet)
>         at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:866)
>         at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.delete(RecoverableZooKeeper.java:127)
>         at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1038)
>         at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1027)
>         at org.apache.hadoop.hbase.regionserver.HRegionServer.deleteMyEphemeralNode(HRegionServer.java:1073)
>         at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:851)
>         at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:147)
>         at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:100)
>         at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:131)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:337)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1340)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.hbase.util.Methods.call(Methods.java:37)
>         at org.apache.hadoop.hbase.security.User.call(User.java:603)
>         at org.apache.hadoop.hbase.security.User.access$700(User.java:50)
>         at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:443)
>         at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:129)
> {noformat}
> This situation emerges randomly. If i rerun the test, the tests may pass.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message