hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Gray (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-3182) If server hosting META dies or is stopping while processing another server shutdown, IOE accessing META stop shutdown handler from finishing
Date Mon, 01 Nov 2010 20:14:25 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927128#action_12927128
] 

Jonathan Gray commented on HBASE-3182:
--------------------------------------

Tripped over this again but didn't even seem to relate to META.  Just got this uncaught exception
that killed my shutdown handler.

> If server hosting META dies or is stopping while processing another server shutdown,
IOE accessing META stop shutdown handler from finishing
> --------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-3182
>                 URL: https://issues.apache.org/jira/browse/HBASE-3182
>             Project: HBase
>          Issue Type: Bug
>          Components: master
>    Affects Versions: 0.90.0
>            Reporter: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.90.0
>
>
> In TestRollingRestart, there is a test which kills server hosting ROOT then immediately
kills server hosting META.  In a recent run this turned up a small race condition if the server
hosting META is closing while we process shutdown of server hosting ROOT.
> {noformat}
> 2010-10-31 20:41:34,621 ERROR [MASTER_META_SERVER_OPERATIONS-dev692.sf2p.facebook.com:54989-0]
executor.EventHandler(154): Caught throwable while processing event M_META_SERVER_SHUTDOWN
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: Server not running
>         at org.apache.hadoop.hbase.regionserver.HRegionServer.checkOpen(HRegionServer.java:2216)
>         at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1652)
>         at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:561)
>         at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
>         at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:749)
>         at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:255)
>         at $Proxy8.openScanner(Unknown Source)
>         at org.apache.hadoop.hbase.catalog.MetaReader.getServerUserRegions(MetaReader.java:495)
>         at org.apache.hadoop.hbase.master.handler.ServerShutdownHandler.process(ServerShutdownHandler.java:125)
>         at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:151)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
>         at java.lang.Thread.run(Thread.java:619)
> {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message