hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-7698) race between RS shutdown thread and openregionhandler causes region to get stuck
Date Tue, 29 Jan 2013 19:11:12 GMT

    [ https://issues.apache.org/jira/browse/HBASE-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13565661#comment-13565661
] 

Sergey Shelukhin commented on HBASE-7698:
-----------------------------------------

[~ram_krish] Were you going to take a look? I thought the patch would be trivial (update state
in ZK before FS calls, or catch exceptions; maybe see other calls before for what can be done
after ZK update instead/needs exceptions caught) and was planning to make one today. I will
unassign myself for now.
                
> race between RS shutdown thread and openregionhandler causes region to get stuck
> --------------------------------------------------------------------------------
>
>                 Key: HBASE-7698
>                 URL: https://issues.apache.org/jira/browse/HBASE-7698
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>
> 2013-01-22 17:59:03,237 INFO  [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5984cf08]
hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(186): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5984cf08
> ...
> 2013-01-22 17:59:03,411 DEBUG [RS_OPEN_REGION-10.11.2.92,50661,1358906192942-0] regionserver.HRegion(1001):
Closing IntegrationTestRebalanceAndKillServersTargeted,66666660,1358906196709.0200b366bc37c5afd1185f7d487c7dfb.:
disabling compactions &amp; flushes
> 2013-01-22 17:59:03,411 DEBUG [RS_OPEN_REGION-10.11.2.92,50661,1358906192942-0] regionserver.HRegion(1023):
Updates disabled for region IntegrationTestRebalanceAndKillServersTargeted,66666660,1358906196709.0200b366bc37c5afd1185f7d487c7dfb.
> 2013-01-22 17:59:03,415 ERROR [RS_OPEN_REGION-10.11.2.92,50661,1358906192942-0] executor.EventHandler(205):
Caught throwable while processing event M_RS_OPEN_REGION
> java.io.IOException: java.io.IOException: java.io.IOException: Filesystem closed
> 	at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1058)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:974)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:945)
> 	at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.cleanupFailedOpen(OpenRegionHandler.java:459)
> 	at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:143)
> 	at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:680)
> tryTransitionFromOpeningToFailedOpen or transitionToOpened below is never called and
region can get stuck.
> As an added benefit, the meta is already written by that time.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message