hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4007) distributed log splitting can get indefinitely stuck
Date Thu, 08 Sep 2011 22:14:11 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13100745#comment-13100745
] 

jiraposter@reviews.apache.org commented on HBASE-4007:
------------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1747/#review1824
-----------------------------------------------------------

Ship it!


- Ted


On 2011-09-08 22:09:32, Prakash Khemani wrote:
bq.  
bq.  -----------------------------------------------------------
bq.  This is an automatically generated e-mail. To reply, visit:
bq.  https://reviews.apache.org/r/1747/
bq.  -----------------------------------------------------------
bq.  
bq.  (Updated 2011-09-08 22:09:32)
bq.  
bq.  
bq.  Review request for hbase, Ted Yu and Michael Stack.
bq.  
bq.  
bq.  Summary
bq.  -------
bq.  
bq.  1/ resubmit all tasks owned by a dead splitlog-worker
bq.  2/ prevent accumulation of /hbase/splitlog/RESCAN nodes
bq.  
bq.  
bq.  This addresses bug HBASE-4007.
bq.      https://issues.apache.org/jira/browse/HBASE-4007
bq.  
bq.  
bq.  Diffs
bq.  -----
bq.  
bq.    src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java 9a71fdf 
bq.    src/main/java/org/apache/hadoop/hbase/master/SplitLogManager.java 54b6d45 
bq.    src/main/java/org/apache/hadoop/hbase/zookeeper/ZKSplitLog.java 61e5c65 
bq.    src/test/java/org/apache/hadoop/hbase/master/TestSplitLogManager.java 9a88855 
bq.  
bq.  Diff: https://reviews.apache.org/r/1747/diff
bq.  
bq.  
bq.  Testing
bq.  -------
bq.  
bq.  1/ resubmit all tasks owned by a dead splitlog-worker - only unit tested. will do cluster
testing.
bq.  2/ prevent accumulation of /hbase/splitlog/RESCAN nodes - tested and deployed in production.
bq.  
bq.  
bq.  Thanks,
bq.  
bq.  Prakash
bq.  
bq.



> distributed log splitting can get indefinitely stuck
> ----------------------------------------------------
>
>                 Key: HBASE-4007
>                 URL: https://issues.apache.org/jira/browse/HBASE-4007
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Prakash Khemani
>            Assignee: Prakash Khemani
>            Priority: Critical
>             Fix For: 0.92.0
>
>         Attachments: 0001-HBASE-4007-distributed-log-splitting-can-get-indefin.patch
>
>
> After the configured number of retries SplitLogManager is not going to resubmit log-split
tasks. In this situation even if the splitLogWorker that owns the task dies the task will
not get resubmitted.
> When a regionserver goes away then all the split-log tasks that it owned should be resubmitted
by the SplitLogMaster.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message