hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-7487) Test for split edit file ordering using failover scenario
Date Thu, 03 Jan 2013 17:30:12 GMT
Ted Yu created HBASE-7487:
-----------------------------

             Summary: Test for split edit file ordering using failover scenario
                 Key: HBASE-7487
                 URL: https://issues.apache.org/jira/browse/HBASE-7487
             Project: HBase
          Issue Type: Sub-task
            Reporter: Ted Yu


TestHLogMethods#testGetSplitEditFilesSorted tests the ordering of split edit files. However,
we should have a test covering more realistic scenario.

Suppose there are two split edit files for one region.
 
Their edits are as the following
 
File 1:
edit id 1001
edit id 1002
edit id 1003
 
File 2:
edit id 2001
edit id 2002
edit id 2003
 
As the current logic, file 1 is named "1003" and file 2 is named "2003".

Suppose region's seq id is 1000 before replaying edits files.
 
So we will replay all the edits in File 1 and File 2
 
However, if we replay File 2 first, the following case could result in data loss:
1.Completing File 2 replay.
2.Do the internalFlushcache.(see HRegion#replayRecoveredEdits:
if (flush) internalFlushcache(null, currentEditSeqId, status);)
3.the regionserver crashes
4.Region is assigned to another server, an its seq ID becomes 2003
5.File1 will be skipped when replaying edits


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message