hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jingyun Tian (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-18128) compaction marker could be skipped
Date Sat, 27 May 2017 03:52:04 GMT
Jingyun Tian created HBASE-18128:
------------------------------------

             Summary: compaction marker could be skipped 
                 Key: HBASE-18128
                 URL: https://issues.apache.org/jira/browse/HBASE-18128
             Project: HBase
          Issue Type: Improvement
          Components: Compaction, regionserver
            Reporter: Jingyun Tian


The sequence for a compaction are as follows:
1. Compaction writes new files under region/.tmp directory (compaction output)
2. Compaction atomically moves the temporary file under region directory
3. Compaction appends a WAL edit containing the compaction input and output files. Forces
sync on WAL.
4. Compaction deletes the input files from the region directory.

But if a flush happened between 3 and 4, then the regionserver crushed. The compaction marker
will be skipped when splitting log because the sequence id of compaction marker is smaller
than lastFlushedSequenceId.
{code}
        if (lastFlushedSequenceId >= entry.getKey().getLogSeqNum()) {
          editsSkipped++;
          continue;
        }
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message