hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "huaxiang sun (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16578) Mob data loss after mob compaction and normal compcation
Date Wed, 21 Sep 2016 00:11:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508209#comment-15508209
] 

huaxiang sun commented on HBASE-16578:
--------------------------------------

Thanks [~jingcheng.du@intel.com]! When I have time, I will probably debug more about the original
testing case to see why it randomly fails.

> Mob data loss after mob compaction and normal compcation
> --------------------------------------------------------
>
>                 Key: HBASE-16578
>                 URL: https://issues.apache.org/jira/browse/HBASE-16578
>             Project: HBase
>          Issue Type: Bug
>          Components: mob
>    Affects Versions: 2.0.0
>            Reporter: huaxiang sun
>            Assignee: Jingcheng Du
>         Attachments: TestMobCompaction.java, TestMobCompaction.java
>
>
> StoreFileScanners on MOB cells rely on the scannerOrder to find the latest cells after
compaction. The value of scannerOrder is assigned by the order of maxSeqId of StoreFile, and
this maxSeqId is valued only after the reader of the StoreFile is created.
> In {{StoreFileScanner.getScannersForStoreFiles}}, the StoreFiles are sorted before the
readers are created and at that time the maxSeqId for each file is -1 (the default value).
This will lead  to a chaos in scanners on MOB cells. We need to create readers just before
the sorting in the method {{StoreFileScanner.getScannersForStoreFiles}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message