hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Meil <doug.m...@explorysmedical.com>
Subject Re: The write process in the Region Server
Date Mon, 11 Jun 2012 12:22:53 GMT

Hi there-

Your understanding is on track.

You probably want to read this section..


Š as it covers those topics in more detail.

On 6/10/12 1:02 PM, "Amit Sela" <amits@infolinks.com> wrote:

>Hi all,
>I'm trying to better understand what's going on in the region server
>write to HBase.
>As I understand the process:
>1. Data is written to memstore.
>2. Once the memstore has reached hbase.hregion.memstore.flush.size ->
>memstore executes flush and writes a new StoreFile.
>3. The number of StoreFiles increases until a compaction is triggered.
>To my understanding, the compaction is triggered after a compaction check
>is done by either CheckCompaction thread running in the background or by
>the flush memstore executed.
>The compaction triggered will be a minor compaction BUT it could promote
>major if it includes all store files.
>When will it NOT include all store files ? say I set compactionThreshld to
>3, then when the 3rd (or 4th) flush is executed, a compaction wiil be
>triggered and will promote to major since it includes all store files.
>Is this right ? can anyone elaborate ?

View raw message