hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jingcheng Du (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15381) Implement a distributed MOB compaction by procedure
Date Thu, 03 Mar 2016 08:35:18 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177484#comment-15177484
] 

Jingcheng Du commented on HBASE-15381:
--------------------------------------

Sure [~saint.ack@gmail.com].
Now in mob, we have a periodically run mob compaction, it can be disabled by setting the periodical
value as -1.
In this compaction, small mob files (the threshold can be configured by users) are collected
and grouped. The groups are compacted one by one by HMaster. There will be additional I/O
between HMaster and HDFS DNs.
In this JIRA, all of these work will be distributed to region servers.

> Implement a distributed MOB compaction by procedure
> ---------------------------------------------------
>
>                 Key: HBASE-15381
>                 URL: https://issues.apache.org/jira/browse/HBASE-15381
>             Project: HBase
>          Issue Type: Improvement
>          Components: mob
>            Reporter: Jingcheng Du
>            Assignee: Jingcheng Du
>
> In MOB, there is a periodical compaction which runs in HMaster (It can be disabled by
configuration), some small mob files are merged into bigger ones. Now the compaction only
runs in HMaster which is not efficient and might impact the running of HMaster. In this JIRA,
a distributed MOB compaction is introduced, it is triggered by HMaster, but all the compaction
jobs are distributed to HRegionServers.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message