hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kannan Muthukkaruppan (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-3290) Max Compaction Size
Date Thu, 02 Dec 2010 21:54:10 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12966296#action_12966296

Kannan Muthukkaruppan commented on HBASE-3290:

Two comments:

#1. We should still retain ability to major compact all files when invoked from shell/admin
API. (Already spoke with Nicolas on this, and he is in agreement).

#2. The comment that Stack raised: <<So, its ok to mess w/ file order? We won't get
ourselves into trouble if we don't respect the order in which files were written? We do a
merge sort when we read all compaction candidates in so should be fine I suppose - since its
same as how scanner merges them...... >> is actually a concern.

It is currently important that we compact a continguous (when sorted by maxSeqId) sub-set
of files. HBASE-1485 fix relies on this to resolve conflicts between cells that have the same
version. [Once we have the proposed fix for HBASE-2856, this will not be necessary. But until
then, the "sort by size" would be an unsafe change.]

> Max Compaction Size
> -------------------
>                 Key: HBASE-3290
>                 URL: https://issues.apache.org/jira/browse/HBASE-3290
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Nicolas Spiegelberg
>            Assignee: Nicolas Spiegelberg
>            Priority: Minor
>             Fix For: 0.92.0
>         Attachments: 3290-v2.txt
> Add ability to specify a maximum storefile size for compaction.  After this limit, we
will not include this file in compactions.  This is useful for large object stores and clusters
that pre-split regions.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message