hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Billy Pearson (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-775) max mapfiles to compact at one time
Date Wed, 13 Aug 2008 19:14:44 GMT

     [ https://issues.apache.org/jira/browse/HBASE-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Billy Pearson updated HBASE-775:
--------------------------------

    Attachment: 775-patch.txt

I went with compaction size based on file sizes not count. count is to hard to figure a default
for 
when you do not know what the column count will be on any users setup.

This should solve the problem when we are running a normal compaction but this will not solve

The issue when it comes to compacting and force is true or if we are compacting after a split
and have references.
Please review stack

The only thing missing I would like to have a debug line in there to let us know when we are
hitting the compaction limit
In case a user is setting it to low and running in to problems down the road but not sure
if its work the extra code and vars to log that.

> max mapfiles to compact at one time
> -----------------------------------
>
>                 Key: HBASE-775
>                 URL: https://issues.apache.org/jira/browse/HBASE-775
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Billy Pearson
>            Assignee: Billy Pearson
>            Priority: Blocker
>             Fix For: 0.3.0
>
>         Attachments: 775-patch.txt
>
>
> Currently we compact all map files with no upper limit this could cause a regionserver
to OOME if the compaction get behind and the number of mapfiles build up.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message