hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Brown <tombrow...@gmail.com>
Subject Re: Too many "Compaction Complete" messages
Date Wed, 04 Sep 2013 15:36:45 GMT
Is it normal to receive 3-5 distinct "Compaction Complete" statuses for the
same region each second? For any individual region, it continuously
generates "Compacting d in {theregion}... Compaction Complete" statuses for
minutes or hours.

In that status message, what is "d"?

--Tom


On Wed, Sep 4, 2013 at 6:21 AM, Frank Chow <zhoushuaifeng@gmail.com> wrote:

> Hi Tom,
> Below parameters may help to reduce the compaction number:
>
>   <property>
>     <name>hbase.hstore.compactionThreshold</name>
>     <value>3</value>
>     <description>
>     If more than this number of HStoreFiles in any one HStore
>     (one HStoreFile is written per flush of memstore) then a compaction
>     is run to rewrite all HStoreFiles files as one.  Larger numbers
>     put off compaction but when it runs, it takes longer to complete.
>     </description>
>   </property>
>
> Make the value larger, if there are too many small files in the region
> dir, this may help a lot.
>
>
>
>
>
>
>
>
> Frank Chow

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message