hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jimmy Xiang <jxi...@cloudera.com>
Subject Re: Too many "Compaction Complete" messages
Date Wed, 04 Sep 2013 15:54:12 GMT
Here "d" should be the column family being compacted.
Do you have 3-5 column families of the same region being compacted?


On Wed, Sep 4, 2013 at 8:36 AM, Tom Brown <tombrown52@gmail.com> wrote:

> Is it normal to receive 3-5 distinct "Compaction Complete" statuses for the
> same region each second? For any individual region, it continuously
> generates "Compacting d in {theregion}... Compaction Complete" statuses for
> minutes or hours.
>
> In that status message, what is "d"?
>
> --Tom
>
>
> On Wed, Sep 4, 2013 at 6:21 AM, Frank Chow <zhoushuaifeng@gmail.com>
> wrote:
>
> > Hi Tom,
> > Below parameters may help to reduce the compaction number:
> >
> >   <property>
> >     <name>hbase.hstore.compactionThreshold</name>
> >     <value>3</value>
> >     <description>
> >     If more than this number of HStoreFiles in any one HStore
> >     (one HStoreFile is written per flush of memstore) then a compaction
> >     is run to rewrite all HStoreFiles files as one.  Larger numbers
> >     put off compaction but when it runs, it takes longer to complete.
> >     </description>
> >   </property>
> >
> > Make the value larger, if there are too many small files in the region
> > dir, this may help a lot.
> >
> >
> >
> >
> >
> >
> >
> >
> > Frank Chow
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message