hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tom Brown <tombrow...@gmail.com>
Subject Re: Too many "Compaction Complete" messages
Date Wed, 04 Sep 2013 17:27:14 GMT
No, just one column family (called "d", not surprisingly).

--Tom


On Wed, Sep 4, 2013 at 9:54 AM, Jimmy Xiang <jxiang@cloudera.com> wrote:

> Here "d" should be the column family being compacted.
> Do you have 3-5 column families of the same region being compacted?
>
>
> On Wed, Sep 4, 2013 at 8:36 AM, Tom Brown <tombrown52@gmail.com> wrote:
>
> > Is it normal to receive 3-5 distinct "Compaction Complete" statuses for
> the
> > same region each second? For any individual region, it continuously
> > generates "Compacting d in {theregion}... Compaction Complete" statuses
> for
> > minutes or hours.
> >
> > In that status message, what is "d"?
> >
> > --Tom
> >
> >
> > On Wed, Sep 4, 2013 at 6:21 AM, Frank Chow <zhoushuaifeng@gmail.com>
> > wrote:
> >
> > > Hi Tom,
> > > Below parameters may help to reduce the compaction number:
> > >
> > >   <property>
> > >     <name>hbase.hstore.compactionThreshold</name>
> > >     <value>3</value>
> > >     <description>
> > >     If more than this number of HStoreFiles in any one HStore
> > >     (one HStoreFile is written per flush of memstore) then a compaction
> > >     is run to rewrite all HStoreFiles files as one.  Larger numbers
> > >     put off compaction but when it runs, it takes longer to complete.
> > >     </description>
> > >   </property>
> > >
> > > Make the value larger, if there are too many small files in the region
> > > dir, this may help a lot.
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Frank Chow
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message