hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin O'dell" <kevin.od...@cloudera.com>
Subject Re: How to know it's time for a major compaction?
Date Wed, 12 Dec 2012 20:50:51 GMT
Ted,

  That is awesome.  Thank you!

On Wed, Dec 12, 2012 at 3:36 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> Thanks confirmation, Kevin.
>
> I logged HBASE-7340 so that user doesn't have to script for compaction.
>
> On Wed, Dec 12, 2012 at 12:30 PM, Kevin O'dell <kevin.odell@cloudera.com
> >wrote:
>
> > Ted,
> >
> >   Yes, it is all done through scripting.
> >
> > On Wed, Dec 12, 2012 at 3:22 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> >
> > > bq. they will major compact any region the balancer has moved.
> > >
> > > Interesting. Do they achieve this through scripting ?
> > >
> > > I think HBase can perform some follow-on action after region movement.
> > >
> > > Cheers
> > >
> > > On Wed, Dec 12, 2012 at 12:19 PM, Kevin O'dell <
> kevin.odell@cloudera.com
> > > >wrote:
> > >
> > > > Otis,
> > > >
> > > > I think it depends on your use case.  Some use cases are extremely
> > > > dependent on locality and latency, so they will major compact any
> > region
> > > > the balancer has moved.  Some people follow the HFile count and will
> > > > trigger a major when there are x amount of files.  Others will just
> > > follow
> > > > best practices and do it daily.  Some do very little writes and only
> > > > compact once a week.
> > > >
> > > > On Wed, Dec 12, 2012 at 3:15 PM, Otis Gospodnetic <
> > > > otis.gospodnetic@gmail.com> wrote:
> > > >
> > > > > Hello,
> > > > >
> > > > > What are the main metrics/signals people use/look at to say "OK,
I
> > > really
> > > > > need to do a major compaction now", other than "hm, performance is
> > not
> > > > > good, let's try major compaction tonight"?
> > > > >
> > > > > Thanks,
> > > > > Otis
> > > > > --
> > > > > HBASE Performance Monitoring - http://sematext.com/spm/index.html
> > > > > Search Analytics - http://sematext.com/search-analytics/index.html
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Kevin O'Dell
> > > > Customer Operations Engineer, Cloudera
> > > >
> > >
> >
> >
> >
> > --
> > Kevin O'Dell
> > Customer Operations Engineer, Cloudera
> >
>



-- 
Kevin O'Dell
Customer Operations Engineer, Cloudera

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message