hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: How to know it's time for a major compaction?
Date Wed, 12 Dec 2012 20:22:27 GMT
bq. they will major compact any region the balancer has moved.

Interesting. Do they achieve this through scripting ?

I think HBase can perform some follow-on action after region movement.

Cheers

On Wed, Dec 12, 2012 at 12:19 PM, Kevin O'dell <kevin.odell@cloudera.com>wrote:

> Otis,
>
> I think it depends on your use case.  Some use cases are extremely
> dependent on locality and latency, so they will major compact any region
> the balancer has moved.  Some people follow the HFile count and will
> trigger a major when there are x amount of files.  Others will just follow
> best practices and do it daily.  Some do very little writes and only
> compact once a week.
>
> On Wed, Dec 12, 2012 at 3:15 PM, Otis Gospodnetic <
> otis.gospodnetic@gmail.com> wrote:
>
> > Hello,
> >
> > What are the main metrics/signals people use/look at to say "OK, I really
> > need to do a major compaction now", other than "hm, performance is not
> > good, let's try major compaction tonight"?
> >
> > Thanks,
> > Otis
> > --
> > HBASE Performance Monitoring - http://sematext.com/spm/index.html
> > Search Analytics - http://sematext.com/search-analytics/index.html
> >
>
>
>
> --
> Kevin O'Dell
> Customer Operations Engineer, Cloudera
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message