hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rahul malviya <malviyarahul2...@gmail.com>
Subject Re: How to Restore the block locality of a RegionServer ?
Date Sun, 10 May 2015 04:36:38 GMT
Thanks for suggestion. I will try this and update the thread if the data
locality is restored.

Thanks,
Rahul

On Sat, May 9, 2015 at 6:36 PM, Dave Latham <latham@davelink.net> wrote:

> Major compactions will fix locality, so long as there is space on the
> local data nodes and they actually happen.  Also, if there is already
> only a single HFile in a store, major compaction may be skipped.
> Newer versions of hbase have a parameter
> hbase.hstore.min.locality.to.skip.major.compact that you can set to
> perform major compaction if locality is below some threshold, even if
> there is only one store file.  (See HBASE-11195).
>
> Dave
>
> On Sat, May 9, 2015 at 5:31 PM, Bryan Beaudreault
> <bbeaudreault@hubspot.com> wrote:
> > Major compactions will restore locality to the cluster.
> >
> > On Sat, May 9, 2015 at 3:36 PM, Michael Segel <michael_segel@hotmail.com
> >
> > wrote:
> >
> >> First, understand why you had to create an ‘auto restart’ script.
> >>
> >> Taking down HBase completely (probably including zookeeper) and do a
> full
> >> restart would probably fix the issue of data locality.
> >>
> >>
> >> > On May 9, 2015, at 5:05 PM, rahul malviya <malviyarahul2001@gmail.com
> >
> >> wrote:
> >> >
> >> > Hi,
> >> >
> >> > My HBase cluster went through a rough patch recently where lot of
> region
> >> > server started dying because of sudden increase in amount of data
> being
> >> > funneled to the HBase cluster and we have to place a auto start script
> >> for
> >> > regionservers.
> >> >
> >> > After this all my data locality is lost which does not seems to
> recover
> >> > even after compaction. This has degraded the performance by a factor
> of
> >> 4.
> >> > So I want to know is their a way to restore the data locality of my
> HBase
> >> > cluster.
> >> >
> >> > I am using hbase-0.98.6-cdh5.2.0.
> >> >
> >> > Thanks,
> >> > Rahul
> >>
> >> The opinions expressed here are mine, while they may reflect a cognitive
> >> thought, that is purely accidental.
> >> Use at your own risk.
> >> Michael Segel
> >> michael_segel (AT) hotmail.com
> >>
> >>
> >>
> >>
> >>
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message