hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gaurav Agarwal <gau...@arkin.net>
Subject Re: Compaction settings per table
Date Fri, 26 Feb 2016 17:30:33 GMT
Got it! Very helpful.

On Fri, Feb 26, 2016 at 3:18 PM, Anoop John <anoop.hbase@gmail.com> wrote:

> In second part he says HBase RS considers both the global configs and
> table/CF level configs in one plate and decides how to handle each
> table/CF
> You can follow his first statement and use the API on HTD/ HCD
>
> -Anoop-
>
> On Fri, Feb 26, 2016 at 11:21 AM, Gaurav Agarwal <gaurav@arkin.net> wrote:
> > Thanks Enis! this is really helpful.
> > I could not understand your second suggestion; could you please explain
> it
> > a bit more?
> >
> > *For compaction and flush, we have a CompoundConfiguration*
> > *that is a layered configuration of hbase-site.xml values ->*
> > *HTD.getConfiguration() values -> HCD.getConfiguration() values.'*
> >
> >
> > On Fri, Feb 26, 2016 at 4:41 AM, Enis Söztutar <enis@hortonworks.com>
> wrote:
> >
> >> For compaction configurations, you can also set it per table OR even per
> >> column family.
> >>
> >> In java, you can use
> >>
> >> HTableDescriptor.setConfiguration() or
> HColumnDescriptor.setConfiguration()
> >> to set the specific configuration values that overrides the ones set in
> >> hbase-site.xml. For compaction and flush, we have a
> CompoundConfiguration
> >> that is a layered configuration of hbase-site.xml values ->
> >> HTD.getConfiguration() values -> HCD.getConfiguration() values.
> >>
> >> You can also use hbase shell to set the configuration as well.
> >>
> >> Enis
> >>
> >> On Thu, Feb 25, 2016 at 4:51 AM, Gaurav Agarwal <gaurav@arkin.net>
> wrote:
> >>
> >> > Go the answer to memstore size per table
> >> > via TableDescriptor#setMemStoreFlushSize(long)
> >> >
> >> > On Thu, Feb 25, 2016 at 5:38 PM, Gaurav Agarwal <gaurav@arkin.net>
> >> wrote:
> >> >
> >> > > In addition, is there a way to set memstore flush size per table/cf
> as
> >> > > well?
> >> > >
> >> > > On Thu, Feb 25, 2016 at 5:20 PM, Gaurav Agarwal <gaurav@arkin.net>
> >> > wrote:
> >> > >
> >> > >> Hi,
> >> > >>
> >> > >> Is there a way to set Compaction configurations differently for
> each
> >> of
> >> > >> my table? Specifically, I want to tweak `
> >> > >> hbase.hstore.compaction.min.size` parameter for one of my table
> while
> >> > >> keeping it to its default value for others.
> >> > >>
> >> > >> --cheers, gaurav
> >> > >>
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > --cheers, gaurav
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > --cheers, gaurav
> >> >
> >>
> >
> >
> >
> > --
> > --cheers, gaurav
>



-- 
--cheers, gaurav

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message