hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anoop John <anoop.hb...@gmail.com>
Subject Re: Compaction settings per table
Date Fri, 26 Feb 2016 09:48:15 GMT
In second part he says HBase RS considers both the global configs and
table/CF level configs in one plate and decides how to handle each
table/CF
You can follow his first statement and use the API on HTD/ HCD

-Anoop-

On Fri, Feb 26, 2016 at 11:21 AM, Gaurav Agarwal <gaurav@arkin.net> wrote:
> Thanks Enis! this is really helpful.
> I could not understand your second suggestion; could you please explain it
> a bit more?
>
> *For compaction and flush, we have a CompoundConfiguration*
> *that is a layered configuration of hbase-site.xml values ->*
> *HTD.getConfiguration() values -> HCD.getConfiguration() values.'*
>
>
> On Fri, Feb 26, 2016 at 4:41 AM, Enis Söztutar <enis@hortonworks.com> wrote:
>
>> For compaction configurations, you can also set it per table OR even per
>> column family.
>>
>> In java, you can use
>>
>> HTableDescriptor.setConfiguration() or HColumnDescriptor.setConfiguration()
>> to set the specific configuration values that overrides the ones set in
>> hbase-site.xml. For compaction and flush, we have a CompoundConfiguration
>> that is a layered configuration of hbase-site.xml values ->
>> HTD.getConfiguration() values -> HCD.getConfiguration() values.
>>
>> You can also use hbase shell to set the configuration as well.
>>
>> Enis
>>
>> On Thu, Feb 25, 2016 at 4:51 AM, Gaurav Agarwal <gaurav@arkin.net> wrote:
>>
>> > Go the answer to memstore size per table
>> > via TableDescriptor#setMemStoreFlushSize(long)
>> >
>> > On Thu, Feb 25, 2016 at 5:38 PM, Gaurav Agarwal <gaurav@arkin.net>
>> wrote:
>> >
>> > > In addition, is there a way to set memstore flush size per table/cf as
>> > > well?
>> > >
>> > > On Thu, Feb 25, 2016 at 5:20 PM, Gaurav Agarwal <gaurav@arkin.net>
>> > wrote:
>> > >
>> > >> Hi,
>> > >>
>> > >> Is there a way to set Compaction configurations differently for each
>> of
>> > >> my table? Specifically, I want to tweak `
>> > >> hbase.hstore.compaction.min.size` parameter for one of my table while
>> > >> keeping it to its default value for others.
>> > >>
>> > >> --cheers, gaurav
>> > >>
>> > >
>> > >
>> > >
>> > > --
>> > > --cheers, gaurav
>> > >
>> >
>> >
>> >
>> > --
>> > --cheers, gaurav
>> >
>>
>
>
>
> --
> --cheers, gaurav

Mime
View raw message