hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "LN (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-700) hbase.io.index.interval need be configuratable in column family
Date Tue, 24 Jun 2008 06:25:45 GMT

    [ https://issues.apache.org/jira/browse/HBASE-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12607488#action_12607488
] 

LN commented on HBASE-700:
--------------------------

thanks paying attention for this issue. 

but i think it may not cause a modification in HTableDescriptor or HColumnDescriptor, for
these low-layer storage tunings.

i'd suggest a conf parameter "hbase.io.index.interval.TableA.ColumnB" for setting index interval
for column 'ColumnB' of table 'TableA'. 

> hbase.io.index.interval need be configuratable in column family 
> ----------------------------------------------------------------
>
>                 Key: HBASE-700
>                 URL: https://issues.apache.org/jira/browse/HBASE-700
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>    Affects Versions: 0.1.2
>            Reporter: LN
>            Priority: Minor
>
> setting parameter hbase.io.index.interval to smaller can improve hbase reading performance
significantly, esp. in large value size column families. however, small hbase.io.index.interval
cause more memory usage, because all index will read into memory when loading a mapfile.
> in my test env, i set hbase.io.index.interval to 1, after inserting about 3M samll size
records to a table(about 1.5G in hadoop file), the regionserver throws OOME.  then i found
total size of  map file index  is 350M.  however, i can't adjust  hbase.io.index.interval
to a larger one, like 32, because other big cell size tables need it be 1.
> so, i think make hbase.io.index.interval a column family property should be very important
for performance tuning. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message