hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lars George <lars.geo...@gmail.com>
Subject Re: Region split with one row?
Date Thu, 24 May 2012 15:19:14 GMT
Hi Ben,

The answer is c) below. 

HBase cannot split a row, so you are now carrying around a 10GB region. It does not matter
what you set the max filesize to, you are bound by this minimum unit. It seems you should
either store some data somewhere else, for example outside of HBase (HDFS maybe?), in another
row, or another table (again in probably more than one row given the size).


On May 24, 2012, at 7:48 AM, Ben Kim wrote:

> What happens when a region has columns of more than 10GB in one row?
> Default max hfile size 10GB, and if the data exceeds 10GB then a region
> split happens. But since one row takes up more than 10GB, I'm wondering how
> region split happens?
> Does this sound clear?
> In my guess there're three possible directions
>   - HBase takes care of this without any problem.
>   - I will need to increase maximum allowed HFile size
>   - There's something wrong with my table schema, and need to redo the
>   design
> what's your guess?
> Thanks a lot
> -- 
> *Benjamin Kim*
> Tel : +82 2.6400.3654* |* Mo : +82 10.5357.0521*
> benkimkimben@gmail.com*

View raw message