hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andriy Kolyadenko" <cryp...@mail.saturnfans.com>
Subject Re: Multi ranges Scan
Date Thu, 25 Mar 2010 23:07:39 GMT
Ok, it would work for regions pruning. And what about actual rows pruning inside single region?
Do you have any ideas how to implement it?

--- Stack wrote: ---

I think you need to make a custom splitter for your mapreduce job, one
that makes splits that align with the ranges you'd have your job run
over.   A permutation on HBASE-2302 might work for you.


On Wed, Mar 17, 2010 at 1:32 PM, Andrey Kolyadenko <cryp...@mailx.ru> wrote:
> Hi all,
> maybe somebody could give me advice in the following situation:
> Currently HBase Scan interface provides ability to set up only first and
> last rows for MR scanning. Is it any way to get multiple ranges into the map
> input?
> For example let's assume I have following table:
> key value
> 1   v1
> 2   v2
> 3   v3
> 4   v4
> 5   v5
> What I need is to get for example [1,2) and [4,5) ranges as input for my Map
> task. Actually I need this for the performance optimization.
> Any advice?
> Thanks.

Sign up for your free SaturnFans email account at http://webmail.saturnfans.com/

View raw message