hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Esteban Gutierrez <este...@cloudera.com>
Subject Re: Any fast way to random access hbase data?
Date Wed, 13 Aug 2014 07:59:12 GMT
Hello Lei,

Have you tried a larger batch size? how many threads or tasks are you using
to fetch data? could you please describe a little bit more your HBase
cluster? e.g. how many region servers, how many regions per RS? whats the
hit ratio of the block cache? any chance for you to share the table schema?


Cloudera, Inc.

On Wed, Aug 13, 2014 at 12:34 AM, leiwangouc@gmail.com <leiwangouc@gmail.com
> wrote:

> I have a hbase table with more than 2G rows.
> Every hour there comes 5M~10M row ids and i must get all the row info from
> the hbase table.
> But even I use the batch call(1000 row ids as a list) as described here
> http://stackoverflow.com/questions/13310434/hbase-api-get-data-rows-information-by-list-of-row-ids
> It takes about 1 hour.
> Any other way to do this more quickly?
> Thanks,
> Lei
> leiwangouc@gmail.com

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message