hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravindra <ravin.i...@gmail.com>
Subject Re: Get operation slows in MR job
Date Tue, 29 Jul 2014 04:56:47 GMT
Hi Thomas,

Putting this in MR job could result in some performance improvement

scan.setCaching(500);
scan.setCacheBlocks(false);

Regards,
Ravindra


On Tue, Jul 29, 2014 at 6:04 AM, Thomas Kwan <thomas.kwan@manage.com> wrote:

> Hi there,
>
> I have a MR job that does Get and then Put operation to a Hbase table.
> For the write operation, I am using TableOutputFormat (like to the map
> function in
>
> https://github.com/larsgeorge/hbase-book/blob/master/ch07/src/main/java/mapreduce/ImportFromFile.java
> ).
> The write is pretty fast, 200K requests/sec.
>
> But the read operations are slow, like 2K requests/sec. I wonder if anyone
> has recommendation on how to improve read operations. I am using batched
> Gets already.
>
> thanks in advance
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message