hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Job Thomas" <j...@suntecgroup.com>
Subject RE: HBase: Paralel Query
Date Wed, 27 Nov 2013 08:22:32 GMT
 
Hi Ted,All
 
I have set 
 
hfile.block.cache.size to 0.6
hbase.regionserver.handler.count to 60
DATA_BLOCK _ENCODING => 'FAST_DIFF' 
 BLOOMFILTER => 'ROW'
 BLOCKSIZE => '8192'
 BLOCKCACHE => 'true'
 
The performance has been increased. 
 
But after creating another table with same size and configurations , the performance of previous
table has been reduced and I am getting good performance for the new table created.
 
I have seen that whle querying out of maxHeapMB=15983 Hbase using only  usedHeapMB=72.
why hbase not utilizing heap space even though I have set BLOCKSIZE => '8192' ( For to
store more number of indexes in memory ).
 
I have read that once block size of hfile has been reduce, the sequential access speed will
decrease . but I didn't experienced this  even though my   BLOCKSIZE is 192' 
 
Best Regards,
Job M Thomas

________________________________

From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Wed 11/27/2013 11:48 AM
To: user@hbase.apache.org
Subject: Re: HBase: Paralel Query



bq. I didn't enabled blockcache

What if you enable blockcache ?

Cheers


On Tue, Nov 26, 2013 at 8:45 PM, Job Thomas <jobt@suntecgroup.com> wrote:

> Hello lars,
>
> Here re the answers ,
>
> -> I have only one region server. ( I am testing Hbase via phoenix with
> Hbase in a single server).
> -> All queries are fired through Phoenix only.( select Lastname from
> tablename where Id=? ( Here Id is the primary key))
> -> hbase.regionserver.handler.count=30(default value).
> -> Hardware:   Core =8
>                      Ram =8 Gb
> -> I didn't enabled blockcache.
> -> Are the client in multiple threads in the process or multiple
> processes? - I am not clear
>
>
> Best Regards,
> Job M Thomas
>
> ________________________________
>
> From: lars hofhansl [mailto:larsh@apache.org]
> Sent: Tue 11/26/2013 11:16 PM
> To: user@hbase.apache.org
> Subject: Re: HBase: Paralel Query
>
>
>
> Hi Job,
>
> first off some questions :)
> How many regions are you accessing?
> What type of query is this (get or scan)?
> How many handlers have you configured?
> What does you hardware look like (how many cores, etc)?
> Is the data all in the blockcache?
> If not, what does the disk IO look like?
> Are the client in multiple threads in the process or multiple processes?
>
>
> Sorry for all the questions, but we need a bit more data.
>
>
> -- Lars
>
>
>
> ________________________________
>  From: Job Thomas <jobt@suntecgroup.com>
> To: user@hbase.apache.org
> Sent: Tuesday, November 26, 2013 12:26 AM
> Subject: HBase: Paralel Query
>
>
>
>
> Hi All,
>
> How can we configure Hbase  inorder to perform multythreading/parallel
> query faster .
>
> These are some bits from my analysis:
>
> Each Thread contain 10 query ( Random)
>
> Tread        H2(Msec)  Phoenix(Msec)
>   1            34             215
>   2            63             222
>   4            120           324
>   6            200          340
>   8           250           460
>   10         350          560
>   12          410         592
>
> I have to find some points in the graph ploted with these values where
> lines are intercepting .
> So I need hbase to perform well with multythreaded condition .
>
>
> Best Regards,
> Job M Thomas
>
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message