hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From y_823...@tsmc.com
Subject Re: HBase reading test
Date Thu, 07 Jan 2010 06:55:31 GMT

I've found the root cause of why multiple reading users lower the hbase
That's because I always new a HTable in a share function, which will make
the region server with meta information being
very busy!
After update following code, the reading performance is fantastic.
    1 concurrent client read: 27 sec
    2 concurrent client read: 28 sec
    4 concurrent client read: 36 sec

public Vector<String> ScanHBase(String tablename,String columnfamily,String
KeyColumn,String StartKeyValue,String StopKeyValue) throws IOException {
      HTable table = new HTable(config, tablename); //-- bad writing

 2010/1/3 <y_823910@tsmc.com>                                                      
 > Each client fetch the same data(5243 rows)                                         
 > The Result is like following:                                                      
 >    1 concurrent client read:  80 sec                                               
 >    2 concurrent client read: 104 sec                                               
 >    3 concurrent client read: 232 sec                                               
 > As above, increasing more concurrent client                                        
 reading connections seems to                                                            
 > lower hbase performance too much.                                                  
 > Any opinions?                                                                      
 Clients were all running in a single process?                                           
 If so, try running them as                                                              
 distinct processes.                                                                     

Fleming Chiu(邱宏明)
週一無肉日吃素救地球(Meat Free Monday Taiwan)

                                                         TSMC PROPERTY       
 This email communication (and any attachments) is proprietary information   
 for the sole use of its                                                     
 intended recipient. Any unauthorized review, use or distribution by anyone  
 other than the intended                                                     
 recipient is strictly prohibited.  If you are not the intended recipient,   
 please notify the sender by                                                 
 replying to this email, and then delete this email and any copies of it     
 immediately. Thank you.                                                     

View raw message