hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gopinathan A <gopinatha...@huawei.com>
Subject What is the best way to get the total row count?
Date Mon, 09 Jul 2012 10:41:10 GMT
Hi,

 

What is the best way to get the total row count?

 

I tried following things,

a>     Count 'tablename' in shell prompt: Helpful, only with very less
number of records.

b>     Runing RowCounter Job: It took almost 8hr to get row count of 2TB
data in 3node cluster (16 core system, 48GB RAM)

c>   Using AggregationClient: Disk IO is very high (System wait is 65-70%,
Load factor is almost 110), this makes server to non responsive and makes
the clients to go down (Due to RPCTimeOut Exceptions).

Thanks & Regards,

Gopinathan A

 

****************************************************************************
***********
This e-mail and attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed
above. Any use of the information contained herein in any way (including,
but not limited to, total or partial disclosure, reproduction, or
dissemination) by persons other than the intended recipient's) is
prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!

 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message