Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of gopinathan.a@huawei.com
 designates 119.145.14.64 as permitted sender)
From: Gopinathan A <gopinathan.a@huawei.com>
To: <dev@hbase.apache.org>
Subject: What is the best way to get the total row count?
Date: Mon, 9 Jul 2012 16:11:10 +0530
Organization: Huawei
Message-ID: <000601cd5dbf$5b163090$114291b0$@a@huawei.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_NextPart_000_0007_01CD5DED.74CE6C90"
Thread-Index: Ac1dv1peefkKgapdTS2CRk7zt1uo3Q==
Content-Language: en-us

------=_NextPart_000_0007_01CD5DED.74CE6C90
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit

Hi,

 
What is the best way to get the total row count?

 
I tried following things,

a>     Count 'tablename' in shell prompt: Helpful, only with very less
number of records.

b>     Runing RowCounter Job: It took almost 8hr to get row count of 2TB
data in 3node cluster (16 core system, 48GB RAM)

c>   Using AggregationClient: Disk IO is very high (System wait is 65-70%,
Load factor is almost 110), this makes server to non responsive and makes
the clients to go down (Due to RPCTimeOut Exceptions).

Thanks & Regards,

Gopinathan A

 
****************************************************************************
***********
This e-mail and attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed
above. Any use of the information contained herein in any way (including,
but not limited to, total or partial disclosure, reproduction, or
dissemination) by persons other than the intended recipient's) is
prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!

 
------=_NextPart_000_0007_01CD5DED.74CE6C90--