Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 60F11D114 for ; Thu, 22 Nov 2012 19:51:03 +0000 (UTC) Received: (qmail 48568 invoked by uid 500); 22 Nov 2012 19:51:01 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 48520 invoked by uid 500); 22 Nov 2012 19:51:01 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Delivered-To: moderator for user@hbase.apache.org Received: (qmail 48808 invoked by uid 99); 22 Nov 2012 12:49:41 -0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) X-Virus-Scanned: amavisd-new at mediator.com.hk Subject: HBASE Benchmarking Mime-Version: 1.0 (Apple Message framework v1085) Content-Type: multipart/alternative; boundary=Apple-Mail-4--528285665 From: "ac@hsk.hk" In-Reply-To: Date: Thu, 22 Nov 2012 20:49:12 +0800 Cc: "ac@hsk.hk" Message-Id: References: <000e01cdc89a$6e1f0d60$4a5d2820$@pointcross.com> To: user@hbase.apache.org X-Mailer: Apple Mail (2.1085) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-4--528285665 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi, I tried to write one million records into the HBASE cluster with 5 nodes = (Hbase 0.94.2 on Hadoop 1.0.4) 1. Methide: sequentialWrite 2. =46rom log, I found that the process had to sleep 3 times (total = 4012ms)=20 3. It scanned .META for max=3D10rows Any idea why it got max=3D10 rows, will this parameter "max=3D10 rows" = slowdown the process? and why it had to sleep a while? Thanks 12/11/22 20:36:30 DEBUG = client.HConnectionManager$HConnectionImplementation: Removed = TestTable,0000055872,1353587583943.b1541003edf820761ffe29683fe02df4. for = tableName=3DTestTable from cache because of 0000765900 12/11/22 20:36:30 DEBUG = client.HConnectionManager$HConnectionImplementation: Retry 1, sleep for = 1003ms! 12/11/22 20:36:31 DEBUG client.MetaScanner: Scanning .META. starting at = row=3DTestTable,0000055872,00000000000000 for max=3D10 rows using = org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementatio= n@2b5356d5 12/11/22 20:36:31 DEBUG = client.HConnectionManager$HConnectionImplementation: Cached location for = TestTable,0000055872,1353587583943.b1541003edf820761ffe29683fe02df4. is = m147:60020 12/11/22 20:36:31 DEBUG = client.HConnectionManager$HConnectionImplementation: Removed = TestTable,0000055872,1353587583943.b1541003edf820761ffe29683fe02df4. for = tableName=3DTestTable from cache because of 0000765900 12/11/22 20:36:31 DEBUG = client.HConnectionManager$HConnectionImplementation: Retry 2, sleep for = 1004ms! 12/11/22 20:36:32 DEBUG client.MetaScanner: Scanning .META. starting at = row=3DTestTable,0000055872,00000000000000 for max=3D10 rows using = org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementatio= n@2b5356d5 12/11/22 20:36:32 DEBUG = client.HConnectionManager$HConnectionImplementation: Cached location for = TestTable,0000055872,1353587583943.b1541003edf820761ffe29683fe02df4. is = m147:60020 12/11/22 20:36:33 DEBUG = client.HConnectionManager$HConnectionImplementation: Removed = TestTable,0000055872,1353587583943.b1541003edf820761ffe29683fe02df4. for = tableName=3DTestTable from cache because of 0000765900 12/11/22 20:36:33 DEBUG = client.HConnectionManager$HConnectionImplementation: Retry 3, sleep for = 2005ms! 12/11/22 20:36:35 DEBUG client.MetaScanner: Scanning .META. starting at = row=3DTestTable,0000192832,00000000000000 for max=3D10 rows using = org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementatio= n@2b5356d5 12/11/22 20:36:35 DEBUG = client.HConnectionManager$HConnectionImplementation: Cached location for = TestTable,0000192832,1353587767402.0770fb8c83b64620f29a1e186aa8addb. is = m147:60020 --Apple-Mail-4--528285665--