Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C14C9F3C4 for ; Sat, 20 Apr 2013 23:37:51 +0000 (UTC) Received: (qmail 96958 invoked by uid 500); 20 Apr 2013 23:37:51 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 96901 invoked by uid 500); 20 Apr 2013 23:37:50 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 96892 invoked by uid 99); 20 Apr 2013 23:37:50 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 20 Apr 2013 23:37:50 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [98.139.213.146] (HELO nm6-vm0.bullet.mail.bf1.yahoo.com) (98.139.213.146) by apache.org (qpsmtpd/0.29) with SMTP; Sat, 20 Apr 2013 23:37:42 +0000 Received: from [98.139.212.150] by nm6.bullet.mail.bf1.yahoo.com with NNFMP; 20 Apr 2013 23:37:20 -0000 Received: from [98.139.212.220] by tm7.bullet.mail.bf1.yahoo.com with NNFMP; 20 Apr 2013 23:37:20 -0000 Received: from [127.0.0.1] by omp1029.mail.bf1.yahoo.com with NNFMP; 20 Apr 2013 23:37:20 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 436262.70260.bm@omp1029.mail.bf1.yahoo.com Received: (qmail 19322 invoked by uid 60001); 20 Apr 2013 23:37:20 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1366501040; bh=D4hVBFgakH+/yZs1OLHTDqg/bWyCIQoGwyiACy97ogE=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-RocketYMMF:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=I3pmVosj6nh7UcfIK+iAE5GnVhm0viHvM58XotoVh/fBOemIgrpYWTmPVCHm4dtfqTQpPCr96ZX6KAoAMt4TgRqUNr5lqQEsAMKvY5kmjEahCno4+UBs7c/N8rhDxlOt+DjHX+jg6uawZjfXDShVyByKHogzIj0CposXDBYVwK0= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-RocketYMMF:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=hUJlDboNUlYsEFj7M3GdWtfNs1gLiOdnimwOyq8RkssE3OP8VvZwmfY4TxDoibiOOT6lN8J0OqUOiNynAAyWaO/d6QjTyibIW5VfwW1/6ShTRiOUeNBJtSejPoco4xqm5oTYi0Pq/LRBqz4OBEOcnR56BwcP1gYawUa+SfkPF9g=; X-YMail-OSG: YeSDUckVM1lhk7mdM9LzxGmZdi8ksIGXjbyaDI1F5Z1ZVa_ kK6SrBjx6r5iWC7uMShpyPhYRXJ8HQ5pqDjDnqpSJsGe54ApAwYhej4k1Xcm eGTfAjze0EP2PO_yK7LQ5WKwpR6D9ZccFSWqU_ShBp33exdZeLkw8UO4oeCE 2aEskuqNL_lYn5fjp5nct1WYJxpP7Bbrt9EDntFQGPJUu6l3Nw8Zo0TXlOGS E_NKt5XVYEmAkuPayQhrgRivPyjBfIA9rlRlWjHJUiVLMYppv9jGnLedPjBh kTeybY7HgkBQd_8G2WSfJAWHy3dtkThVfwTQUvLF9ed9USveXqBpFKO14rVh cHvXqavG6DuuPAcZpP4wqr6k6dIX_utpGuwHoTHQe9Z5gtby4b8IJ0MOzCPl bvi0ONQ4VjZm395Vcsucw423fuYkcAe6qrs_EuH7ED5ek.3.h0Elub7LRvqP hx2HcYgEhOaRpM3aTy9ushNwSwV2tmDTooj94lAmgbZ6.xzl6I4jic70z7WN WabSIt6mM0CPvphkMWGrQY8sQ.z3VpQEHCMSwGk5A_s_CeNP0gN0JSM7X6Pb sduqI3yQ07q92K_W9_5XClmZ.T1ICWpy2ZHSTfuzOGeYTsBljPqdcrE6cpmd iPnhUHyNTQQ-- Received: from [24.130.114.129] by web140604.mail.bf1.yahoo.com via HTTP; Sat, 20 Apr 2013 16:37:19 PDT X-Rocket-MIMEInfo: 002.001,SSBjaGVja2VkIHdpdGggYSBwcm9maWxlLiBOb3RoaW5nIHN0aWNrcyBvdXQuCkRpZCB5b3UgYnVpbGQgdGhlIHRhcmJhbGxzIGluIGJvdGggY2FzZXM_CgoKLS0gTGFycwoKCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwogRnJvbTogbGFycyBob2ZoYW5zbCA8bGFyc2hAYXBhY2hlLm9yZz4KVG86IEplYW4tTWFyYyBTcGFnZ2lhcmkgPGplYW4tbWFyY0BzcGFnZ2lhcmkub3JnPjsgImRldkBoYmFzZS5hcGFjaGUub3JnIiA8ZGV2QGhiYXNlLmFwYWNoZS5vcmc.IApTZW50OiBTYXR1cmRheSwgQXABMAEBAQE- X-RocketYMMF: lhofhansl X-Mailer: YahooMailWebService/0.8.141.536 References: <1366224001.73619.YahooMailNeo@web140604.mail.bf1.yahoo.com> <1366394372.26382.YahooMailNeo@web140606.mail.bf1.yahoo.com> <1366494960.94285.YahooMailNeo@web140606.mail.bf1.yahoo.com> Message-ID: <1366501039.2759.YahooMailNeo@web140604.mail.bf1.yahoo.com> Date: Sat, 20 Apr 2013 16:37:19 -0700 (PDT) From: lars hofhansl Reply-To: lars hofhansl Subject: Re: [VOTE] The 1st hbase 0.94.7 release candidate is available for download To: "dev@hbase.apache.org" , Jean-Marc Spaggiari , lars hofhansl In-Reply-To: <1366494960.94285.YahooMailNeo@web140606.mail.bf1.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="1023258982-1762147109-1366501039=:2759" X-Virus-Checked: Checked by ClamAV on apache.org --1023258982-1762147109-1366501039=:2759 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable I checked with a profile. Nothing sticks out.=0ADid you build the tarballs = in both cases?=0A=0A=0A-- Lars=0A=0A=0A=0A________________________________= =0A From: lars hofhansl =0ATo: Jean-Marc Spaggiari ; "dev@hbase.apache.org" =0ASent:= Saturday, April 20, 2013 2:56 PM=0ASubject: Re: [VOTE] The 1st hbase 0.94.= 7 release candidate is available for download=0A =0A=0AHmm... Does a profil= e run point to anything?=0A=0A-- Lars=0A=0A=0A=0A__________________________= ______=0AFrom: Jean-Marc Spaggiari =0ATo: dev@hbas= e.apache.org; lars hofhansl =0ASent: Saturday, April 20,= 2013 7:35 AM=0ASubject: Re: [VOTE] The 1st hbase 0.94.7 release candidate = is available for download=0A=0A=0ASo, here are the new results.=0A=0AI re-r= an the RandomWriteTest with JDK 1.6 and JDK 1.7 on the same=0Acomputer. I a= lso re-ran it on another one on a SSD with 32GB ram and 8=0Acores with JDK = 1.6. All giving the same trend.=0A=0AI will re-run again with more rows and= then retry with more than 1=0Aclient and compare.=0A=0AJM=0A=0ASummary:=0A= =A0=A0=A0 =A0=A0=A0 =A0=A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 Average rows/seconds=0AComputer1=A0=A0=A0 JDK 1.7=A0=A0=A0 0.94.6.1=A0= =A0=A0 30112=0AComputer1=A0=A0=A0 JDK 1.7=A0=A0=A0 0.94.7=A0=A0=A0 28431=0A= =A0=A0=A0 =A0=A0=A0 =A0=A0=A0 =0AComputer1=A0=A0=A0 JDK 1.6=A0=A0=A0 0.94.6= .1=A0=A0=A0 26384=0AComputer1=A0=A0=A0 JDK 1.6=A0=A0=A0 0.94.7=A0=A0=A0 242= 93=0A=A0=A0=A0 =A0=A0=A0 =A0=A0=A0 =0AComputer2=A0=A0=A0 JDK 1.6=A0=A0=A0 0= .94.6.1=A0=A0=A0 24548=0AComputer2=A0=A0=A0 JDK 1.6=A0=A0=A0 0.94.7=A0=A0= =A0 22568=0A=0ADetails:=0AMachine 1 - JDK 1.7=0Ajmspaggi@hbasetest:~/hbase$= cat hbase-0.94.6.1/output.txt=A0 | grep=0AFinished | grep RandomWriteTest= =0A13/04/19 20:58:13 INFO hbase.PerformanceEvaluation: Finished class=0Aorg= .apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34481=0Aat of= fset 0 for 1048576 rows=0A13/04/19 21:00:06 INFO hbase.PerformanceEvaluatio= n: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWri= teTest in 35055=0Aat offset 0 for 1048576 rows=0A13/04/19 21:02:00 INFO hba= se.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.Performa= nceEvaluation$RandomWriteTest in 35890=0Aat offset 0 for 1048576 rows=0A13/= 04/19 21:03:52 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apach= e.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34207=0Aat offset 0= for 1048576 rows=0A13/04/19 21:05:42 INFO hbase.PerformanceEvaluation: Fin= ished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest= in 34898=0Aat offset 0 for 1048576 rows=0A13/04/19 21:07:36 INFO hbase.Per= formanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEva= luation$RandomWriteTest in 36355=0Aat offset 0 for 1048576 rows=0A13/04/19 = 21:09:28 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hado= op.hbase.PerformanceEvaluation$RandomWriteTest in 34613=0Aat offset 0 for 1= 048576 rows=0A13/04/19 21:11:22 INFO hbase.PerformanceEvaluation: Finished = class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34= 398=0Aat offset 0 for 1048576 rows=0A13/04/19 21:13:15 INFO hbase.Performan= ceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluatio= n$RandomWriteTest in 35092=0Aat offset 0 for 1048576 rows=0A13/04/19 21:15:= 08 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hba= se.PerformanceEvaluation$RandomWriteTest in 33852=0Aat offset 0 for 1048576= rows=0Ajmspaggi@hbasetest:~/hbase$ cat hbase-0.94.7/output.txt=A0 | grep= =0AFinished | grep RandomWriteTest=0A13/04/19 17:10:26 INFO hbase.Performan= ceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluatio= n$RandomWriteTest in 36443=0Aat offset 0 for 1048576 rows=0A13/04/19 17:12:= 21 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hba= se.PerformanceEvaluation$RandomWriteTest in 37071=0Aat offset 0 for 1048576= rows=0A13/04/19 17:14:17 INFO hbase.PerformanceEvaluation: Finished class= =0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37143= =0Aat offset 0 for 1048576 rows=0A13/04/19 17:16:11 INFO hbase.PerformanceE= valuation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$R= andomWriteTest in 37561=0Aat offset 0 for 1048576 rows=0A13/04/19 17:18:05 = INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.= PerformanceEvaluation$RandomWriteTest in 37082=0Aat offset 0 for 1048576 ro= ws=0A13/04/19 17:20:01 INFO hbase.PerformanceEvaluation: Finished class=0Ao= rg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36667=0Aat = offset 0 for 1048576 rows=0A13/04/19 17:21:55 INFO hbase.PerformanceEvaluat= ion: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomW= riteTest in 36580=0Aat offset 0 for 1048576 rows=0A13/04/19 17:23:48 INFO h= base.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.Perfor= manceEvaluation$RandomWriteTest in 36708=0Aat offset 0 for 1048576 rows=0A1= 3/04/19 17:25:42 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apa= che.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36773=0Aat offset= 0 for 1048576 rows=0A13/04/19 17:27:35 INFO hbase.PerformanceEvaluation: F= inished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTe= st in 37035=0Aat offset 0 for 1048576 rows=0A=0AMachine 1 - JDK 1.6=0Ajmspa= ggi@hbasetest:~/hbase$ cat hbase-0.94.6.1/output.txt=A0 | grep=0AFinished |= grep RandomWriteTest=0A13/04/20 08:24:03 INFO hbase.PerformanceEvaluation:= Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWrite= Test in 39531=0Aat offset 0 for 1048576 rows=0A13/04/20 08:26:01 INFO hbase= .PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.Performanc= eEvaluation$RandomWriteTest in 42207=0Aat offset 0 for 1048576 rows=0A13/04= /20 08:27:57 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.= hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 39840=0Aat offset 0 f= or 1048576 rows=0A13/04/20 08:29:53 INFO hbase.PerformanceEvaluation: Finis= hed class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest i= n 39202=0Aat offset 0 for 1048576 rows=0A13/04/20 08:31:50 INFO hbase.Perfo= rmanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvalu= ation$RandomWriteTest in 40973=0Aat offset 0 for 1048576 rows=0A13/04/20 08= :33:50 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop= .hbase.PerformanceEvaluation$RandomWriteTest in 40906=0Aat offset 0 for 104= 8576 rows=0A13/04/20 08:35:49 INFO hbase.PerformanceEvaluation: Finished cl= ass=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 3933= 3=0Aat offset 0 for 1048576 rows=0A13/04/20 08:37:44 INFO hbase.Performance= Evaluation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$= RandomWriteTest in 39185=0Aat offset 0 for 1048576 rows=0A13/04/20 08:39:41= INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase= .PerformanceEvaluation$RandomWriteTest in 39071=0Aat offset 0 for 1048576 r= ows=0A13/04/20 08:41:36 INFO hbase.PerformanceEvaluation: Finished class=0A= org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 38693=0Aat= offset 0 for 1048576 rows=0Ajmspaggi@hbasetest:~/hbase$ cat hbase-0.94.7/o= utput.txt=A0 | grep=0AFinished | grep RandomWriteTest=0A13/04/20 08:43:37 I= NFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.P= erformanceEvaluation$RandomWriteTest in 43526=0Aat offset 0 for 1048576 row= s=0A13/04/20 08:45:39 INFO hbase.PerformanceEvaluation: Finished class=0Aor= g.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 43593=0Aat o= ffset 0 for 1048576 rows=0A13/04/20 08:47:40 INFO hbase.PerformanceEvaluati= on: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWr= iteTest in 42576=0Aat offset 0 for 1048576 rows=0A13/04/20 08:49:39 INFO hb= ase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.Perform= anceEvaluation$RandomWriteTest in 43450=0Aat offset 0 for 1048576 rows=0A13= /04/20 08:51:41 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apac= he.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 43436=0Aat offset = 0 for 1048576 rows=0A13/04/20 08:53:44 INFO hbase.PerformanceEvaluation: Fi= nished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTes= t in 44171=0Aat offset 0 for 1048576 rows=0A13/04/20 08:55:44 INFO hbase.Pe= rformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEv= aluation$RandomWriteTest in 42831=0Aat offset 0 for 1048576 rows=0A13/04/20= 08:57:43 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.had= oop.hbase.PerformanceEvaluation$RandomWriteTest in 42931=0Aat offset 0 for = 1048576 rows=0A13/04/20 08:59:42 INFO hbase.PerformanceEvaluation: Finished= class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 4= 2686=0Aat offset 0 for 1048576 rows=0A13/04/20 09:01:40 INFO hbase.Performa= nceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluati= on$RandomWriteTest in 42879=0Aat offset 0 for 1048576 rows=0A=0A=0AMachine = 2 - JDK 1.6=0Ajmspaggi@buldo:~/foo$ cat hbase-0.94.6.1/output.txt=A0 | grep= Finished |=0Agrep RandomWriteTest=0A13/04/20 08:32:18 INFO hbase.Performan= ceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluatio= n$RandomWriteTest in 47083=0Aat offset 0 for 1048576 rows=0A13/04/20 08:34:= 18 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hba= se.PerformanceEvaluation$RandomWriteTest in 42673=0Aat offset 0 for 1048576= rows=0A13/04/20 08:36:19 INFO hbase.PerformanceEvaluation: Finished class= =0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 43062= =0Aat offset 0 for 1048576 rows=0A13/04/20 08:38:15 INFO hbase.PerformanceE= valuation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$R= andomWriteTest in 41960=0Aat offset 0 for 1048576 rows=0A13/04/20 08:40:15 = INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.= PerformanceEvaluation$RandomWriteTest in 42788=0Aat offset 0 for 1048576 ro= ws=0A13/04/20 08:42:13 INFO hbase.PerformanceEvaluation: Finished class=0Ao= rg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 42635=0Aat = offset 0 for 1048576 rows=0A13/04/20 08:44:13 INFO hbase.PerformanceEvaluat= ion: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomW= riteTest in 43223=0Aat offset 0 for 1048576 rows=0A13/04/20 08:46:10 INFO h= base.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.Perfor= manceEvaluation$RandomWriteTest in 42467=0Aat offset 0 for 1048576 rows=0A1= 3/04/20 08:48:07 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apa= che.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 42322=0Aat offset= 0 for 1048576 rows=0A13/04/20 08:50:02 INFO hbase.PerformanceEvaluation: F= inished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTe= st in 42570=0Aat offset 0 for 1048576 rows=0Ajmspaggi@buldo:~/foo$ cat hbas= e-0.94.7/output.txt=A0 | grep Finished |=0Agrep RandomWriteTest=0A13/04/20 = 08:52:04 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hado= op.hbase.PerformanceEvaluation$RandomWriteTest in 47490=0Aat offset 0 for 1= 048576 rows=0A13/04/20 08:54:02 INFO hbase.PerformanceEvaluation: Finished = class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 46= 620=0Aat offset 0 for 1048576 rows=0A13/04/20 08:56:04 INFO hbase.Performan= ceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluatio= n$RandomWriteTest in 46709=0Aat offset 0 for 1048576 rows=0A13/04/20 08:58:= 01 INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hba= se.PerformanceEvaluation$RandomWriteTest in 46191=0Aat offset 0 for 1048576= rows=0A13/04/20 09:00:01 INFO hbase.PerformanceEvaluation: Finished class= =0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 47665= =0Aat offset 0 for 1048576 rows=0A13/04/20 09:01:57 INFO hbase.PerformanceE= valuation: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$R= andomWriteTest in 45665=0Aat offset 0 for 1048576 rows=0A13/04/20 09:03:56 = INFO hbase.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.= PerformanceEvaluation$RandomWriteTest in 47238=0Aat offset 0 for 1048576 ro= ws=0A13/04/20 09:06:00 INFO hbase.PerformanceEvaluation: Finished class=0Ao= rg.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 46762=0Aat = offset 0 for 1048576 rows=0A13/04/20 09:07:56 INFO hbase.PerformanceEvaluat= ion: Finished class=0Aorg.apache.hadoop.hbase.PerformanceEvaluation$RandomW= riteTest in 45124=0Aat offset 0 for 1048576 rows=0A13/04/20 09:09:54 INFO h= base.PerformanceEvaluation: Finished class=0Aorg.apache.hadoop.hbase.Perfor= manceEvaluation$RandomWriteTest in 44909=0Aat offset 0 for 1048576 rows=0A= =0A=0A2013/4/20 Jean-Marc Spaggiari =0A>=0A> Hi La= rs,=0A>=0A> I just re-ran both of them again. Here are the results:=0A> jms= paggi@hbasetest:~/hbase$ cat hbase-0.94.6.1/output.txt=A0 | grep Finished |= grep RandomWriteTest=0A> 13/04/19 20:58:13 INFO hbase.PerformanceEvaluatio= n: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomWrite= Test in 34481ms at offset 0 for 1048576 rows=0A> 13/04/19 21:00:06 INFO hba= se.PerformanceEvaluation: Finished class org.apache.hadoop.hbase.Performanc= eEvaluation$RandomWriteTest in 35055ms at offset 0 for 1048576 rows=0A> 13/= 04/19 21:02:00 INFO hbase.PerformanceEvaluation: Finished class org.apache.= hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35890ms at offset 0 f= or 1048576 rows=0A> 13/04/19 21:03:52 INFO hbase.PerformanceEvaluation: Fin= ished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest i= n 34207ms at offset 0 for 1048576 rows=0A> 13/04/19 21:05:42 INFO hbase.Per= formanceEvaluation: Finished class org.apache.hadoop.hbase.PerformanceEvalu= ation$RandomWriteTest in 34898ms at offset 0 for 1048576 rows=0A> 13/04/19 = 21:07:36 INFO hbase.PerformanceEvaluation: Finished class org.apache.hadoop= .hbase.PerformanceEvaluation$RandomWriteTest in 36355ms at offset 0 for 104= 8576 rows=0A> 13/04/19 21:09:28 INFO hbase.PerformanceEvaluation: Finished = class org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 3461= 3ms at offset 0 for 1048576 rows=0A> 13/04/19 21:11:22 INFO hbase.Performan= ceEvaluation: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$= RandomWriteTest in 34398ms at offset 0 for 1048576 rows=0A> 13/04/19 21:13:= 15 INFO hbase.PerformanceEvaluation: Finished class org.apache.hadoop.hbase= .PerformanceEvaluation$RandomWriteTest in 35092ms at offset 0 for 1048576 r= ows=0A> 13/04/19 21:15:08 INFO hbase.PerformanceEvaluation: Finished class = org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 33852ms at= offset 0 for 1048576 rows=0A> jmspaggi@hbasetest:~/hbase$ cat hbase-0.94.7= /output.txt=A0 | grep Finished | grep RandomWriteTest=0A> 13/04/19 17:10:26= INFO hbase.PerformanceEvaluation: Finished class org.apache.hadoop.hbase.P= erformanceEvaluation$RandomWriteTest in 36443ms at offset 0 for 1048576 row= s=0A> 13/04/19 17:12:21 INFO hbase.PerformanceEvaluation: Finished class or= g.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37071ms at o= ffset 0 for 1048576 rows=0A> 13/04/19 17:14:17 INFO hbase.PerformanceEvalua= tion: Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomWr= iteTest in 37143ms at offset 0 for 1048576 rows=0A> 13/04/19 17:16:11 INFO = hbase.PerformanceEvaluation: Finished class org.apache.hadoop.hbase.Perform= anceEvaluation$RandomWriteTest in 37561ms at offset 0 for 1048576 rows=0A> = 13/04/19 17:18:05 INFO hbase.PerformanceEvaluation: Finished class org.apac= he.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37082ms at offset = 0 for 1048576 rows=0A> 13/04/19 17:20:01 INFO hbase.PerformanceEvaluation: = Finished class org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTes= t in 36667ms at offset 0 for 1048576 rows=0A> 13/04/19 17:21:55 INFO hbase.= PerformanceEvaluation: Finished class org.apache.hadoop.hbase.PerformanceEv= aluation$RandomWriteTest in 36580ms at offset 0 for 1048576 rows=0A> 13/04/= 19 17:23:48 INFO hbase.PerformanceEvaluation: Finished class org.apache.had= oop.hbase.PerformanceEvaluation$RandomWriteTest in 36708ms at offset 0 for = 1048576 rows=0A> 13/04/19 17:25:42 INFO hbase.PerformanceEvaluation: Finish= ed class org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 3= 6773ms at offset 0 for 1048576 rows=0A> 13/04/19 17:27:35 INFO hbase.Perfor= manceEvaluation: Finished class org.apache.hadoop.hbase.PerformanceEvaluati= on$RandomWriteTest in 37035ms at offset 0 for 1048576 rows=0A>=0A> I copied= the log4j config from one to the other one to make sure they are logging t= he same thing. They are both ran on a single node standalone dedicated comp= uter. Here is the command line I used:=0A> echo Test starting for randomWri= te=0A> for i in {1..10}; do echo; echo -n $i ; rm -rf /tmp/*; bin/start-hba= se.sh; sleep 60; bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation ra= ndomWrite 1; bin/stop-hbase.sh; done &>> output.txt=0A>=0A> Computer is a 4= cores 4.2Ghz 16G with 60GB regular SATA-I hard drive.=0A>=0A> I will re-ru= n the tests on another computer with different specs to figure if the hard = drive is impacting the results.=0A>=0A> But so far, 0.94.7 is still slower = for me.=0A>=0A> JM=0A>=0A>=0A> 2013/4/19 lars hofhansl = =0A>>=0A>> Thanks JM.=0A>>=0A>> I ran PE locally, and between 0.94.6.1 and = 0.94.7 I do not see any systematic slowdown for the random write test.=0A>>= In fact I had the fastest run in 0.94.7 (32.6s) and the slowest one in 0.9= 4.6.1 (39.5s).=0A>>=0A>> Variance of that test is very high (both in 0.94.6= .1 and 0.94.7).=0A>>=0A>>=0A>> My test setup is single node install of HBas= e/Hadoop/ZK.=0A>>=0A>> -- Lars=0A>>=0A>>=0A>>=0A>> ________________________= ________=0A>>=A0 From: Jean-Marc Spaggiari =0A>> T= o: dev@hbase.apache.org; lars hofhansl =0A>> Sent: Thursd= ay, April 18, 2013 8:13 AM=0A>> Subject: Re: [VOTE] The 1st hbase 0.94.7 re= lease candidate is available for download=0A>>=0A>>=0A>> Here is the Perfor= manceEvaluation comparison report:=0A>> http://www.spaggiari.org/media/blog= s/hbase/pdf/performances_20130418.pdf=0A>>=0A>> Summary:=0A>> - Filtered sc= an performances and sequential reads are consistant with=0A>> previous 0.94= releases;=0A>> - Scan range are about 3% slower;=0A>> - Random read are 7%= faster;=0A>> - But random writes are 7% slower.=0A>>=0A>>=0A>> Basically, = here is what I did:=0A>> - Downloaded the file, checked signature for both = security and "regular"=0A>> distribution. Both fine.=0A>> - Decompressed re= gular distribution and checked the CHANGES.txt and=0A>> documentation conte= nt (few random pages).=0A>> - Ran it in standalone; checked the UI, the log= s and ran all performance=0A>> evaluation scenarios.=0A>> - Ran HBCK few ti= mes before and after.=0A>> - Ran IntegrationTestLoadAndVerify (ROWS_WRITTEN= =3D0;=0A>> REFERENCES_CHECKED=3D9855322). Not sure how to validate the resu= lts but I=0A>> will have expected REFERENCES_CHECKED to be 10000000.=0A>> -= Ran IntegrationTestBigLinkedList (REFERENCED=3D6000000), sound right based= =0A>> on the command line (Loop 2 1 3000000)=0A>> - Ran the test suite (org= .apache.hadoop.hbase.catalog.TestMetaReaderEditor=0A>> failed the first tim= e, I re-ran alone it and it passed. Re-ran the entire=0A>> test suite, fail= ed at the same place.)=0A>>=0A>>=0A>> - Deployed it on 9 servers (8 RS, 1 m= aster) and did a rolling-restart.=0A>> - Checked the logs, status, UI;=0A>>= - Changed balancer to default balancer, stop hbase, merged all regions int= o=0A>> a single one, restarted;=0A>> - Checked HBCK, table status, logs, ta= ble regions (should have ony one),=0A>> etc.=0A>> - Ran major compaction on= the small table from the shell, ran balancer,=0A>> checked the logs, check= ed the splits.=0A>> - Stopped the cluster, restored custom balancer, restar= ted, rebalanced,=0A>> checked transitions and logs.=0A>> - From shell, crea= ted a table; did few put, scan on the new and existing=0A>> tables, dropped= table;=0A>> - Ran few different MR Job overnight, checked the results and = logs.=0A>> - Ran IntegrationTestLoadAndVerify (ROWS_WRITTEN=3D0;=0A>> REFER= ENCES_CHECKED=3D9855185). Not sure how to validate the results but I=0A>> w= ill have expected REFERENCES_CHECKED to be 10000000.=0A>> - Ran Integration= TestBigLinkedList (REFERENCED=3D6000000), sound right based=0A>> on the com= mand line (Loop 2 1 3000000)=0A>>=0A>> Overall, +1 for me. All the comments= are in the Google Spreadsheet.=0A>>=0A>> But I think we should take a look= at the random writes performances=0A>> degradation and to IntegrationTestL= oadAnVerify results.=0A>>=0A>> JM=0A>>=0A>>=0A>> 2013/4/17 lars hofhansl =0A>>=0A>> > The 1st 0.94.7 RC is available for download at= =0A>> > http://people.apache.org/~larsh/hbase-0.94.7-rc0/=0A>> >=0A>> > Sig= ned with my code signing key: C7CFE328=0A>> >=0A>> > This RC has 71 issues = resolved against it, contributed by 27 individuals.=0A>> > 0.94.7 is primar= ily a bug fix release. Notable exceptions include:=0A>> > HBASE-8176 Dynami= c Schema Configurations=0A>> > HBASE-7801 Allow a deferred sync option per = Mutation=0A>> >=0A>> > The full list of changes is available here:=0A>> > h= ttps://issues.apache.org/jira/browse/HBASE/fixforversion/12324039=0A>> >=0A= >> > Please try out the RC, check out the doc, take it for a spin, etc, and= =0A>> > vote +1/-1 by April 24th on whether we should release this as 0.94.= 7.=0A>> >=0A>> > The release testing spreadsheet is available here:=0A>> >= =0A>> > https://docs.google.com/spreadsheet/ccc?key=3D0AvLqcVIqNtlTdG9jbVNm= WmhyeGJZeUo4MUdIMEEweEE#gid=3D0=0A>> >=0A>> > Thanks.=0A>> >=0A>> > -- Lars= =0A>=0A> --1023258982-1762147109-1366501039=:2759--