hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Marc Spaggiari <jean-m...@spaggiari.org>
Subject Re: [VOTE] The 1st hbase 0.94.7 release candidate is available for download
Date Sat, 20 Apr 2013 12:06:29 GMT
Hi Lars,

I just re-ran both of them again. Here are the results:
jmspaggi@hbasetest:~/hbase$ cat hbase-0.94.6.1/output.txt  | grep Finished
| grep RandomWriteTest
13/04/19 20:58:13 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34481ms at
offset 0 for 1048576 rows
13/04/19 21:00:06 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35055ms at
offset 0 for 1048576 rows
13/04/19 21:02:00 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35890ms at
offset 0 for 1048576 rows
13/04/19 21:03:52 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34207ms at
offset 0 for 1048576 rows
13/04/19 21:05:42 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34898ms at
offset 0 for 1048576 rows
13/04/19 21:07:36 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36355ms at
offset 0 for 1048576 rows
13/04/19 21:09:28 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34613ms at
offset 0 for 1048576 rows
13/04/19 21:11:22 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 34398ms at
offset 0 for 1048576 rows
13/04/19 21:13:15 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 35092ms at
offset 0 for 1048576 rows
13/04/19 21:15:08 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 33852ms at
offset 0 for 1048576 rows
jmspaggi@hbasetest:~/hbase$ cat hbase-0.94.7/output.txt  | grep Finished |
grep RandomWriteTest
13/04/19 17:10:26 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36443ms at
offset 0 for 1048576 rows
13/04/19 17:12:21 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37071ms at
offset 0 for 1048576 rows
13/04/19 17:14:17 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37143ms at
offset 0 for 1048576 rows
13/04/19 17:16:11 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37561ms at
offset 0 for 1048576 rows
13/04/19 17:18:05 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37082ms at
offset 0 for 1048576 rows
13/04/19 17:20:01 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36667ms at
offset 0 for 1048576 rows
13/04/19 17:21:55 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36580ms at
offset 0 for 1048576 rows
13/04/19 17:23:48 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36708ms at
offset 0 for 1048576 rows
13/04/19 17:25:42 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 36773ms at
offset 0 for 1048576 rows
13/04/19 17:27:35 INFO hbase.PerformanceEvaluation: Finished class
org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest in 37035ms at
offset 0 for 1048576 rows

I copied the log4j config from one to the other one to make sure they are
logging the same thing. They are both ran on a single node standalone
dedicated computer. Here is the command line I used:
echo Test starting for randomWrite
for i in {1..10}; do echo; echo -n $i ; rm -rf /tmp/*; bin/start-hbase.sh;
sleep 60; bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation
randomWrite 1; bin/stop-hbase.sh; done &>> output.txt

Computer is a 4 cores 4.2Ghz 16G with 60GB regular SATA-I hard drive.

I will re-run the tests on another computer with different specs to figure
if the hard drive is impacting the results.

But so far, 0.94.7 is still slower for me.

JM

2013/4/19 lars hofhansl <larsh@apache.org>

> Thanks JM.
>
> I ran PE locally, and between 0.94.6.1 and 0.94.7 I do not see any
> systematic slowdown for the random write test.
> In fact I had the fastest run in 0.94.7 (32.6s) and the slowest one in
> 0.94.6.1 (39.5s).
>
> Variance of that test is very high (both in 0.94.6.1 and 0.94.7).
>
>
> My test setup is single node install of HBase/Hadoop/ZK.
>
> -- Lars
>
>
>
> ________________________________
>  From: Jean-Marc Spaggiari <jean-marc@spaggiari.org>
> To: dev@hbase.apache.org; lars hofhansl <larsh@apache.org>
> Sent: Thursday, April 18, 2013 8:13 AM
> Subject: Re: [VOTE] The 1st hbase 0.94.7 release candidate is available
> for download
>
>
> Here is the PerformanceEvaluation comparison report:
> http://www.spaggiari.org/media/blogs/hbase/pdf/performances_20130418.pdf
>
> Summary:
> - Filtered scan performances and sequential reads are consistant with
> previous 0.94 releases;
> - Scan range are about 3% slower;
> - Random read are 7% faster;
> - But random writes are 7% slower.
>
>
> Basically, here is what I did:
> - Downloaded the file, checked signature for both security and "regular"
> distribution. Both fine.
> - Decompressed regular distribution and checked the CHANGES.txt and
> documentation content (few random pages).
> - Ran it in standalone; checked the UI, the logs and ran all performance
> evaluation scenarios.
> - Ran HBCK few times before and after.
> - Ran IntegrationTestLoadAndVerify (ROWS_WRITTEN=0;
> REFERENCES_CHECKED=9855322). Not sure how to validate the results but I
> will have expected REFERENCES_CHECKED to be 10000000.
> - Ran IntegrationTestBigLinkedList (REFERENCED=6000000), sound right based
> on the command line (Loop 2 1 3000000)
> - Ran the test suite (org.apache.hadoop.hbase.catalog.TestMetaReaderEditor
> failed the first time, I re-ran alone it and it passed. Re-ran the entire
> test suite, failed at the same place.)
>
>
> - Deployed it on 9 servers (8 RS, 1 master) and did a rolling-restart.
> - Checked the logs, status, UI;
> - Changed balancer to default balancer, stop hbase, merged all regions into
> a single one, restarted;
> - Checked HBCK, table status, logs, table regions (should have ony one),
> etc.
> - Ran major compaction on the small table from the shell, ran balancer,
> checked the logs, checked the splits.
> - Stopped the cluster, restored custom balancer, restarted, rebalanced,
> checked transitions and logs.
> - From shell, created a table; did few put, scan on the new and existing
> tables, dropped table;
> - Ran few different MR Job overnight, checked the results and logs.
> - Ran IntegrationTestLoadAndVerify (ROWS_WRITTEN=0;
> REFERENCES_CHECKED=9855185). Not sure how to validate the results but I
> will have expected REFERENCES_CHECKED to be 10000000.
> - Ran IntegrationTestBigLinkedList (REFERENCED=6000000), sound right based
> on the command line (Loop 2 1 3000000)
>
> Overall, +1 for me. All the comments are in the Google Spreadsheet.
>
> But I think we should take a look at the random writes performances
> degradation and to IntegrationTestLoadAnVerify results.
>
> JM
>
>
> 2013/4/17 lars hofhansl <larsh@apache.org>
>
> > The 1st 0.94.7 RC is available for download at
> > http://people.apache.org/~larsh/hbase-0.94.7-rc0/
> >
> > Signed with my code signing key: C7CFE328
> >
> > This RC has 71 issues resolved against it, contributed by 27 individuals.
> > 0.94.7 is primarily a bug fix release. Notable exceptions include:
> > HBASE-8176 Dynamic Schema Configurations
> > HBASE-7801 Allow a deferred sync option per Mutation
> >
> > The full list of changes is available here:
> > https://issues.apache.org/jira/browse/HBASE/fixforversion/12324039
> >
> > Please try out the RC, check out the doc, take it for a spin, etc, and
> > vote +1/-1 by April 24th on whether we should release this as 0.94.7.
> >
> > The release testing spreadsheet is available here:
> >
> >
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdG9jbVNmWmhyeGJZeUo4MUdIMEEweEE#gid=0
> >
> > Thanks.
> >
> > -- Lars
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message