activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vanyatka <ibalas...@gmail.com>
Subject Re: Poort ActiveMQ Persistence Performance
Date Mon, 21 Apr 2008 09:59:03 GMT

Thanks, Rob

I'll try to play with those parameters, here is what I got so far:

 <persistenceAdapter>
          <amqPersistenceAdapter 
	    directory="activemq-data" 
	    maxFileLength="32mb"
	    indexBinSize="8192"
	    indexPageSize="128kb"
	    />
    </persistenceAdapter>

1000 msgs for 1282 msec. 780.0 msgs p/sec
2000 msgs for 2391 msec. 836.0 msgs p/sec
3000 msgs for 3844 msec. 780.0 msgs p/sec
4000 msgs for 4875 msec. 820.0 msgs p/sec
5000 msgs for 7016 msec. 712.0 msgs p/sec
6000 msgs for 9125 msec. 657.0 msgs p/sec
7000 msgs for 11438 msec. 611.0 msgs p/sec
8000 msgs for 13485 msec. 593.0 msgs p/sec
9000 msgs for 16235 msec. 554.0 msgs p/sec
10000 msgs for 19157 msec. 522.0 msgs p/sec
11000 msgs for 21907 msec. 502.0 msgs p/sec
12000 msgs for 24782 msec. 484.0 msgs p/sec
13000 msgs for 28391 msec. 457.0 msgs p/sec
14000 msgs for 29969 msec. 467.0 msgs p/sec
15000 msgs for 34969 msec. 428.0 msgs p/sec
16000 msgs for 35844 msec. 446.0 msgs p/sec
17000 msgs for 37703 msec. 450.0 msgs p/sec
18000 msgs for 40907 msec. 440.0 msgs p/sec
19000 msgs for 44532 msec. 426.0 msgs p/sec
20000 msgs for 48282 msec. 414.0 msgs p/sec
21000 msgs for 51797 msec. 405.0 msgs p/sec
22000 msgs for 56235 msec. 391.0 msgs p/sec
23000 msgs for 59985 msec. 383.0 msgs p/sec
24000 msgs for 65578 msec. 365.0 msgs p/sec
25000 msgs for 66485 msec. 376.0 msgs p/sec
26000 msgs for 69172 msec. 375.0 msgs p/sec
27000 msgs for 74172 msec. 364.0 msgs p/sec
28000 msgs for 77516 msec. 361.0 msgs p/sec
29000 msgs for 81594 msec. 355.0 msgs p/sec
30000 msgs for 86891 msec. 345.0 msgs p/sec




rajdavies wrote:
> 
> 
> I'd recommend looking at the AMQStore documentation  -
> http://activemq.apache.org/amq-message-store.html
> parameters to look at increasing would be the indexPageSize and  
> particularly the indexBinSize - as I suspect the bottle neck is the  
> persistent index.
> 
> cheers,
> 
> Rob
> 
> On 20 Apr 2008, at 19:53, vanyatka wrote:
> 
>>
>>
>> Hi, Rob
>>
>> I've been doing some testing with ActiveMQ 5.1, making it receive  
>> messages
>> as fast as possible. What I noticed was a steady slow down as the  
>> messages
>> kept coming to AMQ. I have to mention here that I intentionally didn't
>> consume messages from the queue (so it kept growing) to see the  
>> storage
>> capacity of AMQ.
>>
>> Below are partial results of sending messages over 100MB network using
>> OpenWire to AMQ 5.1 running on FreeBSD.
>>
>> The trend of performance decrease suggests a possible bottleneck in  
>> the
>> persistence module (which was Kaha by default). Obviously, I cannot  
>> assert
>> this for sure.
>>
>> Even though Kaha is supposed to be the fastest storage mechanism  
>> supplied
>> with AMQ, are there any configuration options to fine-tune it for  
>> heavy
>> loads?
>>
>> This is a part of the more broad issue "how to make AMQ accept more  
>> messages
>> per unit of time, thus reduce number of nodes in a cluster".
>>
>> 1000 msgs for 1516 msec. 659.0 msgs p/sec
>> 2000 msgs for 2579 msec. 775.0 msgs p/sec
>> 3000 msgs for 3657 msec. 820.0 msgs p/sec
>> 4000 msgs for 4735 msec. 844.0 msgs p/sec
>> 5000 msgs for 5875 msec. 851.0 msgs p/sec
>> 6000 msgs for 8032 msec. 747.0 msgs p/sec
>> 7000 msgs for 9110 msec. 768.0 msgs p/sec
>> 8000 msgs for 10204 msec. 784.0 msgs p/sec
>> 9000 msgs for 11360 msec. 792.0 msgs p/sec
>> 10000 msgs for 12454 msec. 802.0 msgs p/sec
>> 11000 msgs for 13579 msec. 810.0 msgs p/sec
>> 12000 msgs for 14688 msec. 816.0 msgs p/sec
>> 13000 msgs for 15875 msec. 818.0 msgs p/sec
>> 14000 msgs for 17282 msec. 810.0 msgs p/sec
>> 15000 msgs for 18500 msec. 810.0 msgs p/sec
>> 16000 msgs for 19735 msec. 810.0 msgs p/sec
>> 17000 msgs for 20922 msec. 812.0 msgs p/sec
>> 18000 msgs for 22172 msec. 811.0 msgs p/sec
>> 19000 msgs for 23391 msec. 812.0 msgs p/sec
>> 20000 msgs for 24750 msec. 808.0 msgs p/sec
>> 21000 msgs for 25954 msec. 809.0 msgs p/sec
>> 22000 msgs for 28125 msec. 782.0 msgs p/sec
>> 23000 msgs for 29282 msec. 785.0 msgs p/sec
>> 24000 msgs for 30750 msec. 780.0 msgs p/sec
>> 25000 msgs for 31969 msec. 782.0 msgs p/sec
>> 26000 msgs for 33172 msec. 783.0 msgs p/sec
>> 27000 msgs for 34454 msec. 783.0 msgs p/sec
>> 28000 msgs for 35875 msec. 780.0 msgs p/sec
>> 29000 msgs for 37235 msec. 778.0 msgs p/sec
>> 30000 msgs for 39875 msec. 752.0 msgs p/sec
>> 31000 msgs for 41250 msec. 751.0 msgs p/sec
>> 32000 msgs for 42547 msec. 752.0 msgs p/sec
>> 33000 msgs for 43813 msec. 753.0 msgs p/sec
>> 34000 msgs for 45297 msec. 750.0 msgs p/sec
>> 35000 msgs for 46610 msec. 750.0 msgs p/sec
>> 36000 msgs for 48329 msec. 744.0 msgs p/sec
>> 37000 msgs for 49672 msec. 744.0 msgs p/sec
>> 38000 msgs for 51000 msec. 745.0 msgs p/sec
>> 39000 msgs for 52688 msec. 740.0 msgs p/sec
>> 40000 msgs for 54422 msec. 734.0 msgs p/sec
>> 41000 msgs for 56047 msec. 731.0 msgs p/sec
>> 42000 msgs for 57391 msec. 731.0 msgs p/sec
>> 43000 msgs for 60719 msec. 708.0 msgs p/sec
>> 44000 msgs for 61907 msec. 710.0 msgs p/sec
>> 45000 msgs for 63422 msec. 709.0 msgs p/sec
>> 46000 msgs for 64766 msec. 710.0 msgs p/sec
>> 47000 msgs for 66360 msec. 708.0 msgs p/sec
>> 48000 msgs for 67813 msec. 707.0 msgs p/sec
>> 49000 msgs for 71563 msec. 684.0 msgs p/sec
>> 50000 msgs for 72750 msec. 687.0 msgs p/sec
>> 51000 msgs for 74204 msec. 687.0 msgs p/sec
>> 52000 msgs for 75704 msec. 686.0 msgs p/sec
>> 53000 msgs for 77266 msec. 685.0 msgs p/sec
>> 54000 msgs for 78563 msec. 687.0 msgs p/sec
>> 55000 msgs for 80125 msec. 686.0 msgs p/sec
>> 56000 msgs for 82016 msec. 682.0 msgs p/sec
>> 57000 msgs for 83500 msec. 682.0 msgs p/sec
>> 58000 msgs for 85047 msec. 681.0 msgs p/sec
>> 59000 msgs for 86516 msec. 681.0 msgs p/sec
>> 60000 msgs for 90422 msec. 663.0 msgs p/sec
>> 61000 msgs for 91641 msec. 665.0 msgs p/sec
>> 62000 msgs for 93032 msec. 666.0 msgs p/sec
>> 63000 msgs for 94579 msec. 666.0 msgs p/sec
>> 64000 msgs for 95782 msec. 668.0 msgs p/sec
>>
>>
>> rajdavies wrote:
>>>
>>>
>>> So long story short - use the default message store (AMQ) in  
>>> version 5!
>>>
>>>
>>
>> -- 
>> View this message in context:
>> http://www.nabble.com/Poort-ActiveMQ-Persistence-Performance-tp12945570s2354p16797097.html
>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>
> 
> 
> 

-- 
View this message in context: http://www.nabble.com/Poort-ActiveMQ-Persistence-Performance-tp12945570s2354p16806479.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.


Mime
View raw message