activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rob Davies <rajdav...@gmail.com>
Subject Re: OOM with high KahaDB index time
Date Wed, 17 Feb 2010 11:18:31 GMT
ok - it looks like you might need to tune KahaDB - set the  
indexCacheSize = 1000 - see http://activemq.apache.org/kahadb.html

cheers,

Rob
On 15 Feb 2010, at 18:46, rideallday wrote:

>
> Yes, topics are durable.
>
> Test case:
> 1. publish messages to queue, let several hundred thousand accumulate.
> 2. publish topics to queue, let several hundred thousand accumulate
> 3. begin consuming from queue.
> 4. begin consuming from topic.
>
> You should see a huge degrade in performance and a bunch of indexing
> messages once you start to consume from topic.
>
>
>
>
> rajdavies wrote:
>>
>> could you provide a test case ?
>>
>> cheers,
>>
>> Rob
>> On 11 Feb 2010, at 21:41, rideallday wrote:
>>
>>>
>>> Umm, actually I'm still seeing issues with high Index times for
>>> topics.
>>>
>>> My test case is:
>>>
>>> Send a huge amount of messages into the broker. Let several hundred
>>> thousand
>>> accumulate. Then start consumers and see how long it takes to drain
>>> the
>>> queues and topics.
>>>
>>> The result is:
>>>
>>> For queues- excellent. Performance is amazing. A few 1000ms Journal
>>> append
>>> messages, but recovery performance exceeds my requirements.
>>> For topics- Index updates in the 2-700ms range. This happens every
>>> second or
>>> so and locks the consumer, so recovery is extremely slow.
>>>
>>> This is very similar behaviour to what I saw with Topics and Queues
>>> before
>>> Rob applied the fix for cursors in KahaDB.
>>>
>>> Is it possible that the fix needs to be also applied to topics?
>>>
>>> I'm using 5.4 snapshot from Feb 1.
>>> -- 
>>> View this message in context:
>>> http://old.nabble.com/OOM-with-high-KahaDB-index-time-tp27217704p27555173.html
>>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>>
>>
>> Rob Davies
>> http://twitter.com/rajdavies
>> I work here: http://fusesource.com
>> My Blog: http://rajdavies.blogspot.com/
>> I'm writing this: http://www.manning.com/snyder/
>>
>>
>>
>>
>>
>>
>>
>
> -- 
> View this message in context: http://old.nabble.com/OOM-with-high-KahaDB-index-time-tp27217704p27598149.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>

Rob Davies
http://twitter.com/rajdavies
I work here: http://fusesource.com
My Blog: http://rajdavies.blogspot.com/
I'm writing this: http://www.manning.com/snyder/






Mime
View raw message