activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cybexion <cybex...@email.de>
Subject Performance in relation to queue size
Date Thu, 22 Jan 2009 10:32:50 GMT

Hi,

I have a queue that should hold up to 30 GB of small persistent messages:
 <systemUsage sendFailIfNoSpace="true">
                <memoryUsage>
                    <memoryUsage limit="1gb"/>
                </memoryUsage>
                <storeUsage>
                    <storeUsage limit="30gb" store="#store"/>
                </storeUsage>

The queue consists of 10 MB files and are specified like this:
       <bean id="store"
class="org.apache.activemq.store.amq.AMQPersistenceAdapter">
                <property name="directory" value="${activemq.base}/data"/>
                <property name="maxFileLength" value="10000000"/>
                <property name="checkpointInterval" value="60000"/>
                <property name="cleanupInterval" value="30000"/>
                <property name="persistentIndex" value="true"/>
        </bean>

This night I made a test with lots of produceds an just 5 consumer. I wanted
to fill the queue to its limit. 
Well, so far I managed to send 18 Million messages into the queue. I have 20
% Store usage so far. 
What I noticed is, that mostly the messages are send within 0-20
milliseconds. However sometimes I have a lot of messages which take 10+
seconds to be send. This is not good in my scenario. I need a producer that
should be very very fast in sending the messages. 
Question now:
Could it be that the number of data files or the size of the datafiles has
impact on the performance?
Would it be better to have one queue big file with 30GB of size instead of
hundreds of files having 1 MB?

The key index ist persistent. I tested this and it seems to be the only way
of NOT getting an out of memory error.
Does it make sense to change the indexkeysize or the indexpagesize in the
store? Would this maybe gice additional constant performance?

Btw: 
I'm using AMQ 5.2

Thanks and best regards

Jörg
 


 


-- 
View this message in context: http://www.nabble.com/Performance-in-relation-to-queue-size-tp21601585p21601585.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.


Mime
View raw message