Return-Path: 
 <users-return-17661-apmail-activemq-users-archive=activemq.apache.org@activemq.apache.org>
Delivered-To: apmail-activemq-users-archive@www.apache.org
Received: (qmail 6200 invoked from network); 22 Jan 2009 10:33:22 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2)
  by minotaur.apache.org with SMTP; 22 Jan 2009 10:33:22 -0000
Received: (qmail 8408 invoked by uid 500); 22 Jan 2009 10:33:20 -0000
Delivered-To: apmail-activemq-users-archive@activemq.apache.org
Received: (qmail 8390 invoked by uid 500); 22 Jan 2009 10:33:20 -0000
Mailing-List: contact users-help@activemq.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:users-help@activemq.apache.org>
List-Unsubscribe: <mailto:users-unsubscribe@activemq.apache.org>
List-Post: <mailto:users@activemq.apache.org>
List-Id: <users.activemq.apache.org>
Reply-To: users@activemq.apache.org
Delivered-To: mailing list users@activemq.apache.org
Received: (qmail 8379 invoked by uid 99); 22 Jan 2009 10:33:20 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Jan 2009 02:33:20 -0800
X-ASF-Spam-Status: No, hits=2.6 required=10.0
	tests=DNS_FROM_OPENWHOIS,SPF_HELO_PASS,SPF_PASS,WHOIS_MYPRIVREG
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of lists@nabble.com designates
 216.139.236.158 as permitted sender)
Received: from [216.139.236.158] (HELO kuber.nabble.com) (216.139.236.158)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Jan 2009 10:33:11 +0000
Received: from isper.nabble.com ([192.168.236.156])
	by kuber.nabble.com with esmtp (Exim 4.63)
	(envelope-from <lists@nabble.com>)
	id 1LPwri-0006rK-Sv
	for users@activemq.apache.org; Thu, 22 Jan 2009 02:32:50 -0800
Message-ID: <21601585.post@talk.nabble.com>
Date: Thu, 22 Jan 2009 02:32:50 -0800 (PST)
From: Cybexion <cybexion@email.de>
To: users@activemq.apache.org
Subject: Performance in relation to queue size
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Nabble-From: cybexion@email.de
X-Virus-Checked: Checked by ClamAV on apache.org


Hi,

I have a queue that should hold up to 30 GB of small persistent messages:
 <systemUsage sendFailIfNoSpace=3D"true">
                <memoryUsage>
                    <memoryUsage limit=3D"1gb"/>
                </memoryUsage>
                <storeUsage>
                    <storeUsage limit=3D"30gb" store=3D"#store"/>
                </storeUsage>

The queue consists of 10 MB files and are specified like this:
       <bean id=3D"store"
class=3D"org.apache.activemq.store.amq.AMQPersistenceAdapter">
                <property name=3D"directory" value=3D"${activemq.base}/data=
"/>
                <property name=3D"maxFileLength" value=3D"10000000"/>
                <property name=3D"checkpointInterval" value=3D"60000"/>
                <property name=3D"cleanupInterval" value=3D"30000"/>
                <property name=3D"persistentIndex" value=3D"true"/>
        </bean>

This night I made a test with lots of produceds an just 5 consumer. I wante=
d
to fill the queue to its limit.=20
Well, so far I managed to send 18 Million messages into the queue. I have 2=
0
% Store usage so far.=20
What I noticed is, that mostly the messages are send within 0-20
milliseconds. However sometimes I have a lot of messages which take 10+
seconds to be send. This is not good in my scenario. I need a producer that
should be very very fast in sending the messages.=20
Question now:
Could it be that the number of data files or the size of the datafiles has
impact on the performance?
Would it be better to have one queue big file with 30GB of size instead of
hundreds of files having 1 MB?

The key index ist persistent. I tested this and it seems to be the only way
of NOT getting an out of memory error.
Does it make sense to change the indexkeysize or the indexpagesize in the
store? Would this maybe gice additional constant performance?

Btw:=20
I'm using AMQ 5.2

Thanks and best regards

J=C3=B6rg
=20


=20


--=20
View this message in context: http://www.nabble.com/Performance-in-relation=
-to-queue-size-tp21601585p21601585.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.