Mailing-List: contact users-help@activemq.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@activemq.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Message-Id: <CFB9F5D1-AAAA-48B6-8AD4-C865B7E7707D@comware.com.au>
From: Jim Alateras <jima@comware.com.au>
To: users@activemq.apache.org
Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes
Content-Transfer-Encoding: 7bit
Mime-Version: 1.0 (Apple Message framework v929.2)
Subject: Large number of messages in the queue
Date: Wed, 18 Mar 2009 00:21:29 +1100

I have around 60K messages in one of my queues that I want to process.  
The problem is that after around 10 minutes I get an  
OutOfMemoryError.  I get a  number of exceptions such as

2009-03-17 23:37:29,354 [VMTransport] ERROR - Failed to page in more  
queue messages
java.lang.OutOfMemoryError: Java heap space


or

java.lang.OutOfMemoryError: Java heap space
	at  
java 
.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java: 
99)
	at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java: 
393)
	at java.lang.StringBuffer.append(StringBuffer.java:225)
	at java.io.StringWriter.write(StringWriter.java:90)
	at java.io.PrintWriter.write(PrintWriter.java:384)
	at java.io.PrintWriter.write(PrintWriter.java:401)
	at java.io.PrintWriter.print(PrintWriter.java:532)
	at java.io.PrintWriter.println(PrintWriter.java:669)
	at java.lang.Throwable.printStackTrace(Throwable.java:513)
	at  
org 
.apache 
.derby.iapi.services.context.ErrorStringBuilder.stackTrace(Unknown  
Source)
	at  
org 
.apache 
.derby.iapi.services.context.ContextManager.cleanupOnError(Unknown  
Source)
	at  
org 
.apache 
.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source)
	at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown  
Source)
	at org.apache.derby.impl.jdbc.ConnectionChild.handleException(Unknown  
Source)
	at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown  
Source)
	at  
org 
.apache 
.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(Unknown Source)
	at  
org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeQuery(Unknown  
Source)
	at  
org 
.apache 
.commons 
.dbcp 
.DelegatingPreparedStatement 
.executeQuery(DelegatingPreparedStatement.java:92)
	at  
org 
.apache 
.activemq 
.store 
.jdbc 
.adapter 
.DefaultJDBCAdapter.doRecoverNextMessages(DefaultJDBCAdapter.java:724)
	at  
org 
.apache 
.activemq 
.store.jdbc.JDBCMessageStore.recoverNextMessages(JDBCMessageStore.java: 
214)
	at  
org 
.apache 
.activemq 
.store.ProxyMessageStore.recoverNextMessages(ProxyMessageStore.java:87)
	at  
org 
.apache 
.activemq 
.broker 
.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java: 
84)
	at  
org 
.apache 
.activemq 
.broker 
.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java: 
236)
	at  
org 
.apache 
.activemq 
.broker 
.region.cursors.AbstractStoreCursor.hasNext(AbstractStoreCursor.java: 
136)
	at  
org 
.apache 
.activemq 
.broker.region.cursors.StoreQueueCursor.hasNext(StoreQueueCursor.java: 
131)
	at org.apache.activemq.broker.region.Queue.doPageIn(Queue.java:1252)
	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java: 
1391)
	at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1075)
	at  
org 
.apache 
.activemq 
.thread.DeterministicTaskRunner.runTask(DeterministicTaskRunner.java:84)
	at org.apache.activemq.thread.DeterministicTaskRunner 
$1.run(DeterministicTaskRunner.java:41)
	at java.util.concurrent.ThreadPoolExecutor 
$Worker.runTask(ThreadPoolExecutor.java:650)
	at java.util.concurrent.ThreadPoolExecutor 
$Worker.run(ThreadPoolExecutor.java:675)


depending on my configuration. What is see is that the inflight count  
tends to always increase, which is consuming memory and was wondering  
under what circumstances it gets capped.

Here is my broker configuration. Any advice would be much appreciated.

   <bean id="broker"  
class="org.apache.activemq.xbean.XBeanBrokerService" lazy-init="true">
     <property name="brokerName" value="localhost" />
     <property name="advisorySupport" value="false" />
     <property name="systemUsage">
       <bean id="systemUsage"  
class="org.apache.activemq.usage.SystemUsage">
         <property name="sendFailIfNoSpace" value="true" />
         <property name="memoryUsage">
           <bean id="memoryUsage"  
class="org.apache.activemq.usage.MemoryUsage">
             <property name="limit" value="10000000" />
           </bean>
         </property>
         <property name="tempUsage">
           <bean id="tempUsage"  
class="org.apache.activemq.usage.TempUsage">
             <property name="limit" value="50000000" />
           </bean>
         </property>
       </bean>
     </property>
     <property name="destinationPolicy">
       <bean class="org.apache.activemq.broker.region.policy.PolicyMap">
         <property name="defaultEntry">
           <bean  
class="org.apache.activemq.broker.region.policy.PolicyEntry">
             <property name="destination">
               <bean class="org.apache.activemq.command.ActiveMQQueue">
                 <constructor-arg index="0" value="*" />
               </bean>
             </property>
             <property name="deadLetterStrategy">
               <bean  
class 
= 
"au 
.com 
.observant.ringocore.dispatcher.activemq.DefaultDeadLetterStrategy" />
             </property>
             <property name="producerFlowControl" value="false" />
             <property name="enableAudit" value="false" />
           </bean>
         </property>
       </bean>
     </property>
     <property name="persistenceAdapter" ref="persistenceAdaptor" />
         <!--  we don't want to start it yet, we may have to change  
persistenceAdaptor -->
     <property name="start" value="false" />
   </bean>

cheers
</jima>