Mailing-List: contact dev-help@directory.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "Apache Directory Developers List" <dev@directory.apache.org>
Received-SPF: pass (athena.apache.org: domain of elecharny@gmail.com
 designates 74.125.82.52 as permitted sender)
Message-ID: <4E420D13.2000608@gmail.com>
Date: Wed, 10 Aug 2011 06:46:11 +0200
From: Emmanuel Lecharny <elecharny@gmail.com>
Reply-To: elecharny@apache.org
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
 rv:5.0) Gecko/20110624 Thunderbird/5.0
MIME-Version: 1.0
To: Apache Directory Developers List <dev@directory.apache.org>
Subject: Re: Replication tests : memory leak
References: <4E416E32.60407@gmail.com>
 <CABzFU-cZoRJMRkXDtiN7GqtFZW3p8pgJQoLj_En=hWoYqVZf0w@mail.gmail.com>
In-Reply-To: 
 <CABzFU-cZoRJMRkXDtiN7GqtFZW3p8pgJQoLj_En=hWoYqVZf0w@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

On 8/9/11 9:57 PM, Kiran Ayyagari wrote:
> On Tue, Aug 9, 2011 at 10:58 PM, Emmanuel Lecharny<elecharny@gmail.com>  wrote:
>> Hi,
>>
>> I tried to launch a test with 10000 modifications (modDn test) to see what
>> could happen, but the test fails after a few thousands loops (around 4000).
>> I started a profiling session, and I saw that the memory is quickly consumed
>> and never released.
>>
>> I tested with 128M, 256M and 512M, the only difference is the number of
>> loops we can do.
>>
>> When we reach the memory limit, the GC start to kick hard and so does the
>> CPU. I have beautiful curves on VisualVM !
>>
>> We do have a memory leak somewhere, we now have to find where ! IMO, it
>> seems that the ActiveMQ queues are storing refs in memory, and aren't
>> cleaned when we pick a message. To be checked.
>>
> I think this is quite likely the scenario cause we use in-vm transport
> for communicating with queues

I tried to configure ActiveMQ to use what they call File Based Cursor, 
with no success 
(http://activemq.apache.org/how-do-i-configure-activemq-to-hold-100s-of-millions-of-queue-messages-.html)

Here is the code I added :

             ...
             // Create the system responsible for transmitting the 
requests when
             // the direct connection to the consumer is closed.
             brokerService = new BrokerService();
             brokerService.setUseJmx( false );
             brokerService.setPersistent( true );
             brokerService.setDataDirectory( path );

             PolicyMap policyMap = new PolicyMap();

             // The Topic policyEntry
             PolicyEntry topicPolicyEntry = new PolicyEntry();
             topicPolicyEntry.setTopic( ">" );
             topicPolicyEntry.setProducerFlowControl( true );

             // Limit memory used to 1M
             topicPolicyEntry.setMemoryLimit( 1000000L );

             PendingSubscriberMessageStoragePolicy 
pendingSubscriberPolicy = new FilePendingSubscriberMessageStoragePolicy();
             topicPolicyEntry.setPendingSubscriberPolicy( 
pendingSubscriberPolicy );

             policyMap.put( topicPolicyEntry.getDestination(), 
topicPolicyEntry );

             // The Queue policyEntry
             PolicyEntry queuePolicyEntry = new PolicyEntry();
             queuePolicyEntry.setTopic( ">" );
             queuePolicyEntry.setProducerFlowControl( true );

             // Limit memory used to 1M
             queuePolicyEntry.setMemoryLimit( 1000000L );

             PendingQueueMessageStoragePolicy pendingQueuePolicy = new 
FilePendingQueueMessageStoragePolicy();
             queuePolicyEntry.setPendingQueuePolicy( pendingQueuePolicy );

             policyMap.put( queuePolicyEntry.getDestination(), 
queuePolicyEntry );

             brokerService.setDestinationPolicy( policyMap );
             ...

Didn't changed anything. My understanding of ActiveMQ configuration is 
*very* limited, so it needs some more love from someone who knows how 
this configuration works.


-- 
Regards,
Cordialement,
Emmanuel Lécharny
www.iktek.com