activemq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jk@penguinsfan.com" ...@penguinsfan.com>
Subject Re: Memory usage jump
Date Sun, 19 Nov 2006 20:07:47 GMT

Done.  AMQ-1061.  I put it is an critical for 4.2.0.

BTW, do you prefer discussing issues here or should they be directly entered
in the tracker?

Thanks.


rajdavies wrote:
> 
> interesting - it appears that the paged in size of messages should  
> also take into account the outstanding memory usage
> Do you fancy raising a jira issue for this ?: http:// 
> issues.apache.org/activemq/browse/AMQ
> 
> cheers,
> 
> rob
> On 19 Nov 2006, at 19:06, jk@penguinsfan.com wrote:
> 
>>
>> Using the store pending cursor, activemq.xml configured to use 200M  
>> of RAM
>> and Kaha store.  JVM started with options -Xms512M -Xmx512M -Xmn100M.
>> Messages are 10KB in size, prefetch is default.
>>
>> I am seeing the memory usage immediately jump up really high (>100)  
>> as soon
>> as a durable consumer is activated when a large number of messages are
>> waiting for that consumer.
>>
>> The producer hangs under this situation.
>>
>> If the consumer is killed before memory usage drops to normal,  
>> memory usage
>> does not drop (i.e., the server locks forever).
>>
>> Here is the kind of things I'm seeing in the DEBUG log:
>>
>> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 10, to: 9
>> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 9, to: 8
>> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 8, to: 7
>> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 7, to: 6
>> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 6, to: 5
>> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 5, to: 4
>> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 4, to: 3
>> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 3, to: 2
>> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 2, to: 1
>> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
>> - Memory usage change.  from: 1, to: 0
>> 2006-11-19 13:51:53,468 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 58, to: 59
>> 2006-11-19 13:51:53,593 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 59, to: 60
>> 2006-11-19 13:51:53,812 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 60, to: 61
>> 2006-11-19 13:51:53,843 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 61, to: 62
>> 2006-11-19 13:51:53,890 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 62, to: 63
>> 2006-11-19 13:51:54,015 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 63, to: 64
>> 2006-11-19 13:51:54,015 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 64, to: 65
>> 2006-11-19 13:51:54,046 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 65, to: 66
>> 2006-11-19 13:51:54,062 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 66, to: 67
>> 2006-11-19 13:51:54,109 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 67, to: 68
>> 2006-11-19 13:51:54,109 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 68, to: 69
>> 2006-11-19 13:51:54,109 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 69, to: 70
>> 2006-11-19 13:51:54,125 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 70, to: 71
>> 2006-11-19 13:51:54,171 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 71, to: 72
>> 2006-11-19 13:51:54,171 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 72, to: 73
>> 2006-11-19 13:51:54,171 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 73, to: 74
>> 2006-11-19 13:51:54,187 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 74, to: 75
>> 2006-11-19 13:51:54,234 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 75, to: 76
>> 2006-11-19 13:51:54,234 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 76, to: 77
>> 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 77, to: 78
>> 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 78, to: 79
>> 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 79, to: 80
>> 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 80, to: 81
>> 2006-11-19 13:51:54,281 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 81, to: 82
>> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 82, to: 83
>> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 83, to: 84
>> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 84, to: 85
>> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 85, to: 86
>> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 86, to: 87
>> 2006-11-19 13:51:54,359 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 87, to: 88
>> 2006-11-19 13:51:54,390 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 88, to: 89
>> 2006-11-19 13:51:54,390 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 89, to: 90
>> 2006-11-19 13:51:54,406 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 90, to: 91
>> 2006-11-19 13:51:54,406 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 91, to: 92
>> 2006-11-19 13:51:54,406 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 92, to: 93
>> 2006-11-19 13:51:54,421 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 93, to: 94
>> 2006-11-19 13:51:54,437 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 94, to: 95
>> 2006-11-19 13:51:54,437 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 95, to: 96
>> 2006-11-19 13:51:54,437 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 96, to: 97
>> 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 97, to: 98
>> 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 98, to: 99
>> 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 99, to: 100
>> 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 100, to: 101
>> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 101, to: 102
>> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 102, to: 103
>> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 103, to: 104
>> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 104, to: 105
>> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 105, to: 106
>> 2006-11-19 13:51:54,562 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 106, to: 107
>> 2006-11-19 13:51:54,562 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 107, to: 108
>> 2006-11-19 13:51:54,562 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 108, to: 109
>> 2006-11-19 13:51:54,593 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 109, to: 110
>> 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 110, to: 111
>> 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 111, to: 112
>> 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 112, to: 113
>> 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 113, to: 114
>> 2006-11-19 13:51:54,625 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 114, to: 115
>> 2006-11-19 13:51:54,687 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 115, to: 116
>> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 116, to: 117
>> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 117, to: 118
>> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 118, to: 119
>> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 119, to: 120
>> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 120, to: 121
>> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 121, to: 122
>> 2006-11-19 13:51:54,734 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 122, to: 123
>> 2006-11-19 13:51:54,734 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 123, to: 124
>> 2006-11-19 13:51:54,750 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 124, to: 125
>> 2006-11-19 13:51:54,765 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 125, to: 126
>> 2006-11-19 13:51:54,781 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 126, to: 127
>> 2006-11-19 13:51:54,781 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 127, to: 128
>> 2006-11-19 13:51:54,812 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 128, to: 129
>> 2006-11-19 13:51:54,828 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 129, to: 130
>> 2006-11-19 13:51:54,828 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 130, to: 131
>> 2006-11-19 13:51:54,828 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 131, to: 132
>> 2006-11-19 13:51:54,843 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 132, to: 133
>> 2006-11-19 13:51:54,984 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 133, to: 134
>> 2006-11-19 13:51:54,984 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 134, to: 135
>> 2006-11-19 13:51:54,984 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 135, to: 136
>> 2006-11-19 13:51:55,031 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 136, to: 137
>> 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 137, to: 138
>> 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 138, to: 139
>> 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 139, to: 140
>> 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 140, to: 141
>> 2006-11-19 13:51:55,062 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 141, to: 142
>> 2006-11-19 13:51:55,062 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 142, to: 143
>> 2006-11-19 13:51:55,109 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 143, to: 144
>> 2006-11-19 13:51:55,109 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 144, to: 145
>> 2006-11-19 13:51:55,234 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 145, to: 146
>> 2006-11-19 13:51:55,265 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 146, to: 147
>> 2006-11-19 13:51:55,265 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 147, to: 148
>> 2006-11-19 13:51:55,265 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 148, to: 149
>> 2006-11-19 13:51:55,281 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 149, to: 150
>> 2006-11-19 13:51:55,281 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 150, to: 151
>> 2006-11-19 13:51:55,281 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 151, to: 152
>> 2006-11-19 13:51:55,375 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 152, to: 153
>> 2006-11-19 13:51:55,390 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 153, to: 154
>> 2006-11-19 13:51:55,406 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 154, to: 155
>> 2006-11-19 13:51:55,437 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 155, to: 156
>> 2006-11-19 13:51:55,437 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 156, to: 157
>> 2006-11-19 13:51:55,437 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 157, to: 158
>> 2006-11-19 13:51:55,453 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 158, to: 159
>> 2006-11-19 13:51:55,453 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 159, to: 160
>> 2006-11-19 13:51:55,453 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 160, to: 161
>> 2006-11-19 13:51:55,484 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 161, to: 162
>> 2006-11-19 13:51:55,484 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 162, to: 163
>> 2006-11-19 13:51:55,531 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 163, to: 164
>> 2006-11-19 13:51:55,562 [/127.0.0.1:1999] DEBUG UsageManager
>> - Memory usage change.  from: 164, to: 165
>> -- 
>> View this message in context: http://www.nabble.com/Memory-usage- 
>> jump-tf2665032.html#a7432291
>> Sent from the ActiveMQ - Dev mailing list archive at Nabble.com.
>>
> 
> 
> 

-- 
View this message in context: http://www.nabble.com/Memory-usage-jump-tf2665032.html#a7432887
Sent from the ActiveMQ - Dev mailing list archive at Nabble.com.


Mime
View raw message