activemq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rob Davies <rajdav...@gmail.com>
Subject Re: Memory usage jump
Date Sun, 19 Nov 2006 19:49:39 GMT
interesting - it appears that the paged in size of messages should  
also take into account the outstanding memory usage
Do you fancy raising a jira issue for this ?: http:// 
issues.apache.org/activemq/browse/AMQ

cheers,

rob
On 19 Nov 2006, at 19:06, jk@penguinsfan.com wrote:

>
> Using the store pending cursor, activemq.xml configured to use 200M  
> of RAM
> and Kaha store.  JVM started with options -Xms512M -Xmx512M -Xmn100M.
> Messages are 10KB in size, prefetch is default.
>
> I am seeing the memory usage immediately jump up really high (>100)  
> as soon
> as a durable consumer is activated when a large number of messages are
> waiting for that consumer.
>
> The producer hangs under this situation.
>
> If the consumer is killed before memory usage drops to normal,  
> memory usage
> does not drop (i.e., the server locks forever).
>
> Here is the kind of things I'm seeing in the DEBUG log:
>
> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 10, to: 9
> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 9, to: 8
> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 8, to: 7
> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 7, to: 6
> 2006-11-19 13:51:53,046 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 6, to: 5
> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 5, to: 4
> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 4, to: 3
> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 3, to: 2
> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 2, to: 1
> 2006-11-19 13:51:53,062 [ata File Writer] DEBUG UsageManager
> - Memory usage change.  from: 1, to: 0
> 2006-11-19 13:51:53,468 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 58, to: 59
> 2006-11-19 13:51:53,593 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 59, to: 60
> 2006-11-19 13:51:53,812 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 60, to: 61
> 2006-11-19 13:51:53,843 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 61, to: 62
> 2006-11-19 13:51:53,890 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 62, to: 63
> 2006-11-19 13:51:54,015 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 63, to: 64
> 2006-11-19 13:51:54,015 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 64, to: 65
> 2006-11-19 13:51:54,046 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 65, to: 66
> 2006-11-19 13:51:54,062 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 66, to: 67
> 2006-11-19 13:51:54,109 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 67, to: 68
> 2006-11-19 13:51:54,109 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 68, to: 69
> 2006-11-19 13:51:54,109 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 69, to: 70
> 2006-11-19 13:51:54,125 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 70, to: 71
> 2006-11-19 13:51:54,171 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 71, to: 72
> 2006-11-19 13:51:54,171 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 72, to: 73
> 2006-11-19 13:51:54,171 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 73, to: 74
> 2006-11-19 13:51:54,187 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 74, to: 75
> 2006-11-19 13:51:54,234 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 75, to: 76
> 2006-11-19 13:51:54,234 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 76, to: 77
> 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 77, to: 78
> 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 78, to: 79
> 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 79, to: 80
> 2006-11-19 13:51:54,265 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 80, to: 81
> 2006-11-19 13:51:54,281 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 81, to: 82
> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 82, to: 83
> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 83, to: 84
> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 84, to: 85
> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 85, to: 86
> 2006-11-19 13:51:54,312 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 86, to: 87
> 2006-11-19 13:51:54,359 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 87, to: 88
> 2006-11-19 13:51:54,390 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 88, to: 89
> 2006-11-19 13:51:54,390 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 89, to: 90
> 2006-11-19 13:51:54,406 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 90, to: 91
> 2006-11-19 13:51:54,406 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 91, to: 92
> 2006-11-19 13:51:54,406 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 92, to: 93
> 2006-11-19 13:51:54,421 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 93, to: 94
> 2006-11-19 13:51:54,437 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 94, to: 95
> 2006-11-19 13:51:54,437 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 95, to: 96
> 2006-11-19 13:51:54,437 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 96, to: 97
> 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 97, to: 98
> 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 98, to: 99
> 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 99, to: 100
> 2006-11-19 13:51:54,468 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 100, to: 101
> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 101, to: 102
> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 102, to: 103
> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 103, to: 104
> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 104, to: 105
> 2006-11-19 13:51:54,500 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 105, to: 106
> 2006-11-19 13:51:54,562 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 106, to: 107
> 2006-11-19 13:51:54,562 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 107, to: 108
> 2006-11-19 13:51:54,562 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 108, to: 109
> 2006-11-19 13:51:54,593 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 109, to: 110
> 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 110, to: 111
> 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 111, to: 112
> 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 112, to: 113
> 2006-11-19 13:51:54,609 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 113, to: 114
> 2006-11-19 13:51:54,625 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 114, to: 115
> 2006-11-19 13:51:54,687 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 115, to: 116
> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 116, to: 117
> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 117, to: 118
> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 118, to: 119
> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 119, to: 120
> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 120, to: 121
> 2006-11-19 13:51:54,718 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 121, to: 122
> 2006-11-19 13:51:54,734 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 122, to: 123
> 2006-11-19 13:51:54,734 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 123, to: 124
> 2006-11-19 13:51:54,750 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 124, to: 125
> 2006-11-19 13:51:54,765 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 125, to: 126
> 2006-11-19 13:51:54,781 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 126, to: 127
> 2006-11-19 13:51:54,781 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 127, to: 128
> 2006-11-19 13:51:54,812 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 128, to: 129
> 2006-11-19 13:51:54,828 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 129, to: 130
> 2006-11-19 13:51:54,828 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 130, to: 131
> 2006-11-19 13:51:54,828 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 131, to: 132
> 2006-11-19 13:51:54,843 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 132, to: 133
> 2006-11-19 13:51:54,984 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 133, to: 134
> 2006-11-19 13:51:54,984 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 134, to: 135
> 2006-11-19 13:51:54,984 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 135, to: 136
> 2006-11-19 13:51:55,031 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 136, to: 137
> 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 137, to: 138
> 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 138, to: 139
> 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 139, to: 140
> 2006-11-19 13:51:55,046 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 140, to: 141
> 2006-11-19 13:51:55,062 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 141, to: 142
> 2006-11-19 13:51:55,062 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 142, to: 143
> 2006-11-19 13:51:55,109 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 143, to: 144
> 2006-11-19 13:51:55,109 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 144, to: 145
> 2006-11-19 13:51:55,234 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 145, to: 146
> 2006-11-19 13:51:55,265 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 146, to: 147
> 2006-11-19 13:51:55,265 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 147, to: 148
> 2006-11-19 13:51:55,265 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 148, to: 149
> 2006-11-19 13:51:55,281 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 149, to: 150
> 2006-11-19 13:51:55,281 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 150, to: 151
> 2006-11-19 13:51:55,281 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 151, to: 152
> 2006-11-19 13:51:55,375 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 152, to: 153
> 2006-11-19 13:51:55,390 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 153, to: 154
> 2006-11-19 13:51:55,406 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 154, to: 155
> 2006-11-19 13:51:55,437 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 155, to: 156
> 2006-11-19 13:51:55,437 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 156, to: 157
> 2006-11-19 13:51:55,437 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 157, to: 158
> 2006-11-19 13:51:55,453 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 158, to: 159
> 2006-11-19 13:51:55,453 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 159, to: 160
> 2006-11-19 13:51:55,453 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 160, to: 161
> 2006-11-19 13:51:55,484 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 161, to: 162
> 2006-11-19 13:51:55,484 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 162, to: 163
> 2006-11-19 13:51:55,531 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 163, to: 164
> 2006-11-19 13:51:55,562 [/127.0.0.1:1999] DEBUG UsageManager
> - Memory usage change.  from: 164, to: 165
> -- 
> View this message in context: http://www.nabble.com/Memory-usage- 
> jump-tf2665032.html#a7432291
> Sent from the ActiveMQ - Dev mailing list archive at Nabble.com.
>


Mime
View raw message