activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raffi <raffi.onj...@gmail.com>
Subject Kahadb index updates taking too much time on ActiveMQ 5.11
Date Tue, 26 Sep 2017 12:51:26 GMT

In production with ActiveMQ 5.11 with multi-kahadb per destination on NFSv4
M|S (Linux 7.1), we're seeing the following log messages intermittently
during operations:

*Slow KahaDB access: Journal append took: 2 ms, Index update took 16901 ms*

Also, on startup, we see the following in our kahadb logs; this condition
severely impacts start up time, sometimes taking up to 90m for the broker to
start, and that's for relatively small persistent store (< 5Gb). We have not
adjusted indexCacheSize, that will be our first attempt to resolve this; we
also plan to benchmark NFSv4 file system performance. Aside from that, is
there any other broker config  

2017-09-25 14:35:27,352 [AMQ-1-thread-1 ] DEBUG ListIndex                     
- loading
 2017-09-25 14:35:27,365 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovering from the journal @1:76785
 2017-09-25 14:35:27,365 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovering from the journal @1:76785
 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovery replayed 1 operations from the journal in 0.012 seconds.
 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovery replayed 1 operations from the journal in 0.012 seconds.
 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO  KahaDBStore                   
- Stopping async queue tasks
 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO  KahaDBStore                   
- Stopping async topic tasks
 2017-09-25 14:35:27,366 [AMQ-1-thread-1 ] INFO  KahaDBStore                   
- Stopped KahaDB
 2017-09-25 14:35:27,855 [AMQ-1-thread-1 ] DEBUG KahaDBStore                   
- Store OpenWire version configured as: 6
 2017-09-25 14:35:30,234 [AMQ-1-thread-1 ] TRACE Journal                       
- Startup took: 2372 ms
 2017-09-25 14:35:30,276 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- KahaDB is version 5
 2017-09-25 14:35:30,276 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- KahaDB is version 5
 2017-09-25 14:35:30,281 [AMQ-1-thread-1 ] DEBUG ListIndex                     
- loading
 2017-09-25 14:35:30,282 [AMQ-1-thread-1 ] DEBUG ListIndex                     
- loading
 2017-09-25 14:35:30,296 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovering from the journal @1:70835
 2017-09-25 14:35:30,296 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovering from the journal @1:70835
 2017-09-25 14:35:30,296 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovery replayed 1 operations from the journal in 0.012 seconds.
 2017-09-25 14:35:30,296 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovery replayed 1 operations from the journal in 0.012 seconds.
 2017-09-25 14:35:30,297 [AMQ-1-thread-1 ] INFO  KahaDBStore                   
- Stopping async queue tasks
 2017-09-25 14:35:30,297 [AMQ-1-thread-1 ] INFO  KahaDBStore                   
- Stopping async topic tasks
 2017-09-25 14:35:30,297 [AMQ-1-thread-1 ] INFO  KahaDBStore                   
- Stopped KahaDB
 2017-09-25 14:35:30,785 [AMQ-1-thread-1 ] DEBUG KahaDBStore                   
- Store OpenWire version configured as: 6
 2017-09-25 14:35:33,023 [AMQ-1-thread-1 ] TRACE Journal                       
- Startup took: 2231 ms
 2017-09-25 14:35:33,060 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- KahaDB is version 5
 2017-09-25 14:35:33,060 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- KahaDB is version 5
 2017-09-25 14:35:33,065 [AMQ-1-thread-1 ] DEBUG ListIndex                     
- loading
 2017-09-25 14:35:33,066 [AMQ-1-thread-1 ] DEBUG ListIndex                     
- loading
 2017-09-25 14:35:33,080 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovering from the journal @1:55603
 2017-09-25 14:35:33,080 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovering from the journal @1:55603
 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovery replayed 1 operations from the journal in 0.013 seconds.
 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO  MessageDatabase               
- Recovery replayed 1 operations from the journal in 0.013 seconds.
 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO  KahaDBStore                   
- Stopping async queue tasks
 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO  KahaDBStore                   
- Stopping async topic tasks
 2017-09-25 14:35:33,081 [AMQ-1-thread-1 ] INFO  KahaDBStore                   
- Stopped KahaDB



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Mime
View raw message