activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kal123 <kpfininf...@gmail.com>
Subject activemq 5.9 Replicated LevelDB FlushCommand cannot cast to Message exception after failover
Date Tue, 05 Nov 2013 17:33:52 GMT

We received this error after the failover any idea why LevelDbClient is
getting these error, causes the broker to stop.

.activemq.leveldb.replicated.MasterLevelDBStore | hawtdispatch-DEFAULT-2
2013-11-05 12:09:57,386 | INFO  | Stopping BrokerService[largeamq] due to
exception, java.io.IOException: org.apache.activemq.command.FlushCommand
cannot be cast to org.apache.activemq.command.Message |
org.apache.activemq.util.DefaultIOExceptionHandler | LevelDB IOException
handler.
java.io.IOException: org.apache.activemq.command.FlushCommand cannot be cast
to org.apache.activemq.command.Message
        at
org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
        at
org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:543)
        at
org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:974)
        at
org.apache.activemq.leveldb.LevelDBClient.collectionCursor(LevelDBClient.scala:1270)
        at
org.apache.activemq.leveldb.LevelDBClient.queueCursor(LevelDBClient.scala:1194)
        at
org.apache.activemq.leveldb.DBManager.cursorMessages(DBManager.scala:708)
        at
org.apache.activemq.leveldb.LevelDBStore$LevelDBMessageStore.recoverNextMessages(LevelDBStore.scala:741)
        at
org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:106)
        at
org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:258)
        at
org.apache.activemq.broker.region.cursors.AbstractStoreCursor.hasNext(AbstractStoreCursor.java:145)
        at
org.apache.activemq.broker.region.cursors.StoreQueueCursor.hasNext(StoreQueueCursor.java:131)
        at
org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1876)
        at
org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:2086)
        at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1581)
        at org.apache.activemq.broker.region.Queue.wakeup(Queue.java:1803)
        at
org.apache.activemq.broker.region.Queue.addSubscription(Queue.java:464)
        at
org.apache.activemq.broker.region.AbstractRegion.addConsumer(AbstractRegion.java:314)
        at
org.apache.activemq.broker.region.RegionBroker.addConsumer(RegionBroker.java:401)
        at
org.apache.activemq.broker.jmx.ManagedRegionBroker.addConsumer(ManagedRegionBroker.java:230)
        at
org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:97)
        at
org.apache.activemq.advisory.AdvisoryBroker.addConsumer(AdvisoryBroker.java:102)
        at
org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:97)
        at
org.apache.activemq.broker.BrokerFilter.addConsumer(BrokerFilter.java:97)

...
also looks like it cannot stop itself:
2013-11-05 12:09:58,216 | ERROR | Failed to page in more queue messages  |
org.apache.activemq.broker.region.Queue | ActiveMQ BrokerService[largeamq]
Task-60
java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException
        at
org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:111)
        at
org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
        at
org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1875)
        at
org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:2086)
        at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1581)
        at org.apache.activemq.broker.region.Queue.wakeup(Queue.java:1803)
        at
org.apache.activemq.broker.region.Queue.removeSubscription(Queue.java:575)
        at
org.apache.activemq.broker.region.AbstractRegion.removeConsumer(AbstractRegion.java:368)
        at
org.apache.activemq.broker.region.RegionBroker.removeConsumer(RegionBroker.java:412)
        at
org.apache.activemq.broker.jmx.ManagedRegionBroker.removeConsumer(ManagedRegionBroker.java:248)
        at
org.apache.activemq.broker.BrokerFilter.removeConsumer(BrokerFilter.java:132)
        at
org.apache.activemq.advisory.AdvisoryBroker.removeConsumer(AdvisoryBroker.java:264)
        at
org.apache.activemq.broker.BrokerFilter.removeConsumer(BrokerFilter.java:132)
        at
org.apache.activemq.broker.BrokerFilter.removeConsumer(BrokerFilter.java:132)
        at
org.apache.activemq.broker.MutableBrokerFilter.removeConsumer(MutableBrokerFilter.java:137)
        at
org.apache.activemq.broker.TransportConnection.processRemoveConsumer(TransportConnection.java:619)
        at
org.apache.activemq.broker.TransportConnection.processRemoveSession(TransportConnection.java:658)
        at
org.apache.activemq.broker.TransportConnection.processRemoveConnection(TransportConnection.java:770)
        at
org.apache.activemq.broker.TransportConnection.doStop(TransportConnection.java:1107)
        at
org.apache.activemq.broker.TransportConnection$4.run(TransportConnection.java:1037)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
Caused by: java.lang.RuntimeException: java.io.IOException
        at
org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:261)
        at
org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:108)
        ... 22 more
Caused by: java.io.IOException
        at
org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
        at
org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:543)
        at
org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:974)
        at
org.apache.activemq.leveldb.LevelDBClient.collectionCursor(LevelDBClient.scala:1270)
        at
org.apache.activemq.leveldb.LevelDBClient.queueCursor(LevelDBClient.scala:1194)
        at
org.apache.activemq.leveldb.DBManager.cursorMessages(DBManager.scala:708)
        at
org.apache.activemq.leveldb.LevelDBStore$LevelDBMessageStore.recoverNextMessages(LevelDBStore.scala:741)
        at
org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:106)
        at
org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:258)
        ... 23 more
Caused by: java.lang.NullPointerException
        at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply$mcV$sp(LevelDBClient.scala:1271)
        at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply(LevelDBClient.scala:1271)
        at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply(LevelDBClient.scala:1271)
        at
org.apache.activemq.leveldb.LevelDBClient.usingIndex(LevelDBClient.scala:968)
        at
org.apache.activemq.leveldb.LevelDBClient$$anonfun$might_fail_using_index$1.apply(LevelDBClient.scala:974)
        at
org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:540)
        ... 30 more
2013-11-05 12:10:03,219 | INFO  | The connection to
'tcp://10.44.175.235:43508' is taking a long time to shutdown. |
org.apache.activemq.broker.TransportConnection | IOExceptionHandler:
stopping BrokerService[largeamq]
2013-11-05 12:10:08,221 | INFO  | The connection to
'tcp://10.44.175.235:43508' is taking a long time to shutdown. |
org.apache.activemq.broker.TransportConnection | IOExceptionHandler:
stopping BrokerService[largeamq]





--
View this message in context: http://activemq.2283324.n4.nabble.com/activemq-5-9-Replicated-LevelDB-FlushCommand-cannot-cast-to-Message-exception-after-failover-tp4673914.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Mime
View raw message