activemq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Claudio Corsi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMQ-4051) IOException: Could not locate data file .\db-10.log
Date Tue, 16 Oct 2012 16:57:03 GMT

    [ https://issues.apache.org/jira/browse/AMQ-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477154#comment-13477154
] 

Claudio Corsi commented on AMQ-4051:
------------------------------------

Hi Edwin,

I was looking at the configuration file and noticed that you defined the carinaIOExceptionHandler
bean but this is not part of the list of attached files.  Does this get called anytime throughout
the test? Is it even required?

There is also the question of what is the type of use-case that you are using that reproduces
this issue?  Are you expecting all of the messages to pump through the network connection
between the brokers or are they also being consumed by consumers that are connected to the
broker that contains the queues?

How many consumers are you connecting to these brokers?  What protocol are you using?  Are
the consumers coming and going or are they permanently connected throughout the test?

Have you been able to reproduce this issue using the latest release v5.7?

--Claudio

                
> IOException: Could not locate data file .\db-10.log
> ---------------------------------------------------
>
>                 Key: AMQ-4051
>                 URL: https://issues.apache.org/jira/browse/AMQ-4051
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.6.0
>         Environment: Windows Server 2008 R2, 8GB, Intel Core 2 Duo CPU 64 bit
> JDK 1.6.0_26, 64 bit
>            Reporter: Edwin Yu
>            Priority: Critical
>             Fix For: 5.8.0
>
>         Attachments: activemq.xml
>
>
> We're doing load testing on the ActiveMQ 5.6.0 broker-to-broker connection, pumping in
about 80,000 messages per hour into the queue.  One of the brokers stops dequeueing messages
to the consumer while its queue size increases.  The log contains repeating errors about "could
not locate the data file."
> We encountered this same issue couple weeks ago.  I found AMQ-3120 and added ignoreMissingJouralFiles="true"
like that issue suggested.  After many more days of testing, today we countered this same
problem again.  Our disk space is plenty.  The log is listed below.  I attached our activemq
configuration from the troubled broker to this issue.
> ------------------------------------------------------------------
> 2012-09-14 16:01:47,354 ERROR | BrokerService[xps-amq-broker_HPC-HAIFA-HAIFA-HAIFA] Task-18
| [Journal:352] Looking for key 10 but not found in fileMap: {11=db-11.log number = 11 , length
= 499163}
> 2012-09-14 16:01:47,354 ERROR | BrokerService[xps-amq-broker_HPC-HAIFA-HAIFA-HAIFA] Task-18
| [AbstractStoreCursor:279] org.apache.activemq.broker.region.cursors.QueueStorePrefetch@5fae7502:n4.HPC/HAIFA/HAIFA/HAIFA,batchResetNeeded=false,storeHasMessages=true,size=100,cacheEnabled=false
- Failed to fill batch
> java.io.IOException: Could not locate data file .\esb\amq_N4-PERFORM70\db-10.log
> 	at org.apache.kahadb.journal.Journal.getDataFile(Journal.java:353)
> 	at org.apache.kahadb.journal.Journal.read(Journal.java:600)
> 	at org.apache.activemq.store.kahadb.MessageDatabase.load(MessageDatabase.java:924)
> 	at org.apache.activemq.store.kahadb.KahaDBStore.loadMessage(KahaDBStore.java:1015)
> 	at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$4.execute(KahaDBStore.java:556)
> 	at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> 	at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recoverNextMessages(KahaDBStore.java:545)
> 	at org.apache.activemq.store.ProxyMessageStore.recoverNextMessages(ProxyMessageStore.java:106)
> 	at org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:97)
> 	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:277)
> 	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:113)
> 	at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
> 	at org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1766)
> 	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:1995)
> 	at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1488)
> 	at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
> 	at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:662)
> 2012-09-14 16:01:47,354 ERROR | BrokerService[xps-amq-broker_HPC-HAIFA-HAIFA-HAIFA] Task-18
| [AbstractStoreCursor:115] org.apache.activemq.broker.region.cursors.QueueStorePrefetch@5fae7502:n4.HPC/HAIFA/HAIFA/HAIFA,batchResetNeeded=false,storeHasMessages=true,size=100,cacheEnabled=false
- Failed to fill batch
> java.lang.RuntimeException: java.io.IOException: Could not locate data file .\esb\amq_N4-PERFORM70\db-10.log
> 	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:280)
> 	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:113)
> 	at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
> 	at org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1766)
> 	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:1995)
> 	at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1488)
> 	at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
> 	at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: Could not locate data file .\esb\amq_N4-PERFORM70\db-10.log
> 	at org.apache.kahadb.journal.Journal.getDataFile(Journal.java:353)
> 	at org.apache.kahadb.journal.Journal.read(Journal.java:600)
> 	at org.apache.activemq.store.kahadb.MessageDatabase.load(MessageDatabase.java:924)
> 	at org.apache.activemq.store.kahadb.KahaDBStore.loadMessage(KahaDBStore.java:1015)
> 	at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$4.execute(KahaDBStore.java:556)
> 	at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> 	at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recoverNextMessages(KahaDBStore.java:545)
> 	at org.apache.activemq.store.ProxyMessageStore.recoverNextMessages(ProxyMessageStore.java:106)
> 	at org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:97)
> 	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:277)
> 	... 10 more
> 2012-09-14 16:01:47,354 ERROR | BrokerService[xps-amq-broker_HPC-HAIFA-HAIFA-HAIFA] Task-18
| [Queue:1491] Failed to page in more queue messages 
> java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Could not
locate data file .\esb\amq_N4-PERFORM70\db-10.log
> 	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:116)
> 	at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
> 	at org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1766)
> 	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:1995)
> 	at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1488)
> 	at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
> 	at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.RuntimeException: java.io.IOException: Could not locate data file
.\esb\amq_N4-PERFORM70\db-10.log
> 	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:280)
> 	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:113)
> 	... 9 more
> Caused by: java.io.IOException: Could not locate data file .\esb\amq_N4-PERFORM70\db-10.log
> 	at org.apache.kahadb.journal.Journal.getDataFile(Journal.java:353)
> 	at org.apache.kahadb.journal.Journal.read(Journal.java:600)
> 	at org.apache.activemq.store.kahadb.MessageDatabase.load(MessageDatabase.java:924)
> 	at org.apache.activemq.store.kahadb.KahaDBStore.loadMessage(KahaDBStore.java:1015)
> 	at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$4.execute(KahaDBStore.java:556)
> 	at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> 	at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recoverNextMessages(KahaDBStore.java:545)
> 	at org.apache.activemq.store.ProxyMessageStore.recoverNextMessages(ProxyMessageStore.java:106)
> 	at org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:97)
> 	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:277)
> 	... 10 more
> 2012-09-14 16:01:47,354 INFO  | ActiveMQ Session Task-26 | [LogComponent:41] 
> --------------------------------------------------------------------------

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message