activemq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dag Liodden (JIRA)" <j...@apache.org>
Subject [jira] Commented: (AMQ-2721) Broker hangs reading KahaDB data store
Date Wed, 27 Oct 2010 07:29:01 GMT

    [ https://issues.apache.org/activemq/browse/AMQ-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=62861#action_62861
] 

Dag Liodden commented on AMQ-2721:
----------------------------------

We also see this issue on 5.3.1-fuse-01-00. Occasionally on restarts (graceful), Kaha hangs
on startup and we have to delete the entire store (and loose messages) to get it going again.
A strange and probably related symptom is that the store seems to grow indefinitely. Although
there should be only a few in-flight messages, our current, corrupted store has 40 data-queue
files (128MB each). The data is too sensitive to publish here, but we can arrange that privately
if needed.

The problem is in KahaStore.generateInterestInMapDataFiles where the while-loop is alternating
between two item ids in an infinite loop.

> Broker hangs reading KahaDB data store
> --------------------------------------
>
>                 Key: AMQ-2721
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2721
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.1
>         Environment: Red hat enterprise
>            Reporter: Dennis Klinkott
>             Fix For: 5.5.0
>
>         Attachments: brokerjstack.log
>
>
> Broker hangs on loading the data store. Happens after using the broker for 10 hours in
productive environment.
> In broker log the last entries we see is a bunch of loading kahadb debug entries.
> 2010-05-05 16:06:19,462 | DEBUG | loading | org.apache.kahadb.index.BTreeIndex | main
> But the broker doesn't stall completely. It is doing something with high cpu load. But
it doesn't get the data store loaded. Even after a few hours it doesn't get finished (usually
only takes a few seconds).
> I took a few jstack-dumps where we can see the broker being busy putting something into
a hashmap.
> We have 2 brokers connected as network of brokers.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message