activemq-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Scorpio ...@xiangjiabao.com>
Subject Re: kahadb index file larger than journal file
Date Wed, 25 Jan 2017 04:00:11 GMT
Christopher:


Thank you for your explanation!

Hope there would be other proper ways to shrink the index file in future 
ActiveMQ releases.

Once we monitored that our broker is killed by system due to "out of 
memory".

I know that meta cache in memory will be synced into index file at 
checking points. _*Does this mean there is as much memory as  the 
db.data file being used?*_

Even though our broker is idle,  we still find that it uses up much 
memory. Could they be relevant associated? Thanks


Kind regards,

Scorpio

On 2017/1/24 20:16, christopher.l.shannon [via ActiveMQ] wrote:
> The index grows based off the amount of data it tracks in the journal,
> but doesn't shrink.  This means if you had a lot of data in your
> journal at some point (several gigabytes, etc) then the index would
> have grown in size with enough page files to keep track of all of the
> data.  This is usually not an issue because the index size generally
> stabilizes at some point relative to the work load of the broker.   If
> you really want to shrink it the only way right now is to stop the
> broker, delete the index and restart so it does a replay and rebuilds
> the index but the size would just grow again as messages flow.
>
> On Mon, Jan 23, 2017 at 8:06 PM, Scorpio <[hidden email] 
> </user/SendEmail.jtp?type=node&node=4721300&i=0>> wrote:
>
> > Hi, All,
> >
> > In my activemq instance, I find that the kahadb index file is larger 
> than
> > the journal file.
> >
> > As far as I know, /db.data/ is the meta store, index for the journal 
> file,
> > which should means it is much smaller than the journal file. 
> However, it
> > does not look like that. The index file seems to keep growing while the
> > journal file is rotated. Do I miss something? Thanks.
> >
> > Log attached:
> > root@host:~/run/apache-activemq-5.13.1/data/kahadb# du * -sh
> > 16M     db-16.log
> > 1.2G    db.data
> > 3.2M    db.redo
> > 4.0K    lock
> > root@host:~/run/apache-activemq-5.13.1/data/kahadb#
> >
> > Kind regards,
> > Scorpio
> >
> >
> >
> > --
> > View this message in context: 
> http://activemq.2283324.n4.nabble.com/kahadb-index-file-larger-than-journal-file-tp4721284.html
> > Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>
>
> ------------------------------------------------------------------------
> If you reply to this email, your message will be added to the 
> discussion below:
> http://activemq.2283324.n4.nabble.com/kahadb-index-file-larger-than-journal-file-tp4721284p4721300.html

>
> To start a new topic under ActiveMQ - User, email 
> ml-node+s2283324n2341805h23@n4.nabble.com
> To unsubscribe from kahadb index file larger than journal file, click 
> here 
> <http://activemq.2283324.n4.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4721284&code=bnlAeGlhbmdqaWFiYW8uY29tfDQ3MjEyODR8MTkzNzMzOTQ5NQ==>.
> NAML 
> <http://activemq.2283324.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>

>





--
View this message in context: http://activemq.2283324.n4.nabble.com/kahadb-index-file-larger-than-journal-file-tp4721284p4721315.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message