Return-Path: X-Original-To: apmail-activemq-users-archive@www.apache.org Delivered-To: apmail-activemq-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CAB9218E11 for ; Fri, 29 Apr 2016 13:11:15 +0000 (UTC) Received: (qmail 91429 invoked by uid 500); 29 Apr 2016 13:11:15 -0000 Delivered-To: apmail-activemq-users-archive@activemq.apache.org Received: (qmail 91396 invoked by uid 500); 29 Apr 2016 13:11:15 -0000 Mailing-List: contact users-help@activemq.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@activemq.apache.org Delivered-To: mailing list users@activemq.apache.org Received: (qmail 91380 invoked by uid 99); 29 Apr 2016 13:11:14 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Apr 2016 13:11:14 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id E72F5C06C5 for ; Fri, 29 Apr 2016 13:11:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.549 X-Spam-Level: * X-Spam-Status: No, score=1.549 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id sLDNPb8BvgOb for ; Fri, 29 Apr 2016 13:11:09 +0000 (UTC) Received: from mail-io0-f182.google.com (mail-io0-f182.google.com [209.85.223.182]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id A27405F47D for ; Fri, 29 Apr 2016 13:11:09 +0000 (UTC) Received: by mail-io0-f182.google.com with SMTP id d62so106931014iof.2 for ; Fri, 29 Apr 2016 06:11:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to; bh=r8B58qfn/k3V8dhbKvYbw1YDxlFi0TLyuE96rxJwgKo=; b=AbAeAclb3u7U2cVesG+eRMqFY0mFPm9HTXnfBl6dt69dwxmbz4tlGc9J1fNXBWCV8/ D5BBQZpuDrWFtCON91AnTKdxrC1lWI0ZpBpyjcT0ElRz5HQBxeVzVPlQH7aOHV/htlQS E2mHO1P6cWe+N0vtDKrfzmF774OOBqoTWAdvTEB7TB8RQB1IPPNu6w2OMnas/PcaKIyB SRLEF4+djcMzGyh2Ymwa724qYqoBbqMTA7oygZ4pNNXVHjubd13YmuZl/CD7H2JbEqUA dfn275iMnSZpBazm9v+KgrqmDtOOseXjDuX3bnh/TghHhX36vpQ/RbpUUyoQmSpXjP13 j8lQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:date :message-id:subject:from:to; bh=r8B58qfn/k3V8dhbKvYbw1YDxlFi0TLyuE96rxJwgKo=; b=hKi7r8i50oBSRMEvBXI7ksrGrfqw9+EEfmz4wZouIplAolXfikfbPZaSnPm75q0Pz+ VKFnzoSlQEG21YCMPIgdEmleRNzZGIwqp7b3ASTOA3cbeHNnLSUagJE274E91FtGcbhn Y/VmVgSXghbRJfgb/a8G//DQY/tzXvsr80QV22mc7SZ4ADcROT4kXrElpV617VYZbyyd HYdzYFIf9RvICMmCDiYY5p++5kNScTXRd8g5L+pn8sDhfUQT2oyLqB9lYJlYKeQy8kj3 4T/M/H5M4JelxHbyBciqfVe4XDR8sZskB2RppGAeZpErEg3pU8U7Ip98VUwunBT3rvim A5Mg== X-Gm-Message-State: AOPr4FVpNxKurndABjpkEMGOSmZFMrTMY98V2FXu+glQTH0NeWmveJXAYaOnDam02ifJjlVgvjxoVuUMO48vqQ== MIME-Version: 1.0 X-Received: by 10.107.174.1 with SMTP id x1mr24297329ioe.76.1461935468362; Fri, 29 Apr 2016 06:11:08 -0700 (PDT) Sender: tbain98@gmail.com Received: by 10.50.25.228 with HTTP; Fri, 29 Apr 2016 06:11:08 -0700 (PDT) Received: by 10.50.25.228 with HTTP; Fri, 29 Apr 2016 06:11:08 -0700 (PDT) In-Reply-To: <5723560B.6030201@die-schneider.net> References: <5723560B.6030201@die-schneider.net> Date: Fri, 29 Apr 2016 07:11:08 -0600 X-Google-Sender-Auth: sm09oqJ1jK78DczsPLWYPHNG6zE Message-ID: Subject: Re: Separate kahadb for queues and dead letter queues? From: Tim Bain To: ActiveMQ Users Content-Type: multipart/alternative; boundary=001a11445e1046ca1b05319f6032 --001a11445e1046ca1b05319f6032 Content-Type: text/plain; charset=UTF-8 Using mKahaDB with a separate KahaDB instance for the DLQ is the best idea I know of for dealing with the problem you describe. A JIRA enhancement request exists for compacting KahaDB journals ( https://issues.apache.org/jira/plugins/servlet/mobile#issue/AMQ-3978). You should vote for it, and if you felt like implementing a fix and submitting a pull request, that would help make sure it gets implemented sooner rather than later. On Apr 29, 2016 6:39 AM, "Christian Schneider" wrote: > We have the issue that our journals at a customer are very large. We > analyzed the messages in the system and found that most of the time > the normal queues stay at a very low number of messages near to 0. The > only queues that hold messages for longer periods of time are the dead > letter queues. > > The journals are much bigger than the dead letter queue contents. > > My assumption is that most of the journals only contain very few still > needed messages and the ones they contain are the messages that now are in > the dead letter queues. > Still the journals can not be cleaned up of course. > > So what I would like to to is to use one kahadb for the regular queues and > a different one for the dead letter queues. Does that make sense? > I will try to do this using "Multi(m) kahaDB persistence adapter": See > http://activemq.apache.org/kahadb.html > > I also wonder if it would make sense that ActiveMQ cleans up its journals > regularly. It could simply move all oldest messages to the newest jorunal > to kind of pack if denser. > Would that work? > > Christian > > -- > Christian Schneider > http://www.liquid-reality.de > > Open Source Architect > http://www.talend.com > > --001a11445e1046ca1b05319f6032--