From users-return-19071-apmail-jackrabbit-users-archive=jackrabbit.apache.org@jackrabbit.apache.org Wed Aug 1 21:51:24 2012 Return-Path: X-Original-To: apmail-jackrabbit-users-archive@minotaur.apache.org Delivered-To: apmail-jackrabbit-users-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6D1F5DD31 for ; Wed, 1 Aug 2012 21:51:24 +0000 (UTC) Received: (qmail 46615 invoked by uid 500); 1 Aug 2012 21:51:23 -0000 Delivered-To: apmail-jackrabbit-users-archive@jackrabbit.apache.org Received: (qmail 46568 invoked by uid 500); 1 Aug 2012 21:51:23 -0000 Mailing-List: contact users-help@jackrabbit.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@jackrabbit.apache.org Delivered-To: mailing list users@jackrabbit.apache.org Received: (qmail 46460 invoked by uid 99); 1 Aug 2012 21:51:23 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Aug 2012 21:51:23 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of webster@lexmark.com designates 64.18.3.92 as permitted sender) Received: from [64.18.3.92] (HELO exprod8og106.obsmtp.com) (64.18.3.92) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Aug 2012 21:51:16 +0000 Received: from mail-yx0-f182.google.com ([209.85.213.182]) (using TLSv1) by exprod8ob106.postini.com ([64.18.7.12]) with SMTP ID DSNKUBmkv5PNr15CDb3RRfGZMKjZ++hIznbS@postini.com; Wed, 01 Aug 2012 14:50:56 PDT Received: by yenl8 with SMTP id l8so9258304yen.13 for ; Wed, 01 Aug 2012 14:50:55 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:date:message-id:subject:from:to:cc:content-type :x-gm-message-state; bh=C9lJb96LQJJOJ9zU+cquAoZQSal/RE0w86lyKoXcjdI=; b=lOCifk7gPNWPQt6ftnEVFG8rLwlMX6Aa0EHVOghidcGqLLYJFYzW5n/IPGcd2IOi9t 9jBBnwWlJ9iE5Lj7GZESzjfoc334Crk6LyjBG1sDtNfUmU6J40QYhumvU6VtigZxXgfi m2H+RkVSx66uUG6hgkYImShDthOjbSKsmrvYIStSXJdwqEREd9AZQqAcQlgSrz+20qMj 6eQQZwsnT91qsOF4V/O+BrbenfIsCBOq/C7zlWJmG0TtNp9otWmbtcndKMjgy5I1HQSb 2nQsK5hNhHBjAyKwYRScAwfYDzV6Wv0jMn3duu9upczdtMePdpFawuOhPjDfA+6XWgbY lfcw== MIME-Version: 1.0 Received: by 10.100.228.19 with SMTP id a19mr3257748anh.62.1343857855142; Wed, 01 Aug 2012 14:50:55 -0700 (PDT) Received: by 10.100.93.16 with HTTP; Wed, 1 Aug 2012 14:50:55 -0700 (PDT) Date: Wed, 1 Aug 2012 17:50:55 -0400 Message-ID: Subject: Re: [Jackrabbit] runaway Postgres bundle Toast table From: Gary Webster To: users@jackrabbit.apache.org Cc: dev@jackrabbit.apache.org Content-Type: multipart/alternative; boundary=005045017543159a8a04c63b4a13 X-Gm-Message-State: ALoCoQmAYX7Pk4eB0y8uORuLLCGwyVowWsS8PtmMaChrv1ES4Q+tyT8llzaeG2ByqUb8G+zZD0Lm X-Virus-Checked: Checked by ClamAV on apache.org --005045017543159a8a04c63b4a13 Content-Type: text/plain; charset=ISO-8859-1 Hello. I've now noticed that Jackrabbit is doing this "update ... BUNDLE_DATA = $1 ..." for each file change/add, where $1 is 6MB+ in size ! Surely that is not functioning as designed. I could easily saturate a 100Mb ethernet with just this statement! Can anyone give me some advice on this? Thanks. On Mon, Jul 30, 2012 at 12:41 PM, Gary Webster wrote: > Hello. > > I am currently experiencing a horrible issue, using Jackrabbit clustering > with PostgreSQL as the Persistence Manager. > > This particular table (ws_bundle) grows ~10GB/hr ! My entire DB, for > multiple apps, including the rest of the repository DB, is <1GB. > This table is even bigger than the data store! > > I enabled query/statement logging in Postgres. The log went to 1GB in > just a couple minutes! > It is dominated by this one statement, which occurs every ~2 sec: > "update WS_BUNDLE set BUNDLE_DATA = $1 where NODE_ID_HI = $2 and > NODE_ID_LO = $3" > Parameter $1 is hex & appears to keep growing exponentially. The last one > I could catch was over 7million characters long !! > I can't believe that is correct functionality. > > Surely, I have something wrong in my Jackrabbit-db configuration. > > Thanks for your help. > > --005045017543159a8a04c63b4a13--