Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7D8EE7A0A for ; Tue, 20 Sep 2011 20:47:33 +0000 (UTC) Received: (qmail 39516 invoked by uid 500); 20 Sep 2011 20:47:31 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 39477 invoked by uid 500); 20 Sep 2011 20:47:31 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 39469 invoked by uid 99); 20 Sep 2011 20:47:31 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Sep 2011 20:47:31 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.215.50] (HELO mail-ew0-f50.google.com) (209.85.215.50) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Sep 2011 20:47:25 +0000 Received: by ewy22 with SMTP id 22so767802ewy.37 for ; Tue, 20 Sep 2011 13:47:03 -0700 (PDT) Received: by 10.213.25.202 with SMTP id a10mr27414ebc.32.1316551622656; Tue, 20 Sep 2011 13:47:02 -0700 (PDT) Received: from [192.168.1.83] ([86.93.211.179]) by mx.google.com with ESMTPS id a8sm7727640eec.4.2011.09.20.13.47.01 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 20 Sep 2011 13:47:02 -0700 (PDT) References: <511D471F-34F9-432D-80DE-307DAAE55C44@almende.org> In-Reply-To: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Received: by 10.180.109.167 with HTTP; Tue, 20 Sep 2011 08:26:49 -0700 (PDT) Message-Id: Content-Transfer-Encoding: quoted-printable X-Mailer: iPhone Mail (8J2) From: Monica Razdan Subject: Re: Caching in BigCouch Date: Tue, 20 Sep 2011 22:46:54 +0200 To: "user@couchdb.apache.org" Julien thanks for your reply. Your experience helps me to reflect back on my= use case. Robert, I'm investigating the possibilities of scaling couchdb using BigCou= ch. However, I haven't been able to find documents or resources about the pe= rformance and scaling benchmarks?=20 Svein,=20 Thanks for your post! I'm investigating couchbase server as well at this mom= ent. Has anyone ran some performance and/or scaling test on bigCouch or Couchbase= server?=20 On Tue, Sep 20, 2011 at 9:40 AM, Julien Gagnet wro= te: > No. Couchdb and Bigcouch don't provide any caching. It relies on disk cach= ing. >=20 > So even if you see the couch process taking little memory, that > doesn't mean you won't get any improvement in adding more memory to > the box. The disk cache use a sophisticated LRU algorithm and should > provide what you're after. We recently were hitted by a performance > issue and using local disk wasn't an option, we've been able to > increase the memory up to a point where most of the db fit in the disk > caching and solve our problem. >=20 > Julien >=20 > On 19 September 2011 22:15, Monica Razdan wrote: >>=20 >> I'm my quest to find clustering for couchdb using hadoop I stumbled upon= this blog >>=20 >> http://mpouttuclarke.wordpress.com/2011/01/04/couchdb-and-hadoop/ >>=20 >> The author mentions here about LRU caching being used by hadoop. I have a= huge dataset sorted on timestamp and caching on timestamp like LRU would be= important for my use case. Does bigCouch offers such mechanism under it's h= ood ? >>=20 >> Monica >>=20 >>=20 >>=20 >> On Sep 19, 2011, at 10:43 PM, Robert Newson wro= te: >>=20 >>> What do you mean by 'caching' here? >>>=20 >>> On 19 September 2011 21:36, Monica Razdan wrote: >>>> Hello, >>>>=20 >>>> I wanted to compare the caching mechanism used in Hadoop - LRU with >>>> the caching in BigCouch. However, I couldn't find details about >>>> underlying caching algorithm used in Bigcouch. Could someone please >>>> direct me to the right resource? >>>>=20 >>>> Thanks, >>>> monica >>>>=20 >=20