From user-return-21777-apmail-couchdb-user-archive=couchdb.apache.org@couchdb.apache.org Wed Aug 15 13:00:40 2012 Return-Path: X-Original-To: apmail-couchdb-user-archive@www.apache.org Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 29BA4DCA5 for ; Wed, 15 Aug 2012 13:00:40 +0000 (UTC) Received: (qmail 96994 invoked by uid 500); 15 Aug 2012 13:00:38 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 96943 invoked by uid 500); 15 Aug 2012 13:00:38 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 96935 invoked by uid 99); 15 Aug 2012 13:00:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Aug 2012 13:00:38 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sean.copenhaver@gmail.com designates 209.85.213.180 as permitted sender) Received: from [209.85.213.180] (HELO mail-yx0-f180.google.com) (209.85.213.180) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Aug 2012 13:00:30 +0000 Received: by yenl8 with SMTP id l8so1840634yen.11 for ; Wed, 15 Aug 2012 06:00:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=TX9A2FEJXRWYnJR3daCO9KFd+852oN/Mxyi5sr8UfQM=; b=ewOInOITBwhpnjLZYZQS46Chld/mMtgrXx7QN/h8XIVPDSICIuX2AFSkICjckjpbxl 4Qs3NmxCfWGxCSqOwYk30m6dqDc88tMZanzep3+UqsNSWpnAhCPk0iEUDioJUyuNQmoH RRZpbwMwPRD8ATz23XHDuNV917e/qRV2JgThrWRBfmRVz3S/u1tt0iphlBbUDCT10Us8 RnYdnROa7ujFEcbJzFOaJBN1D2TIFvFImYXgIii3v4prupj5THkbiWAS+bka7KGEXLxw SI34aGZBS1Wcr7R4qQfKBOQcwXyu1Mq6niFVQ0Rk91YbUu4wZ3wzdh4QmBfhlnfw89zj p0Ng== MIME-Version: 1.0 Received: by 10.60.2.74 with SMTP id 10mr1541201oes.64.1345035609497; Wed, 15 Aug 2012 06:00:09 -0700 (PDT) Received: by 10.76.24.161 with HTTP; Wed, 15 Aug 2012 06:00:09 -0700 (PDT) In-Reply-To: References: Date: Wed, 15 Aug 2012 09:00:09 -0400 Message-ID: Subject: Re: Production usage of BigCouch and the Future? From: Sean Copenhaver To: user@couchdb.apache.org Content-Type: multipart/alternative; boundary=e89a8fb20340b6deb804c74d81e2 --e89a8fb20340b6deb804c74d81e2 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Excuse me for butting in a bit, but I wanted to point out that real-time is about consistent performance not raw speed. Also CouchDB doesn't do any caching itself. It relies on the filesystem for everything (at least I believe this is still true). Of course the filesystem will cache things for you and Erlang is quite capable of handling concurrent IO and connections. Erlang on a single request performance might not be as fast as other systems, but usually at scale Erlang does quite well. So CouchDB will probably handle it fine honestly that is once built. That much data will take some time to build the views the first time. Having your views in multiple design documents could help... especially if you have to update only one of them at some other time. Now if the read performance is adequate for your needs, you'll have to test. On Wed, Aug 15, 2012 at 8:48 AM, JRad wrote: > Robert, > > Can it handle a 150G view on a Xeon x4 2.6, with 64G memory with 15k disk= s, > without performance degradation? we need couchdb's realtime view reponse = on > 30 concurrent connections! > I don't know details of paging for b+tree in couchdb, but can we achieve = a > (view_size) / (memory) ratio that is performance-safe!? ( this may mean i= t > leads to cover top most levels of b+tree in memory!? ) we estimate about = 1 > billion keys in that 150G! > --=20 =93The limits of language are the limits of one's world. =93 - Ludwig von Wittgenstein "Water is fluid, soft and yielding. But water will wear away rock, which is rigid and cannot yield. As a rule, whatever is fluid, soft and yielding will overcome whatever is rigid and hard. This is another paradox: what is soft is strong." - Lao-Tzu --e89a8fb20340b6deb804c74d81e2--