Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 91772 invoked from network); 6 Jan 2010 21:07:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 6 Jan 2010 21:07:54 -0000 Received: (qmail 94219 invoked by uid 500); 6 Jan 2010 21:07:53 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 94139 invoked by uid 500); 6 Jan 2010 21:07:53 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 94129 invoked by uid 99); 6 Jan 2010 21:07:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jan 2010 21:07:53 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mike@cloudant.com designates 67.207.148.201 as permitted sender) Received: from [67.207.148.201] (HELO ycdev.cloudant.com) (67.207.148.201) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jan 2010 21:07:44 +0000 Received: from D-172-25-100-84.dhcp4.washington.edu (b172-25-100-0.nat.washington.edu [205.175.113.100]) (Authenticated sender: mike) by ycdev.cloudant.com (Postfix) with ESMTPSA id 196EE144360 for ; Wed, 6 Jan 2010 21:07:23 +0000 (UTC) Message-Id: <43BDC8E4-8272-46CC-87F0-A78B279D0A3C@cloudant.com> From: Michael Miller To: user@couchdb.apache.org In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v936) Subject: Re: Building IFI View for Text Queries Date: Wed, 6 Jan 2010 13:07:22 -0800 References: X-Mailer: Apple Mail (2.936) X-Virus-Checked: Checked by ClamAV on apache.org And please note that you can compact that view index as well. For documents that are frequently updated, you will see a huge gain in both space, build, and query performance by compacting the view indices (at least based on our experiences at cloudant). Also, there was some work on implementations of various tokenizers in JS, but for the life of me I can't find the link to the code anymore. -Mike On Jan 6, 2010, at 1:01 PM, Chris Anderson wrote: > > there is actually a separate index directory called > > .my_db_name_design/ > > inside that directory. within it is 1 index file per design document. > that file size is the actual index size.