Return-Path: Delivered-To: apmail-couchdb-user-archive@www.apache.org Received: (qmail 27668 invoked from network); 6 Jun 2010 10:21:52 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 6 Jun 2010 10:21:52 -0000 Received: (qmail 69544 invoked by uid 500); 6 Jun 2010 10:21:51 -0000 Delivered-To: apmail-couchdb-user-archive@couchdb.apache.org Received: (qmail 69310 invoked by uid 500); 6 Jun 2010 10:21:48 -0000 Mailing-List: contact user-help@couchdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@couchdb.apache.org Delivered-To: mailing list user@couchdb.apache.org Received: (qmail 68936 invoked by uid 99); 6 Jun 2010 10:21:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 06 Jun 2010 10:21:47 +0000 X-ASF-Spam-Status: No, hits=0.1 required=10.0 tests=AWL,FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of robert.newson@gmail.com designates 74.125.82.180 as permitted sender) Received: from [74.125.82.180] (HELO mail-wy0-f180.google.com) (74.125.82.180) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 06 Jun 2010 10:21:42 +0000 Received: by wyb34 with SMTP id 34so2616770wyb.11 for ; Sun, 06 Jun 2010 03:21:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type; bh=K3obg4ZvAiu3GLpJ/kB3rEhddUUddj9lgGnMQ/pWN0c=; b=fBr474JZWmZEN+/aV6IZiloB4Q9757AV5MNSGT6uPDKJIY+xdYK3IYIdvFC0hY+30N PHCwSPl7wP0bxF2idh35n496D7sVYG+SBzK/3hHbuApDJC/0kwAk5W0NF5IIeCXimLiz Vioy7dbJbHdo3XVOc5TFW4tEbHFqiYrejzhJ4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=ommNCJ1vtAec9LZLOnlHEjhS2nQM4EbaHXCCFmF15M5F3vgUPBNXmq+vuXz/RHgZGO bP9nwSEvHP8UuqreHSWO0emHVlf7+43XYyR506nSju8bywKAR+IvAOpLnWXaNnqaGGi3 JzwVx9ncXHC4HQTdZzGcXAg+VHa2DwqSXmhaI= MIME-Version: 1.0 Received: by 10.216.160.132 with SMTP id u4mr1146206wek.19.1275819681087; Sun, 06 Jun 2010 03:21:21 -0700 (PDT) Received: by 10.216.20.136 with HTTP; Sun, 6 Jun 2010 03:21:21 -0700 (PDT) In-Reply-To: References: Date: Sun, 6 Jun 2010 11:21:21 +0100 Message-ID: Subject: Re: clucene and couchdb From: Robert Newson To: user@couchdb.apache.org Content-Type: text/plain; charset=ISO-8859-1 The concurrency fix was simple. I had forgotten that QueryParser was not thread-safe and had allowed multiple threads to access the same instance concurrently. ApacheBench now confirms that concurrent searching works as expected. You couldn't trigger these problems via the Python script, since that serializes all requests, but my main motivation for moving couchdb-lucene onto its own port in 0.5 was to allow direct, concurrent querying. B. On Sun, Jun 6, 2010 at 4:53 AM, Norman Barker wrote: > Itamar, > > I posted on clucene, one of the main problems is that Java Lucene > allows storing UserData which CLucene doesn't, this allows the couchdb > seq_num to be stored in the Lucene index keeping it in synch. > > Robert, can you expand on the concurrency fix, surely stdin / stdout > is still the bottle neck? > > Norman > > On Sat, Jun 5, 2010 at 4:12 PM, Jarrod Roberson wrote: >> On Fri, Jun 4, 2010 at 5:49 PM, Robert Newson wrote: >> >>> Everything I have testwise is at http://github.com/rnewson/couchdb-lucene >>> >>> I understand the reluctance to pull in the Java Virtual Machine just >>> to use Lucene but, in my experience, there's no other comparable >>> library for features or performance, including clucene. >>> >>> >> then you haven't seen Xapian then, much better choice if you aren't already >> using Java. >> >