Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 9452 invoked from network); 11 Apr 2009 14:03:06 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 11 Apr 2009 14:03:06 -0000 Received: (qmail 56230 invoked by uid 500); 11 Apr 2009 14:03:03 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 56155 invoked by uid 500); 11 Apr 2009 14:03:03 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 56143 invoked by uid 99); 11 Apr 2009 14:03:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Apr 2009 14:03:03 +0000 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [209.85.200.172] (HELO wf-out-1314.google.com) (209.85.200.172) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Apr 2009 14:02:55 +0000 Received: by wf-out-1314.google.com with SMTP id 29so1400762wff.20 for ; Sat, 11 Apr 2009 07:02:34 -0700 (PDT) MIME-Version: 1.0 Received: by 10.142.14.18 with SMTP id 18mr1815933wfn.304.1239458554220; Sat, 11 Apr 2009 07:02:34 -0700 (PDT) In-Reply-To: <63e2e4460904110621s78163340pbf88a99831678ec3@mail.gmail.com> References: <70422ecc0904100738v23806a91gba4fca747ba3748f@mail.gmail.com> <70422ecc0904101020k17cab6a8xe2365c1f2b5156b3@mail.gmail.com> <9ac0c6aa0904101054o6cbfe83dhe0f2956151580f53@mail.gmail.com> <70422ecc0904110006v35fdc65q77b939f849606b98@mail.gmail.com> <85719C3168944A0DA8698E10398B86FE@VEGA> <70422ecc0904110227u7870fb51wc20b9fc6501f35a6@mail.gmail.com> <9ac0c6aa0904110248s4fbf83b6nafd28cc9b16b0c46@mail.gmail.com> <63e2e4460904110304n51de11f9m1f0daaa1e84db680@mail.gmail.com> <9ac0c6aa0904110450h4d69905aw1f6d093698bb2528@mail.gmail.com> <63e2e4460904110621s78163340pbf88a99831678ec3@mail.gmail.com> Date: Sat, 11 Apr 2009 10:02:34 -0400 Message-ID: <9ac0c6aa0904110702s5619926bpaab0c950c6d617d5@mail.gmail.com> Subject: Re: RangeFilter performance problem using MultiReader From: Michael McCandless To: java-user@lucene.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Ahhh, OK, perhaps that explains the sizable perf difference you're seeing w/ optimized vs not. I'm curious to see the results of your "merge each month into 1 index" test... Mike On Sat, Apr 11, 2009 at 9:21 AM, Roberto Franchini wrote: > On Sat, Apr 11, 2009 at 1:50 PM, Michael McCandless > wrote: >> Hmm then I'm a bit baffled again. >> >> Because, each of your "by month" indexes presumably has a unique >> subset of terms for the "date_doc" field? =A0Meaning, a given "by month" >> index will have all date_doc corresponding to that month, and a >> different "by month" index would presumably have no overlap in the >> terms for the date_doc field. > > Yes and no :) In this situation: > >>> 200901-->index1, index2 >>> 200902-->index3 >>> 200903-->index4,index5,index6 > > each month does not overlap with each other, but index1 and index2 > overlap, and so index4 with 5 and 6. So there's overlapping inside a > single month. > So I want to trie, next week, this one: >>> 200901-->index12 (merge of 1 and 2) >>> 200902-->index3 >>> 200903-->index456 (merge of 4,5,6) > > This way we avoid overlapping inside a single month. Maybe this can > help: stay tuned :) > R. > > > -- > Roberto Franchini > http://www.celi.it > http://www.blogmeter.it > http://www.memesphere.it > Tel +39-011-6600814 > jabber:ro.franchini@gmail.com skype:ro.franchini > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org