Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 83236 invoked from network); 6 Jan 2010 06:51:06 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 6 Jan 2010 06:51:06 -0000 Received: (qmail 80457 invoked by uid 500); 6 Jan 2010 06:51:04 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 80388 invoked by uid 500); 6 Jan 2010 06:51:04 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 80378 invoked by uid 99); 6 Jan 2010 06:51:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jan 2010 06:51:04 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of farhang@gmail.com designates 74.125.78.26 as permitted sender) Received: from [74.125.78.26] (HELO ey-out-2122.google.com) (74.125.78.26) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jan 2010 06:50:56 +0000 Received: by ey-out-2122.google.com with SMTP id 9so3372412eyd.3 for ; Tue, 05 Jan 2010 22:50:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=NBr+Ni2s2JEJI9G3/x3rRt8MPKwl2tcHCdQVF7Pc/pM=; b=Gr3wuPPoLInUYQg+ZQ35T8OXASM4tj+58G44hekQSEgd6dT7nyRY5ESFEfb3nK9pO7 69m1xncQpWl5/Hr/APl+LWxhklAFvyP33CawlxngoUx4+gTTu7WqNCwFchrqaUHTtosD UZxt6AYJG5AojE+vSb1c0IA2fEwUajq1vMGIc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=os6PSYocfE+TjbTdq3JH0eGCcnrlMeXWu1lldnI+7S7Wz1RNuxLHmiQMeuoN1Mii7Y jK3PQ5mTdrmPX0+PXCId9kag1RnwWdRFAocBmeAsFHxtgZ+KRTszWfj5Ue3pmZfJw1Sg tHb06EfPhA1k0OeJdxhCuYZpdd1kB7NoxnBL8= MIME-Version: 1.0 Received: by 10.216.91.69 with SMTP id g47mr10389005wef.167.1262760634297; Tue, 05 Jan 2010 22:50:34 -0800 (PST) In-Reply-To: <4B442D77.9030006@gmail.com> References: <9ac0c6aa1001051200v224a8ad3p5dcb1bc00807bcd9@mail.gmail.com> <4B442D77.9030006@gmail.com> Date: Tue, 5 Jan 2010 23:50:34 -0700 Message-ID: Subject: Re: Switching from Store.YES to Store.NO From: Babak Farhang To: java-user@lucene.apache.org Content-Type: text/plain; charset=ISO-8859-1 I'm curious (:-)) about what do you mean by *adjusted*? Also, not sure I have the nomenclature here right, but isn't indexing functionally separate from merging segments? (You *index* to a segment which may, or may not, be later *merged* with other segments, no?) On Tue, Jan 5, 2010 at 11:28 PM, Chris Lu wrote: > Just curious, will it be adjusted during indexing when merging segments? > > Thanks! > > -- > Chris Lu > ------------------------- > Instant Scalable Full-Text Search On Any Database/Application > site: http://www.dbsight.net > demo: http://search.dbsight.com > Lucene Database Search in 3 minutes: > http://wiki.dbsight.com/index.php?title=Create_Lucene_Database_Search_in_3_minutes > DBSight customer, a shopping comparison site, (anonymous per request) got > 2.6 Million Euro funding! > > > Michael McCandless wrote: >> >> Making that switch is fine. >> >> The change will not be retroactive, ie, all previously indexed docs >> with Store.YES will continue to store their fields. But new docs >> won't store their fields if you specify Store.NO. >> >> I don't think this (what happens when certain schema changes happen >> mid-indexing) is well documented, in general. >> >> Mike >> >> On Tue, Jan 5, 2010 at 12:01 PM, Babak Farhang wrote: >> >>> >>> Hi, >>> >>> A review of the requirements of the project I'm working on has led us >>> to conclude that going forward we don't need Lucene to store certain >>> field values--just index. Owing to the large size of the data, we >>> can't really afford to reindex everything, (Going forward, we plan to >>> treat these fields as if they were never stored.) Which brings up my >>> question. What effect, if any, does switching to Store.NO have when >>> existing documents in the index already use Store.YES for that field? >>> Will the change take effect for the new docs added to the index? Are >>> there any side-effects to consider? >>> >>> Also, more generally, since the Lucene API does not guard against >>> changing the document "schema" as the index is being built, I imagine >>> the effects of such mid-stream "schema" changes might be documented >>> somewhere. Please share, if you know of such a document. >>> >>> Regards, >>> -Babak >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >>> For additional commands, e-mail: java-user-help@lucene.apache.org >>> >>> >>> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >> For additional commands, e-mail: java-user-help@lucene.apache.org >> >> > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org