Mailing-List: contact general-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: general@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of uwe@thetaphi.de designates
 188.138.97.18 as permitted sender)
From: "Uwe Schindler" <uwe@thetaphi.de>
To: <general@lucene.apache.org>
References: <004d01ccad9c$9ed9f790$dc8de6b0$@comcast.net>
In-Reply-To: <004d01ccad9c$9ed9f790$dc8de6b0$@comcast.net>
Subject: RE: MaxFieldLength in Lucene 3.4
Date: Mon, 28 Nov 2011 08:40:50 +0100
Message-ID: <001601ccada1$0d5fbde0$281f39a0$@thetaphi.de>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="US-ASCII"
Content-Transfer-Encoding: 7bit
Thread-Index: AQFIDc80bskyhLxfAFOHGpsHysVV0ZbLIz4g
Content-Language: de

Hi,

The move is simple - LimitTokenCountAnalyzer is just a wrapper around any
other Analyzer, so I don't really understand your question - of course all
other analyzers are unlimited. If you have myAnalyzer with
myMaxFieldLengthValue used before, you can change your code as follows:
 
Before:
new IndexWriter(dir, new IndexWriterConfig(Version.LUCENE_34,
myAnalyzer).setFoo().setBar().setMaxFieldLength(myMaxFieldLengthValue));

After:
new IndexWriter(dir, new IndexWriterConfig(Version.LUCENE_34, new
LimitTokenCountAnalyzer(myAnalyzer,
myMaxFieldLengthValue)).setFoo().setBar());

You only have to do this on the indexing side, on the query side
(QueryParser) just use myAnalyzer without wrapping. With the new code, the
responsibilities for cutting the field after a specific number of tokens was
moved out out the indexing code in Lucene. This is now just an analysis
feature not a indexing feature anymore.

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de

> -----Original Message-----
> From: Joe MA [mailto:mrjama@comcast.net]
> Sent: Monday, November 28, 2011 8:09 AM
> To: general@lucene.apache.org
> Subject: MaxFieldLength in Lucene 3.4
> 
> While upgrading to Lucene 3.4, I noticed the MaxFieldLength values on the
> indexers are deprecated.   There appears to be a LimitTokenCountAnalyzer
> that limits the tokens - so does that mean the default for all other
analyzers is
> unlimited?
> 
> Thanks in advance -
> JM