lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Simon Willnauer <simon.willna...@gmail.com>
Subject Re: 4.0 tokenStream or SimpleAnalyzer bug?
Date Fri, 02 Nov 2012 07:00:00 GMT
hey scott,

this is intentional see the javadoc step 2:
http://lucene.apache.org/core/4_0_0/core/org/apache/lucene/analysis/TokenStream.html

simon

On Fri, Nov 2, 2012 at 2:07 AM, Scott Smith <ssmith@mainstreamdata.com> wrote:
> I was doing some tokenizer/filter analysis attempting to fix a bug I have in highlighting
under 4.0.  I was running the displayTokensWithFullDetails code from LIA2.  I would get an
exception with a bad index value of -1.
>
> I fixed the problem by doing a reset() immediately after creating my TokenStream object.
 Shouldn't a new TokenStream object be essentially "reset" when created?  This was with SimpleAnalyzer()
(since I suspect that may be relevant).

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message