lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Muir <rcm...@gmail.com>
Subject Re: Aligning text analyses, with and without stopwords
Date Thu, 26 Jul 2012 18:23:15 GMT
On Thu, Jul 26, 2012 at 12:16 PM, Johannes Neubarth <jneubarth@imooty.eu> wrote:

> For stopwords that are at the end of the tokenStream (e.g. "them"), the
> positionIncrement is not updated - after leaving the while-loop,
> skippedTokens is 0. My workaround is to append a unique number to every
> input text, so that every text ends with a non-stopword. Can you think
> of a more reasonable approach?
>

Personally I consider this a bug:
https://issues.apache.org/jira/browse/LUCENE-3849

-- 
lucidimagination.com

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message