lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-1958) ShingleFilter creates shingles across two consecutives documents : bug or normal behaviour ?
Date Fri, 09 Oct 2009 18:29:31 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12764141#action_12764141
] 

Robert Muir commented on LUCENE-1958:
-------------------------------------

MRIT64, actually I am not curious about next(reusableToken), but instead whether your Analyzer
implements 

{code}
public TokenStream reusableTokenStream(String fieldName, Reader reader) throws IOException
{code}

If you were trying to reuse ShingleFilters in 2.4.1 with this technique, I think this would
be unsafe. It is safe in 2.9

bq. Anyway, it doesnt' matter know because the problem doesnt occur with Lucene 2.9.

Ok to mark this issue as resolved?


> ShingleFilter creates shingles across two consecutives documents : bug or normal behaviour
?
> --------------------------------------------------------------------------------------------
>
>                 Key: LUCENE-1958
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1958
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/analyzers
>    Affects Versions: 2.4.1
>         Environment: Windows XP / jdk1.6.0_15
>            Reporter: MRIT64
>            Priority: Minor
>
> HI
> I add two consecutive documents that are indexed with some filters. The last one is ShingleFilter.
> ShingleFilter creates a shingle spannnig the two documents, which has no sense in my
context.
> Is that a bug oris it  ShingleFilter normal behaviour ? If it's normal behaviour, is
it possible to change it optionnaly ?
> Thanks
> MR

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message