lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lance Norskog (JIRA)" <>
Subject [jira] [Commented] (LUCENE-2899) Add OpenNLP Analysis capabilities as a module
Date Wed, 06 Jun 2012 08:45:23 GMT


Lance Norskog commented on LUCENE-2899:

I consider the code and feature set mostly cooked as a first release. The toolkit as is lets
you do two things:
# Do named entity recognition and filter out names for an autosuggest dictionary
# Pick nouns and verbs out of text and only index those. This gives you a field with a smaller
more focused set of terms. MoreLikeThis might work better.

Please review it for design, bugs, code nits, whatever.

> Add OpenNLP Analysis capabilities as a module
> ---------------------------------------------
>                 Key: LUCENE-2899
>                 URL:
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: modules/analysis
>            Reporter: Grant Ingersoll
>            Priority: Minor
>         Attachments: opennlp_trunk.patch
> Now that OpenNLP is an ASF project and has a nice license, it would be nice to have a
submodule (under analysis) that exposed capabilities for it. Drew Farris, Tom Morton and I
have code that does:
> * Sentence Detection as a Tokenizer (could also be a TokenFilter, although it would have
to change slightly to buffer tokens)
> * NamedEntity recognition as a TokenFilter
> We are also planning a Tokenizer/TokenFilter that can put parts of speech as either payloads
(PartOfSpeechAttribute?) on a token or at the same position.
> I'd propose it go under:
> modules/analysis/opennlp

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message