lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Miller (JIRA)" <>
Subject [jira] Commented: (LUCENE-1758) improve arabic analyzer: light8 -> light10
Date Tue, 04 Aug 2009 23:30:14 GMT


Mark Miller commented on LUCENE-1758:

Its not released, but Arabic Analyzer has been around long enough thats its certainly in use
by at least a couple people - lets be very explicit in the contrib changes (which I'm sure
non of these users will read ;) ) about the lowercase compat break.

> improve arabic analyzer: light8 -> light10
> ------------------------------------------
>                 Key: LUCENE-1758
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: contrib/analyzers
>            Reporter: Robert Muir
>            Assignee: Robert Muir
>            Priority: Minor
>             Fix For: 2.9
>         Attachments: LUCENE-1758.patch, LUCENE-1758.patch, LUCENE-1758.txt
> Someone mentioned on the java user list that the arabic analysis was not as good as they
would like.
> This patch adds the لل- prefix (light10 algorithm versus light8 algorithm).
> In the light10 paper, this improves precision from .390 to .413
> They mention this is not statistically significant, but it makes linguistic sense and
at least has been shown not to hurt.
> In the future, I hope openrelevance will allow us to try some more approaches. 

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message