lucene-solr-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] Commented: (SOLR-1078) WordDelimiterFilter do wrong word breaking for Thai vowel
Date Fri, 08 May 2009 20:52:45 GMT

    [ https://issues.apache.org/jira/browse/SOLR-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12707522#action_12707522
] 

Robert Muir commented on SOLR-1078:
-----------------------------------

i think so, U+005E CIRCUMFLEX ACCENT, U+0060 GRAVE ACCENT, etc.

> WordDelimiterFilter do wrong word breaking for Thai vowel
> ---------------------------------------------------------
>
>                 Key: SOLR-1078
>                 URL: https://issues.apache.org/jira/browse/SOLR-1078
>             Project: Solr
>          Issue Type: Bug
>          Components: Analysis
>    Affects Versions: 1.4
>         Environment: Ubuntu 8.10 64bit
> Java 1.6.0_10
>            Reporter: SIriwat Aumngamsup
>             Fix For: 1.4
>
>         Attachments: SOLR-1078.patch
>
>
> With any configuration of schema.xml
> {code:xml}<filter class="solr.WordDelimiterFilterFactory" />{code}
> will do wrong word breaking with Thai characters.
> ----
> Example: "ผู้ ใหญ่ บ้าน"
> Wrong result: 0 => "ผ", 1 => "ใหญ", 2 => "บ", 3 => "าน"
> Expect result: 0 => "ผู้", 1 => "ใหญ่", 2 => "บ้าน"
> ----
> Example2: "ผู้ใหญ่บ้าน" (no space)
> Wrong result: 0 => "ผ", 1 => "ใหญ", 2 => "บ", 3 => "าน" (same
result)
> Expect result: 0 => "ผู้ใหญ่บ้าน"
> ----
> There's a similar problem with Drupal (http://drupal.org/node/335928)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message