Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Date: Thu, 22 Mar 2012 10:00:22 +0000 (UTC)
From: "Christian Moen (Created) (JIRA)" <jira@apache.org>
To: dev@lucene.apache.org
Message-ID: <30354453.1740.1332410422301.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Created] (LUCENE-3901) Add katakana filter to better deal
 with katakana spelling variants
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Add katakana filter to better deal with katakana spelling variants
------------------------------------------------------------------

                 Key: LUCENE-3901
                 URL: https://issues.apache.org/jira/browse/LUCENE-3901
             Project: Lucene - Java
          Issue Type: New Feature
          Components: modules/analysis
            Reporter: Christian Moen
             Fix For: 3.6, 4.0


Many Japanese katakana words end in a long sound that is sometimes optional=
.

For example, =E3=83=91=E3=83=BC=E3=83=86=E3=82=A3=E3=83=BC and =E3=83=91=E3=
=83=BC=E3=83=86=E3=82=A3 are both perfectly valid for "party".  Similarly w=
e have =E3=82=BB=E3=83=B3=E3=82=BF=E3=83=BC and =E3=82=BB=E3=83=B3=E3=82=BF=
 that are variants of "center" as well as =E3=82=B5=E3=83=BC=E3=83=90=E3=83=
=BC and =E3=82=B5=E3=83=BC=E3=83=90 for "server".

I'm proposing that we add a katakana stemmer that removes this long sound i=
f the terms are longer than a configurable length.  It's also possible to a=
dd the variant as a synonym, but I think stemming is preferred from a ranki=
ng point of view.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrato=
rs: https://issues.apache.org/jira/secure/ContactAdministrators!default.jsp=
a
For more information on JIRA, see: http://www.atlassian.com/software/jira

       
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org