Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
MIME-Version: 1.0
In-Reply-To: <CAB1V9m4EFVFaeF62jEncZom9LF=Lb4HMDtTCK3gcZnexG1o=mg@mail.gmail.com>
References: <CAB1V9m7EKmaHEb8B6mcaKJJ-YbAU5YNv74faeHZQPt4ypy=Wdg@mail.gmail.com>
 <205847485.449706.1506514653255@mail.yahoo.com> <CAB1V9m6ZUxekcRUTGjbMw1C_ycGnmQiCod7vYfmurasaYSKTrg@mail.gmail.com>
 <974674c4-192c-f1c4-46e1-4f7df49f852a@rondhuit.com> <CAB1V9m7Amwk_fOtUQ4ApuME_1DhyHKt+kH-NUXYpF7CkO02+Xw@mail.gmail.com>
 <CAB1V9m4EFVFaeF62jEncZom9LF=Lb4HMDtTCK3gcZnexG1o=mg@mail.gmail.com>
From: Chitra <chithu.r111@gmail.com>
Date: Tue, 24 Oct 2017 17:46:58 +0530
Message-ID: <CAB1V9m5TBky3q4t0W2qZnDo=izq=oemRQwb5FgtLtsSGAX1Dpg@mail.gmail.com>
Subject: Re: Accent insensitive search for greek characters
To: Lucene Users <java-user@lucene.apache.org>
Content-Type: multipart/alternative; boundary="94eb2c1c1742a3224f055c49eb51"
archived-at: Tue, 24 Oct 2017 12:17:26 -0000

--94eb2c1c1742a3224f055c49eb51
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi,
                   ICUTransformFilter is working fine for greek characters
alone as per requirement. but one case it's breaking( =CF=83 & =CF=82 are t=
he lower
forms of =CE=A3 Sigma).

*Example:*

I indexed the terms =CF=80=CE=B5=CE=BB=CE=AC=CF=84=CE=B7=CF=82 (indexed as =
=CF=80=CE=B5=CE=BB=CE=B1=CF=84=CE=B7=CF=82) & =CF=80=CE=B5=CE=BB=CE=AC=CF=
=84=CE=B7=CE=A3 (indexed as
=CF=80=CE=B5=CE=BB=CE=B1=CF=84=CE=B7=CF=82).I get the expected search resul=
ts if I perform the search for
=CF=80=CE=B5=CE=BB=CE=AC=CF=84=CE=B7=CE=A3 (or) =CF=80=CE=B5=CE=BB=CE=AC=CF=
=84=CE=B7=CF=82 (or) any combinations of upper case & lower case Greek
characters. But if I search as =CF=80=CE=B5=CE=BB=CE=B1=CF=84=CE=B7=CF=83 I=
 won't get any search results.

In Greek, =CF=83 & =CF=82 are the lower forms of =CE=A3 Sigma. And this cas=
e is solved in
ICUFoldingFilter.


Is ICU Transliterator rule formed right? Kindly look at the below code


TokenStream tok =3D new ICUTransformFilter(tok,
Transliterator.getInstance("Greek;
> Lower; NFD; [:Nonspacing Mark:] Remove; NFC;"));


Kindly help me to resolve this.


Regards,
Chitra

--94eb2c1c1742a3224f055c49eb51--