Mailing-List: contact lucy-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: lucy-dev@incubator.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Message-ID: <4EC4FE6B.5010104@aevum.de>
Date: Thu, 17 Nov 2011 13:30:35 +0100
From: Nick Wellnhofer <wellnhofer@aevum.de>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:8.0) Gecko/20111105 Thunderbird/8.0
MIME-Version: 1.0
To: lucy-dev@incubator.apache.org
References: <4EC161D0.1060103@aevum.de>
 <20111114212215.GA26256@rectangular.com> <4EC1C342.7080401@aevum.de>
 <20111115042209.GA27084@rectangular.com> <4EC2D0E5.10909@aevum.de>
 <20111116034932.GA10681@rectangular.com> <4EC43816.1070107@aevum.de>
 <CAOdYfZXm6uPEnirdtZ7X=VFewRQXLfc0oSq3UN_HaNDKCxdAFg@mail.gmail.com>
In-Reply-To: 
 <CAOdYfZXm6uPEnirdtZ7X=VFewRQXLfc0oSq3UN_HaNDKCxdAFg@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Subject: Re: [lucy-dev] Unicode integration

On 17/11/2011 01:46, Robert Muir wrote:
> Does your unicode library also support "NFKC_CaseFold" ? It might be a
> nice default:
>
> # Derived Property:   NFKC_Casefold (NFKC_CF)
> #   This property removes certain variations from characters: case,
> compatibility, and default-ignorables.
> #   It is used for loose matching and certain types of identifiers.
> #   It is constructed by applying NFKC, CaseFolding, and removal of
> Default_Ignorable_Code_Points.
> #   The process of applying these transformations is repeated until a
> stable result is produced.

I'm not sure about the last point but NFKC, CaseFolding, and removal of 
Default_Ignorable_Code_Points are supported.

Nick