Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of paul_t100@fastmail.fm
 designates 66.111.4.25 as permitted sender)
Message-ID: <4B1D6A14.8020304@fastmail.fm>
Date: Mon, 07 Dec 2009 20:48:20 +0000
From: Paul Taylor <paul_t100@fastmail.fm>
Reply-To: paul_t100@fastmail.fm
User-Agent: Thunderbird 2.0.0.23 (Macintosh/20090812)
MIME-Version: 1.0
To: Lucene Users <java-user@lucene.apache.org>
Subject: Looking for a MappingCharFilter that accepts regular expressions
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

I want my search to treat 'No. 1' and 'No.1' the same, because in our 
context its one token I want 'No. 1' to become 'No.1',  I need to do 
this before tokenizing because the tokenizer would split one value into 
two terms and one into just one term. I already use a NormalizeMapFilter 
to map &' to 'and' but I think it only takes literal text and I need to

1. be case insensitive (but lowercasefilter is only applied after 
tokenizing)

2. cope with all numbers e.g no. 109

So I was going to subclass BaseCharFilter and do my matches with a 
regular expression like ([Nn]+[Oo]+\\.) ([0-9]+) but I'm struggling to 
understand the offset methods you have to do once you get a match. Has 
anyone already got a regular expression Charfilter OR am I approaching 
this all wrong

thanks Paul


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org