Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of paul_t100@fastmail.fm
 designates 66.111.4.25 as permitted sender)
Message-ID: <5150480C.3070306@fastmail.fm>
Date: Mon, 25 Mar 2013 12:50:20 +0000
From: Paul Taylor <paul_t100@fastmail.fm>
Reply-To: paul_t100@fastmail.fm
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8;
 rv:17.0) Gecko/20130307 Thunderbird/17.0.4
MIME-Version: 1.0
To: "java-user@lucene.apache.org" <java-user@lucene.apache.org>
Subject: Using MappingCharFIlter in analyzer breaking wildcard matches
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

I created this simple StripSpacesAndSeparatorsAnalyzer so that it 
ignores certain characters such as hypens in the field so that I can 
search for

catno:WRATHCD25
catno:WRATHCD-25

and get the same results, and that works (the original value of the 
field added to the index was WRATHCD-25)

However there is a problem with wildcard searching

catno:WRATHCD25*

works, but

catno:WRATHCD-25*

does not

If I amend the analyzer to comment out the initReader() method then

catno:WRATHCD-25*

now works but of course

catno:WRATHCD25

no longer works.


Wham I doing wrong please


public class StripSpacesAndSeparatorsAnalyzer extends Analyzer {

     protected NormalizeCharMap charConvertMap;

     protected void setCharConvertMap() {

         NormalizeCharMap.Builder builder = new NormalizeCharMap.Builder();
         builder.add(" ","");
         builder.add("-","");
         builder.add("_","");
         builder.add(":","");
         charConvertMap = builder.build();
     }

     public StripSpacesAndSeparatorsAnalyzer() {
         setCharConvertMap();
     }

     @Override
     protected TokenStreamComponents createComponents(String fieldName, 
Reader reader) {
         Tokenizer source = new KeywordTokenizer(reader);
         TokenStream filter = new LowercaseFilter(source);
         return new TokenStreamComponents(source, filter);
     }


     @Override
     protected Reader initReader(String fieldName,
                                 Reader reader)
     {
         return new MappingCharFilter(charConvertMap, reader);
     }
}

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org