Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (hermes.apache.org: local policy)
Mime-Version: 1.0 (Apple Message framework v619.2)
In-Reply-To: <1582287727.20050401180703@keljob.com>
References: <424C0E62.10002@colaborativa.net>
 <297f128e646a94719e98205e5e42c4bc@ehatchersolutions.com>
 <773719179.20050401150918@keljob.com>
 <3e9becd32d830a737fc6da54ea0d1e36@ehatchersolutions.com>
 <1582287727.20050401180703@keljob.com>
Content-Type: text/plain; charset=US-ASCII; format=flowed
Message-Id: <4367f81557fe22108fce438e2b3c0b22@ehatchersolutions.com>
Content-Transfer-Encoding: 7bit
From: Erik Hatcher <erik@ehatchersolutions.com>
Subject: Re: Re[4]: Analyzer don't work with wildcard queries,
 snowball analyzer.
Date: Fri, 1 Apr 2005 12:13:12 -0500
To: java-user@lucene.apache.org

On Apr 1, 2005, at 11:07 AM, Sven Duzont wrote:
> EH> I presume your analyzer normalized accented characters?  Which 
> analyzer
> EH> is that?
>
> Yes, i'm using a custom analyser for indexing / searching, ti consists
> in :
> - FrenchStopFilter
> - IsoLatinFilter (this is the one that will replace accented
> characters)

Could you share that filter with the community?

> EH> You will need to employ some form of character normalization on
> EH> wildcard queries too.
>
> thanks, it works succeffuly, code snippet following
>
> ---
>  sven
>
> /*----------------------- CODE ----------------------------*/
>
> private static Query CreateCustomQuery(Query query)
> {
>   if(query instanceof BooleanQuery)  {
>     final BooleanClause[] bClauses = ((BooleanQuery) 
> query).getClauses();
>
>     // The first clause is required
>     if(bClauses[0].prohibited != true)
>       bClauses[0].required = true;

Why do you flip the required flag like this?

>
>     // Will parse each clause to remove accents if needed
>     Term term;
>     for (int i = 0; i < bClauses.length; i++)    {
>       if(bClauses[i].query instanceof WildcardQuery)      {
>         term = ((WildcardQuery)bClauses[i].query).getTerm();
>         bClauses[i].query = new WildcardQuery(new Term(term.field(),
>             
> ISOLatin1AccentFilter.RemoveAccents(term.text().toLowerCase())));
>       }

What about handling BooleanQuery's nested within a BooleanQuery?  
You'll need some recursion.

	Erik


>       if(bClauses[i].query instanceof PrefixQuery)      {
>         term = ((PrefixQuery)bClauses[i].query).getPrefix();
>         bClauses[i].query = new PrefixQuery(new Term(term.field(),
>             
> ISOLatin1AccentFilter.RemoveAccents(term.text().toLowerCase())));
>       // toLowerCase because the text is lowercased during indexation
>       }
>     }
>   }
>   else if(query instanceof WildcardQuery)  {
>     final Term term = ((WildcardQuery)query).getTerm();
>     query = new WildcardQuery(new Term(term.field(),
>         
> ISOLatin1AccentFilter.RemoveAccents(term.text().toLowerCase())));
>   }
>   else if(query instanceof PrefixQuery)  {
>     final Term term = ((PrefixQuery)query).getPrefix();
>     query = new PrefixQuery(new Term(term.field(),
>         
> ISOLatin1AccentFilter.RemoveAccents(term.text().toLowerCase())));
>   }
>   return query;
> }
>
> /*----------------------- END OF CODE ----------------------------*/
>
> EH> 	Erik
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org