Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (asf.osuosl.org: domain of markrmiller@gmail.com designates
 66.249.92.170 as permitted sender)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=D9O2aiCIQRSC4bFTTl1a8ZJUrCrg/z71p/pRmqHcLAwqBrsWfyIq4Enk7tFzkcSuU+n3WDHWPolDMnsMIqeymydWO8VbZKHNCA6F+TP35Gi8XwqRHmnsriK7XZ85IKkOLldykvhum4va05Q3a4zuTu2IhocjXALdfT0FgKxVsV0=
Message-ID: <ab0709bf0608211109o1a18793fn53c9244977864924@mail.gmail.com>
Date: Mon, 21 Aug 2006 14:09:55 -0400
From: "Mark Miller" <markrmiller@gmail.com>
To: java-user@lucene.apache.org
Subject: Re: Searching a untokenized field using SnowballAnalyzer
In-Reply-To: <44E9E04E.6090802@bassnet.biz>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_55858_22700943.1156183795128"
References: <44E9E04E.6090802@bassnet.biz>

------=_Part_55858_22700943.1156183795128
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

My guess? When you store those field untokenized, they are untokenized. When
you use the SnowBall analyzer with the query parser and search those
untokenized fields, you're query is tokenized. As you can imagine, a
tokenized search by not match un untokenzied field. Why does this not happen
with StandardAnalyzer? Most likely because StandardAnalyzer does not modify
ferrari during it's processing (in fact I know it does not) while
SnowBallAnalyzer probably does modify ferrari...perhaps to ferrar.

The results:

search query: ferrari
query parser /SnowballAnalyzer: ferrar
query parser /StandardAnalyzer: ferrari

- Mark

On 8/21/06, Lorenzo Di Gaetano <lorenzo.digaetano@bassnet.biz> wrote:
>
> Hi all,
>
> I have the following problem. I use SnowballAnalyzer to index Documents
> containing tokenized and untokenized fields. But when I try to search a
> document using one of the untokenized fields (usually keywords and
> unique identifiers) it doesn't find anything...
>
> Simple exampe of code:
>
> doc.add(new Field("car","ferrari",Field.Store.NO,Field.Index.UN_TOKENIZED
> );
>
> when I try to search it using the following search strings:
>
> car:ferrari
>
> or
>
> car:"ferrari"
>
> it finds nothing.
>
> If I use StandardAnalyzer instead of SnowballAnalyzer it finds the
> Document correctly!!! Even the field name and the field value are
> lowercases, it seems that there is a problem on querying untokenized
> fields using SnowballAnalyzer... The only way I have to find my "car"
> field is using TermQueries...  But  I absolutely need  to make complex
> queries on multiple field values at once.
>
> Please help me! Thank you in advance.
>
> Lorenzo
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

------=_Part_55858_22700943.1156183795128--