Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of erickerickson@gmail.com
 designates 209.85.219.217 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=Kpyr6QPpysUr1rzxl3+e1kYkEDuhg3CoZc398LvX3i1KGikn/MG0q6z59WvPyacfif
         BaVr0gO2YN1WkxlLzgbTuUDIG9eSXwHkGxBLIQIh1lrpOlcPa2m3lK0/l6uJvrwxuF83
         ZV54AvDg5zQ9mvCCH47l7wQ0eb/skxO+WiiS0=
MIME-Version: 1.0
In-Reply-To: <4B1198A3.2030106@gmx.de>
References: <4B0D6FEC.7080508@gmx.de>
	 <359a92830911251011s3fd4df94ye432e482e08bc22e@mail.gmail.com>
	 <8c4e68610911251208q12a77a47wbe89291d8ba10025@mail.gmail.com>
	 <4B1198A3.2030106@gmx.de>
Date: Sun, 29 Nov 2009 13:34:31 -0500
Message-ID: <359a92830911291034v30055082mca31bbbba0a97a6a@mail.gmail.com>
Subject: Re: Problem with a "." for searching Lucene 2.4.0
From: Erick Erickson <erickerickson@gmail.com>
To: java-user@lucene.apache.org, info@soebes.de
Content-Type: multipart/alternative; boundary=0016e6d9746e96cbd8047986c620

--0016e6d9746e96cbd8047986c620
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

See below

On Sat, Nov 28, 2009 at 4:39 PM, Karl Heinz Marbaise <khmarbaise@gmx.de>wro=
te:

> Hi Ian,
>
> many thanks for the hints...based on your and Ericks hints i have taken a
> deeper look into that...and the StandardAnalyzer which I'm using will
> removed informations like "." and "-" from my queries
> (+filename:testEXCEL-formats.xls) ...
>
>
Here's the first issue. I wouldn't use StandardAnalyzer here at all. You're
taking an analyzer
that's not intended to handle file names (actually, it's intended to try to
preserve
emails, etc) and then having to compensate for it's actions in your
queryparser.
PerFieldAnalyzerWrapper can be used both at index and query time to parse
different fields with different analyzers.

Rather, I'd create my own analyzer from the tokenizers and tokenfilters
Lucene
provides that do what I want. Say a LowerCaseFilter and WhiteSpaceAnalyzer
or something. Use that analyzer for indexing and querying...


>
>  In addition to Erick's advice, since you are storing filename without
>> analysis you could use a TermQuery to find it.
>>
> Does this mean i don't need to index the filename ?
>
>
Indexing and storing are orthogonal. That is, if you want to search
on something, you MUST index it. Storing it is simply putting an
un-analyzed copy in your Document so you can easily display
the original data.


>
> > You can use
>
>> BooleanQuery to combine that with other queries, including those
>> generated by QueryParser.
>>
>>  Based on those advices i have made an implementation which modifies my
> CustomerQueryParser:
>
>
Rather than do this, I'd re-use a custom analyzer (see above, and assuming
that you
can't use one of the standard analyzers) and just escape the relevant
characters
before feeding them to the query parser. The Lucene Wiki has a list of
characters
that need escaping I'm pretty sure. But see QueryParser.escape....


> protected Query getFieldQuery(String field, String term) throws
> ParseException {
>  LOGGER.debug("getFieldQuery(): field:" + field + " Term: " + term)
>  if (FieldNames.REVISION.getValue().equals(field)) {
>        int revision =3D Integer.parseInt(term);
>        term =3D NumberUtils.pad(revision);
>  }
>
>  if (FieldNames.FILENAME.getValue().equals(field)) {
>    Term t =3D new Term(FieldNames.FILENAME.getValue(), term.toLowerCase()=
);
>    TermQuery tq =3D new TermQuery (t);
>    BooleanQuery bq =3D new BooleanQuery ();
>    bq.add(tq, Occur.MUST);
>    return bq;
>  }
> return super.getFieldQuery(field, term);
> }
>
> Based on my Unit Tests it works as expected...
>
> But I'm not sure to understand the things like "queryparts -filename:*.xl=
s"
> correct..
>
>
If you can use analyzers as above, you'll save yourself a lot of work by
letting Lucene
do the heavy lifting <G>...

Best
Erick


> Doesn't that mean that my implementation will change the behaviour into t=
he
> following:
>
> "queryparts +filename:*.xls" or did i misunderstand things here ?
>
>
> Thanks for your help...
>
>
> Kind regards
> Karl Heinz Marbaise
> --
> SoftwareEntwicklung Beratung Schulung    Tel.: +49 (0) 2405 / 415 893
> Dipl.Ing.(FH) Karl Heinz Marbaise        ICQ#: 135949029
> Hauptstrasse 177                         USt.IdNr: DE191347579
> 52146 W=FCrselen                           http://www.soebes.de
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

--0016e6d9746e96cbd8047986c620--