Mailing-List: contact lucene-net-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: lucene-net-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of itamar.synhershko@gmail.com
 designates 209.85.213.176 as permitted sender)
MIME-Version: 1.0
Sender: itamar.synhershko@gmail.com
In-Reply-To: 
 <CACb34KgSohPe4ivZ2ar66ZJrsbptSs=sZ_brKe5yiqS1VyFuoA@mail.gmail.com>
References: 
 <CACb34KjRLBgJC8wZCa1zwEirVJK4AfAG2CJFMAWygK9BKMMz_g@mail.gmail.com>
	<CC0F4D53.11426%rvesse@dotnetrdf.org>
	<CACb34KjM_v+vT=9r9HWci9fR7kTstzrAMKjecq2Zx4V5Thb4Jw@mail.gmail.com>
	<CAHTr4ZteL0F4kwNep3-dU2nC_GPuKg3GS4N3oJAmEKOwsRpfcQ@mail.gmail.com>
	<AE4CD557E23DE74E901488E2AD8898840824A243@FMSMSX102.amr.corp.intel.com>
	<CACb34KhAv-7motF+B0OqP=SHShimB6tnHT6WTYP4U0jsUc+iCw@mail.gmail.com>
	<AE4CD557E23DE74E901488E2AD8898840824B29F@FMSMSX102.amr.corp.intel.com>
	<CACb34KgSohPe4ivZ2ar66ZJrsbptSs=sZ_brKe5yiqS1VyFuoA@mail.gmail.com>
Date: Wed, 27 Jun 2012 00:18:59 +0300
Message-ID: 
 <CAHTr4Zt1otpabPZF8WN3jTicReyWb_Nkoez_a=i3A7gnFoypzw@mail.gmail.com>
Subject: Re: SPAM-HIGH: Disparity between API usage and Luke
From: Itamar Syn-Hershko <itamar@code972.com>
To: lucene-net-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=e89a8f3b9beb9a0e5d04c366a5f1

--e89a8f3b9beb9a0e5d04c366a5f1
Content-Type: text/plain; charset=ISO-8859-1

It is, if you have any uppercase letters for example. If StandardAnalyzer
is passed to QueryParser and you search on a non-analyzed field, you won't
be able to find it.

On Wed, Jun 27, 2012 at 12:15 AM, Rob Cecil <rob.cecil@gmail.com> wrote:

> Well the field is "Id" - which contains unique, non-recurring terms. So I
> don't think mapping it to Field.Index.ANALYZED makes sense, does it? If it
> is mapped as NOT_ANALYZED, it is still indexed, so should I be able to
> issue a query like "Id:BAUER*" ?
>
> On Tue, Jun 26, 2012 at 3:06 PM, Lingam, ChandraMohan J <
> chandramohan.j.lingam@intel.com> wrote:
>
> > QueryParser has no knowledge of how data was indexed.  For your scenario,
> > I don't believe you would be able to use Query Parser with standard
> > analyzer when data was originally indexed with Field.Index.NOT_ANALYZED
> > option.
> >
> > Interesting question is why is luke working/finding the match?  I would
> > have expected Luke to not find any matches.
> >
> >
> > -----Original Message-----
> > From: Rob Cecil [mailto:rob.cecil@gmail.com]
> > Sent: Tuesday, June 26, 2012 12:54 PM
> > To: lucene-net-user@lucene.apache.org
> > Subject: Re: SPAM-HIGH: Disparity between API usage and Luke
> >
> > I can definitely try that. I just expected QueryParser would respect the
> > case of the source string. I was hoping to avoid using the Query API
> > per-se, and just let the parser to the work for me.
> >
> > On Tue, Jun 26, 2012 at 1:19 PM, Lingam, ChandraMohan J <
> > chandramohan.j.lingam@intel.com> wrote:
> >
> > > >> var query = _parser.Parse("Id:BAUER*");
> > >
> > > In your code, most likely, the value got converted to lower case (i.e.
> > > bauer*) by the parse statement.
> > > Whereas indexed value is in upper case as it is not analyzed (from
> > > screen shot).
> > >
> > > Can you explicitly try using prefix query?
> > >
> > >
> > >
> > > > Same results, apparently, when I use Luke 1.0.1.
> > > >
> > > > When I search for "Id:BAUER*" I get 15 hits in Luke, but in my
> > > > custom app, zero.
> > > >
> > > > On Tue, Jun 26, 2012 at 12:31 PM, Rob Vesse <rvesse@dotnetrdf.org>
> > > wrote:
> > > >
> > > > > You appear to be using Luke 3.5 which per the information on the
> > > > > Luke homepage (http://code.google.com/p/luke/) uses Lucene 3.5
> > > > >
> > > > > Since Lucene.Net is currently on 2.9.4 I wouldn't be surprised to
> > > > > see different behavior between the API and executing in Luke.
> > > > >
> > > > > If you use a version of Luke which more closely aligns with the
> > > > > version
> > > > of
> > > > > Lucene.Net (Luke 1.0.1 uses Lucene 3.0.1 which should be close
> > > > > enough since the 2.9.x releases were previews of the 3.0.x
> > > > > releases as I understood it) what behavior do you see?
> > > > >
> > > > > Hope this helps,
> > > > >
> > > > > Rob
> > > > >
> > > > > On 6/26/12 10:50 AM, "Rob Cecil" <rob.cecil@gmail.com> wrote:
> > > > >
> > > > > >If I run a query against my index using QueryParser to query a
> > field:
> > > > > >
> > > > > >                var query = _parser.Parse("Id:BAUER*");
> > > > > >                var topDocs = searcher.Search(query, 10);
> > > > > >                Assert.AreEqual(count, topDocs.TotalHits);
> > > > > >
> > > > > >I get 0 for my TotalHits, yet in Luke, the same query phrase
> > > > > >yields
> > > > > >15 results, what am I doing wrong? I use the StandardAnalyzer
> > > > > >both to create the index and to query.
> > > > > >
> > > > > >The field is defined as:
> > > > > >
> > > > > >new Field("Id", myObject.Id, Field.Store.YES,
> > > > > >Field.Index.NOT_ANALYZED)
> > > > > >
> > > > > >and is a string field. The result set back from Luke looks like
> > > > > >(screencap):
> > > > > >
> > > > > >http://screencast.com/t/NooMK2Rf
> > > > > >
> > > > > >Thanks!
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
>

--e89a8f3b9beb9a0e5d04c366a5f1--