Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: local policy)
From: "Allison, Timothy B." <tallison@mitre.org>
To: "java-user@lucene.apache.org" <java-user@lucene.apache.org>, Darin McBeath
	<ddmcbeath@yahoo.com>
Subject: RE: SpanQuery not working as expected
Thread-Topic: SpanQuery not working as expected
Thread-Index: AQHPgRRLhukFaSErPUGKSEChrTwJj5tkHr8A
Date: Fri, 6 Jun 2014 14:12:29 +0000
Message-ID: <1D06A081892ADF4589BD83EE24B9DC3025960939@IMCMBX02.MITRE.ORG>
References: <1402010208.4859.YahooMailNeo@web141002.mail.bf1.yahoo.com>
In-Reply-To: <1402010208.4859.YahooMailNeo@web141002.mail.bf1.yahoo.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Hi Darin,

Have you thought about using multivalued fields?  If you set the positionIn=
crementGap to something kind of big (well > 1, say :) ), and you know that =
your data is always authorfirst, authorlast,  you could just search for "da=
rin fulford".

The positionincrementgap will prevent matching on doc2 below.

Doc1
Authorsfield:
	Darin fulford

Doc2=20
Authorsfield:
	Matilda darin
	Fulford alexandria

Don't get me wrong, I love the capabilities of SpanQuery, but will this sim=
ple solution meet your needs?


-----Original Message-----
From: Darin McBeath [mailto:ddmcbeath@yahoo.com.INVALID]=20
Sent: Thursday, June 05, 2014 7:17 PM
To: java-user@lucene.apache.org
Subject: SpanQuery not working as expected

I read through the=A0http://searchhub.org/2009/07/18/the-spanquery/=A0which=
 provided a good overview for how one can construct fairly complex span que=
ries. =A0I was particularly interested in the ability to construct nested s=
pan queries. =A0I'm trying to apply this concept to search a field that con=
tains some structure (as below). =A0I have a couple of other fields that wi=
ll have a bit more nesting, but this should give the general idea. =A0

authors
=A0 author [one or more]
=A0 =A0 first name
=A0 =A0 last name

Prior to indexing the content with Lucene, I added some 'markers' around th=
e various bits I might want to search. =A0For example 'bauthor' implies beg=
inning author, 'eauthor' implies ending author, and 'sauthor' implies a sep=
arator between individual authors (that would be used as part of the exclud=
e clause in a not span query). =A0I do similar things for 'first name' and =
'last name'.

My constructed query (as interpreted by Lucene) is included below. =A0This =
was extracted from the 'parsed string' returned from the query when I set d=
ebug=3Dtrue. =A0Within a given 'authscope' field, I'm trying to find a situ=
ation where the author first name is 'darin' and the last name is 'fulford'=
 within a given 'author'. =A0=A0

spanNot(
=A0 =A0 spanNear(
=A0 =A0 =A0 =A0 [authscope:bauthor,=A0
=A0 =A0 =A0 =A0 spanNear(
=A0 =A0 =A0 =A0 =A0 =A0 [spanNot(
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 spanNear(
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 [authscope:bfname,=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 authscope:darin,=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 authscope:efname],=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 2147483647, true),=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 authscope:sfname, 0, 0),=A0
=A0=A0 =A0 =A0 =A0 =A0 =A0 spanNot(
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 spanNear(
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 [authscope:blname,=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 authscope:fulford,=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 authscope:elname],=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 2147483647, true),=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 authscope:slname, 0, 0)],=A0
=A0=A0 =A0 =A0 =A0 =A0 =A0 2147483647, false),=A0
=A0=A0 =A0 =A0 =A0 authscope:eauthor],=A0
=A0=A0 =A0 =A0 =A0 2147483647, true),=A0
=A0=A0 =A0 authscope:sauthor, 0, 0)",

I have loaded the following =A02 documents into my index.

[
=A0=A0{"id":"1",=A0"authscope":" bauthors=A0 bauthor blname=A0mcbeath elnam=
e slname=A0 bfname=A0 darin efname sfname=A0 eauthor sauthor=A0 bauthor bln=
ame=A0 fulford elname slname=A0 bfname=A0 darby efname sfname=A0 eauthor sa=
uthor=A0 bauthor blname=A0 mcbeath elname slname=A0 bfname=A0 darby efname =
sfname=A0 eauthor sauthor=A0 eauthors sauthors "},
=A0=A0{"id":"2",=A0"authscope":" bauthors=A0 bauthor blname=A0 mcbeath elna=
me slname=A0 bfname=A0 darin efname sfname=A0 eauthor sauthor=A0 bauthor bl=
name=A0 fulford elname slname=A0 bfname=A0 darin efname sfname=A0 eauthor s=
author=A0 eauthors sauthors "}
]

What I can't figure out is why the above query would match on both document=
s. =A0It should only match the document with id:2.


Any insights would be appreciated. =A0I'm using Lucene 4.7.2.

Darin.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org