Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of
 simon.willnauer@googlemail.com designates 209.85.218.211 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=googlemail.com; s=gamma;
        h=mime-version:reply-to:in-reply-to:references:date:message-id
         :subject:from:to:content-type:content-transfer-encoding;
        b=Zs1d+HbSNNs5l8W/86uGZLyqiwatGe/fVUqZFtwGJuaDPgXpE2dxh4IFKO+TxcvT0C
         9jNTI343GPgo97BedDabnS//MI7rLZvCa+9jmxSW6JeVhNhNsvlNqPHsMIr0nOvhsUbg
         K9+iRt4ObOMeQS6j1mfAyLuRl5TP4wv7oglI4=
MIME-Version: 1.0
Reply-To: simon.willnauer@gmail.com
In-Reply-To: <11a518030908122110t3861ecf9vd89403905426a998@mail.gmail.com>
References: <11a518030908121246i2657ca68sb25e438015436fe9@mail.gmail.com>
	 <11a518030908122110t3861ecf9vd89403905426a998@mail.gmail.com>
Date: Thu, 13 Aug 2009 09:36:59 +0200
Message-ID: <f18c9dde0908130036u11535b9ap7e0d6fb599a8f459@mail.gmail.com>
Subject: Re: term query boost problem
From: Simon Willnauer <simon.willnauer@googlemail.com>
To: java-user@lucene.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Chrisitan,
if you haven't done so you might find Luke
(http://www.getopt.org/luke/) very helpful so see what has been
indexed and how.

simon

On Thu, Aug 13, 2009 at 6:10 AM, Christian
Bongiorno<christian@bongiorno.org> wrote:
> turns out the index is being built with lower-case terms which is why we
> aren't getting hits the way we expect. When I change my search terms to
> lower I see more of what I expect.
>
> Gonna keep working on this and post updates.
>
> On Wed, Aug 12, 2009 at 12:46 PM, Christian Bongiorno <
> christian@bongiorno.org> wrote:
>
>> I have a situation where I have a series of terms queries as part of a
>> BooleanQuery.
>>
>> example:
>>
>> term: 'sole type' -> leather
>> =C2=A0 BooleanClause.SHOULD_OCCURR
>> term: 'title' -> 'Men's Golf shoes'
>> =C2=A0 BooleanClause.SHOULD_OCCURR
>> ...
>>
>> But, some terms are incredibly powerful indicators of match
>> term: 'band type' -> 'gold'
>>
>> Normally, I would set this as a field boost in the query. Problem is, it
>> isn't producing ANY changes even when I set the boost score absurdly hig=
h. I
>> have also tried to set the BooleanClause.MUST on my really important ter=
m
>> and I get no results at all.
>>
>> I tried a simple TermQuery for that (no clause) and got no results. Belo=
w
>> is a code snippet. I checked through the recent archives discussing fiel=
d
>> boosts and I am pretty confident I am doing it right. So, now I am presu=
ming
>> it's a problem with my query.
>>
>> =C2=A0 =C2=A0 private Query buildQuery(Map<String, String> CatalogInfo) =
{
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 if (CatalogInfo !=3D null && CatalogInfo.siz=
e() > 0) {
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 BooleanQuery booleanQuery =3D =
new BooleanQuery();
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 for (Map.Entry<String, String>=
 attributeValue :
>> CatalogInfo.entrySet()) {
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 String attribute=
Name =3D attributeValue.getKey();
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 String[] attribu=
teValues;
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 if (attributeVal=
ue.getValue().indexOf(VALUES_DELIMITER) =3D=3D
>> -1) {
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at=
tributeValues =3D new String[]
>> {attributeValue.getValue()};
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 } else {
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at=
tributeValues =3D
>> attributeValue.getValue().split(VALUES_DELIMITER);
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 }
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 for (String attr=
ibuteValue : attributeValues) {
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 St=
ring escapedValue =3D
>> QueryParser.escape(attributeValue).trim();
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Te=
rmQuery termQuery =3D new TermQuery(new
>> Term(attributeName, escapedValue));
>>
>>
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Fl=
oat boostNumber =3D _boostMap.get(attributeName); //
>> this is where 'band type' gets it's boost
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 if=
 (boostNumber !=3D null) {
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 LOG.warn("Boost value found: " + boostNumber);
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 termQuery.setBoost(boostNumber);
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 }
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 bo=
oleanQuery.add(termQuery,
>> BooleanClause.Occur.SHOULD);
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 }
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 }
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 LOG.warn("Boolean query: " + b=
ooleanQuery.toString());
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 return booleanQuery;
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 }
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 return null;
>> =C2=A0 =C2=A0 }
>> --
>> Christian Bongiorno
>>
>>
>
>
> --
> Christian Bongiorno
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org