Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of erickerickson@gmail.com
 designates 209.85.128.187 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=beta;
        h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:references;
        b=Vv/DiG3h+WOymT1wfAjBmtDaQzPzjPXqDyhGmtivGfP/W2ko/YR+lcBq3S6MXhqO0Sl5orkW6w4Pd+1xoSdm8pMotmG6ueONC12Fp9PtVtS1rsNKEhoU1DN/y6rCxGB/+d5912IcnjB5RuUC0223V1SEZukSzVCkBqLa0drJ3Ck=
Message-ID: <359a92830711021025g2f16a628p2255d9746b60f45c@mail.gmail.com>
Date: Fri, 2 Nov 2007 13:25:51 -0400
From: "Erick Erickson" <erickerickson@gmail.com>
To: java-user@lucene.apache.org
Subject: Re: RE : Re: problem undestanding the hits.score
In-Reply-To: <318407.26712.qm@web25706.mail.ukl.yahoo.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_14401_12188535.1194024351566"
References: <995658.17899.qm@web25706.mail.ukl.yahoo.com>
	 <318407.26712.qm@web25706.mail.ukl.yahoo.com>

------=_Part_14401_12188535.1194024351566
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

I strongly recommend against this. Simple word counts are a poor
measure of relevance. Which is why Lucene doesn't score that
way. Do you have an example showing why the default scoring is
inadequate or is this just an assumption?

It would be helpful if you gave us some idea of what you're trying
to accomplish. What is the use-case you're trying to solve? That
would generate more helpful responses I think....

Best
Erick

On 11/2/07, Jamal H Tandina <jtandina@yahoo.fr> wrote:
>
> <<<<
>
> If you want to give priority to documents that are larger, like z1, you
>
> should change the DefaultSimilarity (at index time), more exactly the
> method:
>
>   public float lengthNorm(String fieldName, int numTerms) {
>     return (float)(1.0 / Math.sqrt(numTerms));
>   }
>
> to something like this
>
>   public float lengthNorm(String fieldName, int numTerms) {
>     return (float)(Math.sqrt(numTerms));
>
>
>   }
> >>>
>
> I want to give priority to documents that have the word we are searching
> more frequent !
>
> Thank you
>
>
>
> Jamal H Tandina <jtandina@yahoo.fr> a =E9crit : Thank you  for your reply
>
> How can i change the defaultSimilarity in the indexing and the searching,
> do you have an example or an url how to set the Similarity  ?
>
> http://lucene.zones.apache.org:8080/hudson/job/Lucene-Nightly/javadoc/org=
/apache/lucene/search/Similarity.html
>
> Thanks again
>
> Ion Badita  a =E9crit : Try too look at Similarity, there you will find
> thinks about the
> scoring. Your query is more "similar" with the shorter document.
> If you have 2 documents with a field body; first with words "red flower"
> and the second with just one word "flower", and search for the word
> "flower", the second document will score high because is very similar
> with the query.
>
> If you want to give priority to documents that are larger, like z1, you
> should change the DefaultSimilarity (at index time), more exactly the
> method:
>
>   public float lengthNorm(String fieldName, int numTerms) {
>     return (float)(1.0 / Math.sqrt(numTerms));
>   }
>
> to something like this
>
>   public float lengthNorm(String fieldName, int numTerms) {
>     return (float)(Math.sqrt(numTerms));
>   }
>
>
> Reindex your documents with the Similarity modified and try to search
> again. The IndexWriter has a method to set the similarity used for
> indexing.
>
>
> I hope this will help you...
>
>
> Ion
>
>
>
> Jamal jamalator wrote:
> >  Hi
> >
> > I have indexed this html document
> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dz1=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> >
> >
> > zo zo zo zo zo zo zo zo zo zo zo zo
>
> > zo zo zo zo zo zo zo zo zo zo zo zo
>
> > zo zo zo zo zo zo zo zo zo zo zo zo
> >
> >
> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dz2=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> >
> >
> >  zo zo zo zo zo zo zo zo zo zo zo zo
>
> >  zo zo zo zo zo zo zo zo zo zo zo zo
>
> >
> >
> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dz3=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> >
> >
> >  zo zo zo zo zo zo zo zo zo zo zo zo
>
> >
> >
> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
> > with this code
> >
> > Field contentK1 =3D new  Field("htmlcontent",httpd.getContentKeywords()=
,
> Field.Store.NO,Field.Index.TOKENIZED );
> > contentK1.setBoost(1/10f);  //10%
> > doc.add(contentK1);
> >
> > and when a search "zo" with luke i have (whitespaceanalyser):
> >
> > (score , id   )
> > (0,0957,z2 )
> > (0,0947,z3 )
> > (0,0938,z1)
> >
> > NORMALY the resut expected have to be z1 z2 z3
> >
> > Some One have an idea ??
> >
> > Thank you all
> >
> >
> >
> > ---------------------------------
> >   Ne gardez plus qu'une seule adresse mail ! Copiez vos mails vers
> Yahoo! Mail
> >
> >
> > ---------------------------------
> >  Ne gardez plus qu'une seule adresse mail ! Copiez vos mails vers Yahoo=
!
> Mail
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
>
>
> ---------------------------------
> Ne gardez plus qu'une seule adresse mail ! Copiez vos mails vers Yahoo!
> Mail
>
>
> ---------------------------------
> Ne gardez plus qu'une seule adresse mail ! Copiez vos mails vers Yahoo!
> Mail

------=_Part_14401_12188535.1194024351566--