Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
From: "Uwe Schindler" <uwe@thetaphi.de>
To: <java-user@lucene.apache.org>
References: <1498556749425-4342991.post@n3.nabble.com>
In-Reply-To: <1498556749425-4342991.post@n3.nabble.com>
Subject: RE: Is it possible to normalise BM25 scores in the query level?
Date: Tue, 27 Jun 2017 16:39:25 +0200
Message-ID: <01f201d2ef53$2ce317d0$86a94770$@thetaphi.de>
MIME-Version: 1.0
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: quoted-printable
Content-Language: de
Thread-Index: AQLDaQoF48qnxJe2nIKhV4yf6nKPo6BX02nw
archived-at: Tue, 27 Jun 2017 14:39:40 -0000

Hi,

Once you have executed the query the TopDocs collector gives you the =
maximum score. Then you just need to normalize on your own.

But keep in mind: This is not always a good idea, because the maximum =
score and the score of the first document does not mean to be useful to =
compare. E.g. if the first, top-ranking result is a very bad match and =
no better ones are there, there is not reason to say it's a 100% hit!

BTW: Lucene up to version 6 had some internal normalization in place, =
but this was removed in Lucene 7. The reason is simple: The scores are =
calculated just to compare them inside the same result set. They were =
never implemented to be used across different indexes or queries.

-----
Uwe Schindler
Achterdiek 19, D-28357 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de

> -----Original Message-----
> From: Rifat [mailto:rifatozcan1981@gmail.com]
> Sent: Tuesday, June 27, 2017 11:46 AM
> To: java-user@lucene.apache.org
> Subject: Is it possible to normalise BM25 scores in the query level?
>=20
> Hi all,
>=20
> I searched for this a lot but could not find a clear answer, yet. is =
there a
> way such that Lucene (or Elasticsearch) provides query level =
normalization
> of BM25 scores. Because BM25 scores varies considerably across =
queries. For
> example, is it possible to get scores normalised by the max score for =
that
> query? Since lucene processes docs one at a time and return score for =
that
> document, at that moment, it seems not easy to do the normalisation.
>=20
> thanks,
> rifat
>=20
>=20
>=20
>=20
> --
> View this message in context: =
http://lucene.472066.n3.nabble.com/Is-it-
> possible-to-normalise-BM25-scores-in-the-query-level-tp4342991.html
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>=20
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org