Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of anshumg@gmail.com designates
 209.85.221.195 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=d0by4mL2nwbj+enR6Qe2ztnM52DFAYSM8JACVNOua1WFQM1NMm40J0xQo+ouS3es33
         u3UEKkWWc38LVCBqIsV0JEbjvu8EPE/R7bFJTnrA9Opa3tQ22XiSiCXyn3yYCThLfT6M
         EbCWsHe1m51RNOdLU7D7LGfdLmBHTIn4/HA0o=
MIME-Version: 1.0
In-Reply-To: <7d6ffee60905061757x258dbf58ic8c894334c2da416@mail.gmail.com>
References: <7d6ffee60905061757x258dbf58ic8c894334c2da416@mail.gmail.com>
Date: Thu, 7 May 2009 10:38:37 +0530
Message-ID: <867513fe0905062208m15e70ff3y1edb1cf775474a8b@mail.gmail.com>
Subject: Re: interpreting scores
From: Anshum <anshumg@gmail.com>
To: java-user@lucene.apache.org
Content-Type: multipart/alternative; boundary=0016364eeff02a62b504694b81f4

--0016364eeff02a62b504694b81f4
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

Hi Nate,
The scores are only comparable within the same search and not over different
searches as the scores are affected by query as well as docs.
About the threshold, I guess you could have count cutoff to get 'x' best
matches. Said so coz I'm not really able to recollect anything which could
use score as a metric to absolutely cluster 'good' and 'not good' matches.

--
Anshum Gupta
Naukri Labs!
http://ai-cafe.blogspot.com

The facts expressed here belong to everybody, the opinions to me. The
distinction is yours to draw............


On Thu, May 7, 2009 at 6:27 AM, Nate <nate@n4te.com> wrote:

> Hi all,
>
> First, the problem I'm trying to solve: I have two folders, each
> containing files. I need to match files in one folder with files in
> the other. Eg:
>
> notes/Michael Jackson - Don't Stop 'till You Get Enough.notes
> songs/Michael Jackson Don't stop until you get enough.mp3
>
> I provide the notes files, but the song files come from a user's music
> library, so often are not named well. I am attempting to use Lucene to
> find the most likely note file for each song file.
>
> I index the note files, then I use the StandardAnalyzer with carefully
> chosen stop words to search the index. The query uses each word in the
> song file name (w/o extension) as a term. Fuzzy matching is used for
> words with > 4 characters, and the fuzzy percentage is set to be 1 /
> termlength. This works ok so far, though I would love to hear opinions
> on any improvements I could make. This is my first use of Lucene, so
> I'm not sure I've chosen the best approach.
>
> The problem I'm having is: Sometimes there is a song file that has no
> matching note file. In this case I get back results with "low" scores,
> such as 0.2 or 0.05. A "really good" match gives me 7 or 8. I don't
> really understand what the scoring means, so I don't know what would
> be a reasonable threshold to ignore scores.
>
> I understand scores are not relevance percentages. I think the scores
> are only useful relative to other scores. Is this right? Are they only
> relative to scores from the same search, or from any search against
> the same index? How can I know if a score is "low", so I can ignore
> matches that aren't very good?
>
> Sorry if this has been discussed before. I have searched around a
> great deal and was unable to find a straight answer.
>
> Thanks!
> -Nate
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

--0016364eeff02a62b504694b81f4--