From java-user-return-45962-apmail-lucene-java-user-archive=lucene.apache.org@lucene.apache.org Thu Apr 29 14:37:49 2010 Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 30646 invoked from network); 29 Apr 2010 14:37:49 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 29 Apr 2010 14:37:49 -0000 Received: (qmail 83406 invoked by uid 500); 29 Apr 2010 14:37:47 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 83289 invoked by uid 500); 29 Apr 2010 14:37:47 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 83281 invoked by uid 99); 29 Apr 2010 14:37:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Apr 2010 14:37:47 +0000 X-ASF-Spam-Status: No, hits=0.1 required=10.0 tests=AWL,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [213.86.41.124] (HELO mail.truvo.com) (213.86.41.124) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Apr 2010 14:37:40 +0000 X-ASG-Debug-ID: 1272551929-04ba03090000-H1Y1KX X-Barracuda-URL: http://10.255.0.214:8000/cgi-bin/mark.cgi Received: from exchq-001.wdnet.org (localhost [127.0.0.1]) by mail.truvo.com (Spam Firewall) with ESMTP id C85F110F132 for ; Thu, 29 Apr 2010 16:38:49 +0200 (CEST) Received: from exchq-001.wdnet.org (exchq-001.wdnet.org [10.100.10.5]) by mail.truvo.com with ESMTP id ovdHArNBbR4grTsw for ; Thu, 29 Apr 2010 16:38:49 +0200 (CEST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-ASG-Orig-Subj: RE: Relevancy Practices Subject: RE: Relevancy Practices Date: Thu, 29 Apr 2010 16:38:49 +0200 Message-ID: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Relevancy Practices Thread-Index: Acrnppcgu+TpU2RjQiuzFovEsLuLjwAAmpXg From: "Fornoville, Tom" To: X-Barracuda-Connect: exchq-001.wdnet.org[10.100.10.5] X-Barracuda-Start-Time: 1272551929 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at truvo.com We've only been using Lucene for a couple of weeks and we're still in the evaluation and R&D phase but there's one single thing that has helped us out enormously with the relevance testing: a set of reference documents and queries. We basically sat together with the business people a created a list of about 50 (fictional) documents, some queries and the order in which results should be returned. Once everyone agreed on this reference data we converted it to a set of unit tests. Until now this approach has helped us out big time both in refining the business requirements and the scoring and relevancy in the search engine itself. Cheers, Tom -----Original Message----- From: Grant Ingersoll [mailto:gsiasf@gmail.com] On Behalf Of Grant Ingersoll Sent: donderdag 29 april 2010 16:15 To: java-user@lucene.apache.org Subject: Relevancy Practices I'm putting on a talk at Lucene Eurocon (http://lucene-eurocon.org/sessions-track1-day2.html#1) on "Practical Relevance" and I'm curious as to what people put in practice for testing and improving relevance. I have my own inclinations, but I don't want to muddy the water just yet. So, if you have a few moments, I'd love to hear responses to the following questions. What worked? =20 What didn't work? =20 What didn't you understand about it? =20 What tools did you use? =20 What tools did you wish you had either for debugging relevance or "fixing" it? How much time did you spend on it? How did you avoid over/under tuning? What stage of development/testing/production did you decide to do relevance tuning? Was that timing planned or not? Thanks, Grant --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org