Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
  s=s1024; d=yahoo.com;
  h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type;
  b=U7l/bSjO1hzJXmnVl11VrGdLmKwDNbE7737kXUFK4Mr/pXHBbDR3Wy1jb0mo7OXs+Cp1s2iysaFcOwlhMFzA08fCvYJY8pgh8VbeXiY9GHvPmt7muwDakamGuDtqzM5eCU/f8OgmXth62zSDt3Lac1y1w0DJlP41LEXGzXQxYG0=;
Message-ID: <841536.42106.qm@web52906.mail.re2.yahoo.com>
Date: Mon, 15 Nov 2010 15:32:22 -0800 (PST)
From: Ahmet Arslan <iorixxx@yahoo.com>
Subject: Re: What is the best Analyzer and Parser for this type of question?
To: java-user@lucene.apache.org
In-Reply-To: <AANLkTi=BmyJXYGN=Yn1D7MqUqkrguNMKnO2yzod1-XB2@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii


> Example of Question:
> - What is the role of PrnP in mad cow disease?

First thing is do not directly query questions. Manually formulate queries:
remove 'what' 'is' 'the' 'of' '?' etc.

For example i would convert this question into:

"mad cow"^5 "cow disease"^3 "mad cow disease"^15 "role PrnP"~5^2 "role mad cow disease"~45 mad^0.1 role^0.5 cow disease PrnP^10

> I am running in 11.638 documents and the result is 10410
> docs for this question (lowwwwww precision)

Use OR default operator, collect and evaluate top 1000 documents only.

And instead of Porter you can try KStem.
http://ciir.cs.umass.edu/cgi-bin/downloads/downloads.cgi

Try different length normalization described here. Also their Lucene query example (SpanNear) can inspire you.  http://trec.nist.gov/pubs/trec16/papers/ibm-haifa.mq.final.pdf


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org