Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: java-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of
 SRS0=PkZHx3=2R=basetechnology.com=jack@yourhostingaccount.com designates
 65.254.253.237 as permitted sender)
Message-ID: <9E55ABF061FB4DB98754FDAA34790C5E@JackKrupansky14>
From: "Jack Krupansky" <jack@basetechnology.com>
To: <java-user@lucene.apache.org>
References: 
 <CAOGCNNpb2yP8-vfqB8DWPBvgQas-v+cT0YPNPHOOa_YUvtfRAg@mail.gmail.com>
In-Reply-To: 
 <CAOGCNNpb2yP8-vfqB8DWPBvgQas-v+cT0YPNPHOOa_YUvtfRAg@mail.gmail.com>
Subject: Re: Performance issue when using multiple PhraseQueries against a 1+
 million entries index
Date: Mon, 19 May 2014 16:28:00 -0400
MIME-Version: 1.0
Content-Type: text/plain;
	format=flowed;
	charset="UTF-8";
	reply-type=original
Content-Transfer-Encoding: 7bit
Importance: Normal
Sender: "Jack Krupansky" <jack@basetechnology.com>

Does your index fit fully in system memory - the OS file cache? If not, 
there could be a lot of thrashing (I/O) as Lucene accesses the index.

-- Jack Krupansky

-----Original Message----- 
From: Liviu Matei
Sent: Monday, May 19, 2014 4:21 PM
To: java-user@lucene.apache.org
Subject: Performance issue when using multiple PhraseQueries against a 1+ 
million entries index

Hi,

In order to achieve a somehow "smarter" search that takes into
consideration also the context I decided to use PhraseQuery. Now I create
~100 phrase queries from the input text and combine them with boolean query
into one query and issue a search against the index.
Now if the index size is big (1+ million entries with a lot of content) I
am encountering performance hits - reponse time ~30 seconds which is not
acceptable. Can you please tell me if there is a way to tune the
PhraseQueries ? Or is it another way to improve perfomance besides reducing
the number of queries, I've read a little about N-Gram query but not sure
if it is suitable in this scenario ?

Thanks and regards,
Liviu 


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org