From java-user-return-34363-apmail-lucene-java-user-archive=lucene.apache.org@lucene.apache.org Tue Jun 10 15:10:46 2008 Return-Path: Delivered-To: apmail-lucene-java-user-archive@www.apache.org Received: (qmail 58061 invoked from network); 10 Jun 2008 15:10:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 10 Jun 2008 15:10:46 -0000 Received: (qmail 9845 invoked by uid 500); 10 Jun 2008 15:10:40 -0000 Delivered-To: apmail-lucene-java-user-archive@lucene.apache.org Received: (qmail 9817 invoked by uid 500); 10 Jun 2008 15:10:40 -0000 Mailing-List: contact java-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-user@lucene.apache.org Delivered-To: mailing list java-user@lucene.apache.org Received: (qmail 9806 invoked by uid 99); 10 Jun 2008 15:10:40 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Jun 2008 08:10:40 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of glen.newton@gmail.com designates 209.85.198.227 as permitted sender) Received: from [209.85.198.227] (HELO rv-out-0506.google.com) (209.85.198.227) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Jun 2008 15:09:49 +0000 Received: by rv-out-0506.google.com with SMTP id f6so3078683rvb.5 for ; Tue, 10 Jun 2008 08:10:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=ScAK/wsdqEucepj9zRfzferRAQ/1o9K5W9ojBP1m5b8=; b=NyP/71q9P7aFYBkCXsDKJTunrhawh9OFpndAAt8clI4I4w/PlGhE9TvchJcLKIYQjF GvVu0bPu08J8OrADG4YppxL4YfIX0/W4f+vDja9T/S8wHV9+/VLdftDbnEPSoerLEMh4 I0HptCHNUk1i7rJVvX1MMar/3fmkJutArLlOs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=OmV9qRa5nj00m2uhMtduYIFhgYeRn5fVHkU1ObzbyBzi/YWT7HyNTuVr0Q4UY9fvZo uS4/1jZYpeSGAofogJKKDmA8yqoMt7EnM6ujHA5nWH7B4BHDIaETp+QXjVrBkFULoUZt deisR+7h5odQQf0sdq2EAw65RVY6N/BI3/Ydc= Received: by 10.141.34.12 with SMTP id m12mr3116399rvj.26.1213110605610; Tue, 10 Jun 2008 08:10:05 -0700 (PDT) Received: by 10.141.18.7 with HTTP; Tue, 10 Jun 2008 08:10:05 -0700 (PDT) Message-ID: <5e76f3840806100810m71524d3dub976a0d3476393ae@mail.gmail.com> Date: Tue, 10 Jun 2008 11:10:05 -0400 From: "Glen Newton" To: java-user@lucene.apache.org Subject: Re: Concurrent query benchmarks In-Reply-To: <193059.25790.qm@web50311.mail.re2.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <193059.25790.qm@web50311.mail.re2.yahoo.com> X-Virus-Checked: Checked by ClamAV on apache.org 2008/6/9 Otis Gospodnetic : > Hi Glen, > > Thanks for sharing. Does your benchmarking tool build on top of contrib/benchmark? (not sure if that one lets you specify the number of concurrent threads -- if it does not, perhaps this is an opportunity to add this functionality). No, it is a stand-alone program. You give it the index directory, the default query field, the number of threads, and the filename of a file that contains one Lucene query per line.hreads. The output is one line: the # fo threads followed by the #queries handled per second. I have a shell script which runs the above with increasing #s of threads. > I couldn't find info about the index format (compound or not) you used. It would be good to see the comparison with high number of threads for the 2 index formats. It would also be good to see the numbers when the index has no deletion and when it has some percentage of docs deleted. Sorry, I didn't include it. The index in the benchmarks uses the compound format, with 0% documents deleted. > > Finally, if you end up extending contrib/benchmark, I think just having the ability to pump the results of that into a gnuplot script would be nice to have. I've written a standalone benchmarking tool that did pretty much what yours seems to do, but I wrote it for Technorati, so I can't release it. :( I would be very willing to contribute what I have, with the gnuplot scripts that I have. Let me finish off what I am doing for my work and I will clean things up a bit, write a little documentation. -Glen > > Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > ----- Original Message ---- >> From: Glen Newton >> To: java-user@lucene.apache.org >> Sent: Tuesday, June 10, 2008 12:51:41 AM >> Subject: Concurrent query benchmarks >> >> A number of people have asked about query benchmarks. >> >> I have posted benchmarks for concurrent query requests for Lucene >> 2.3.1 on my blog, where I look at 1 - 4096 concurrent requests: >> http://zzzoot.blogspot.com/2008/06/simultaneous-threaded-query-lucene.html >> >> I hope you find this useful. >> >> thanks, >> >> Glen >> >> -- >> >> - >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org >> For additional commands, e-mail: java-user-help@lucene.apache.org > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-user-help@lucene.apache.org > > -- - --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org For additional commands, e-mail: java-user-help@lucene.apache.org