Mailing-List: contact ruby-dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: ruby-dev@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of goodieboy@gmail.com
 designates 209.85.217.10 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:to:subject:in-reply-to:mime-version
         :content-type:references;
        b=wqFfYiIWYnhMCrSZ/n0o1d9db5/j/OL20nQL0MeSuY2KbUEkJRz0hLwnC9v9BspxBf
         hCDGb0w6qHIPDiduKwUUL2fdNL7Y58HOowIuT5g6yo5A+BimvIiu4Tcwmu8FVZm4jCs6
         ZaepZHsDOvYYIIQHkgMfWXhsYfrY9p+De9Gtk=
Message-ID: <c66dcac40811260906l77aacfd1u8556dd27bf371711@mail.gmail.com>
Date: Wed, 26 Nov 2008 12:06:57 -0500
From: "Matt Mitchell" <goodieboy@gmail.com>
To: ruby-dev@lucene.apache.org
Subject: Re: quick jruby + solr benchmarks
In-Reply-To: <2CA214F1-2CAE-4DD1-8756-9327799C82D2@ehatchersolutions.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_20661_23444347.1227719217764"
References: <c66dcac40811251504na241e64t9ae560e1ade8a0fa@mail.gmail.com>
	 <D17663D8-31C1-4643-863A-42C2D4ECD8AA@ehatchersolutions.com>
	 <c66dcac40811260654p7f2de55ck19dd46aa9a7e4102@mail.gmail.com>
	 <2CA214F1-2CAE-4DD1-8756-9327799C82D2@ehatchersolutions.com>

------=_Part_20661_23444347.1227719217764
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Interesting. My main goal was to get a feel for how jruby and the
direct/embedded stuff compared to mri ruby and straight up http. But
obviously, the data and these tests are not realistic at all. Thanks for
your feedback guys.

Matt

On Wed, Nov 26, 2008 at 10:34 AM, Erik Hatcher
<erik@ehatchersolutions.com>wrote:

> I just had a brief conversation with Yonik on this to get his way more
> expert opinion, and it really boils down to this in this particular test...
> the query itself is incredibly fast (1 millisecond or less QTime Solr
> reports) since there are no documents.  So what these differences are
> showing is merely the difference between HTTP and a method call - with
> nothing else (of note) going on.
>
> In a realer world scenario, the HTTP overhead makes less difference as the
> work being done in the query/faceting overshadows the communication
> overhead.
>
> There's lies, damned lies, and benchmarks :)
>
>        Erik
>
>
>
> On Nov 26, 2008, at 9:54 AM, Matt Mitchell wrote:
>
>  Yeah I overlooked all of that. Thanks Erik. So could a better query test
>> be
>> an incremental one based on id like:
>>
>> 100.times do |id|
>>  q = "id:#{id}"
>>  # query request here...
>> end
>>
>> ?
>>
>> Would you happen to know why the solr home and data dir never really
>> change?
>> Anytime I use commons http or embedded, a "solr" directory is created in
>> the
>> same directory as my script. Even though I'm setting the home and data dir
>> in my code?
>>
>> Matt
>>
>> On Wed, Nov 26, 2008 at 3:28 AM, Erik Hatcher <erik@ehatchersolutions.com
>> >wrote:
>>
>>  just a couple of quick code comments...
>>>
>>> On Nov 25, 2008, at 6:04 PM, Matt Mitchell wrote:
>>>
>>>  # EmbeddedSolrServer
>>>> def embedded(solr_home)
>>>> @embedded ||= (
>>>>  import org.apache.solr.client.solrj.embedded.EmbeddedSolrServer
>>>>  import org.apache.solr.core.CoreContainer
>>>>  import org.apache.solr.core.CoreDescriptor
>>>>  import org.apache.solr.client.solrj.SolrQuery
>>>>  core_name = 'main-core'
>>>>  container = CoreContainer.new
>>>>  descriptor = CoreDescriptor.new(container, core_name, solr_home)
>>>>  core = container.create(descriptor)
>>>>
>>>>
>>> You'll want to close that core, otherwise the JVM doesn't exit.  I
>>> changed
>>> this to:
>>>
>>> @core = ....
>>>
>>>  container.register(core_name, core, false)
>>>
>>>>
>>>>
>>> and used @core there.
>>>
>>> query = {'qt' => 'standard', 'q'=>'ipod', 'facet.field' => 'cat'}
>>>
>>>>
>>>>
>>> Note that faceting is not enabled unless there is also a &facet=on
>>>
>>> params = hash_to_params(query)
>>>
>>>>
>>>> max = 1000
>>>>
>>>> Benchmark.bm do |x|
>>>> x.report 'http commons' do
>>>>  max.times do
>>>>   http_commons.query(params)
>>>>  end
>>>> end
>>>> x.report 'embedded' do
>>>>  max.times do
>>>>   embedded(solr_home).query(params)
>>>>  end
>>>> end
>>>> end
>>>>
>>>>
>>> And I added an:
>>>
>>> @core.close
>>>
>>> at the end.
>>>
>>>      Erik
>>>
>>>
>>>
>

------=_Part_20661_23444347.1227719217764--