lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-1709) Parallelize Tests
Date Sat, 27 Jun 2009 07:42:47 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12724815#action_12724815
] 

Michael McCandless commented on LUCENE-1709:
--------------------------------------------

Actually I see decent gains from concurrency: when I run tests with 6
threads my tests run a little over 3X faster (12:59 with 1 thread and
4:15 with 6 threads).

I'm using a Python script that launches the threads, each specifying
-Dtestpackage to run a certain subset of Lucene's tests.

This is on an OpenSolaris (2009.06) machine, with a Core i7 920 CPU
(= 8 cores presented to the OS) and an Intel X25M SSD, 12 GB RAM.  The
hardware has quite a bit of concurrency.


> Parallelize Tests
> -----------------
>
>                 Key: LUCENE-1709
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1709
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.4.1
>            Reporter: Jason Rutherglen
>             Fix For: 3.0
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> The Lucene tests can be parallelized to make for a faster testing system.  
> This task from ANT can be used: http://ant.apache.org/manual/CoreTasks/parallel.html
> Previous discussion: http://www.gossamer-threads.com/lists/lucene/java-dev/69669
> Notes from Mike M.:
> {quote}
> I'd love to see a clean solution here (the tests are embarrassingly
> parallelizable, and we all have machines with good concurrency these
> days)... I have a rather hacked up solution now, that uses
> "-Dtestpackage=XXX" to split the tests up.
> Ideally I would be able to say "use N threads" and it'd do the right
> thing... like the -j flag to make.
> {quote}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message