lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <>
Subject [jira] Commented: (LUCENE-1709) Parallelize Tests
Date Sat, 27 Jun 2009 07:42:47 GMT


Michael McCandless commented on LUCENE-1709:

Actually I see decent gains from concurrency: when I run tests with 6
threads my tests run a little over 3X faster (12:59 with 1 thread and
4:15 with 6 threads).

I'm using a Python script that launches the threads, each specifying
-Dtestpackage to run a certain subset of Lucene's tests.

This is on an OpenSolaris (2009.06) machine, with a Core i7 920 CPU
(= 8 cores presented to the OS) and an Intel X25M SSD, 12 GB RAM.  The
hardware has quite a bit of concurrency.

> Parallelize Tests
> -----------------
>                 Key: LUCENE-1709
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.4.1
>            Reporter: Jason Rutherglen
>             Fix For: 3.0
>   Original Estimate: 48h
>  Remaining Estimate: 48h
> The Lucene tests can be parallelized to make for a faster testing system.  
> This task from ANT can be used:
> Previous discussion:
> Notes from Mike M.:
> {quote}
> I'd love to see a clean solution here (the tests are embarrassingly
> parallelizable, and we all have machines with good concurrency these
> days)... I have a rather hacked up solution now, that uses
> "-Dtestpackage=XXX" to split the tests up.
> Ideally I would be able to say "use N threads" and it'd do the right
> thing... like the -j flag to make.
> {quote}

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message