lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-1709) Parallelize Tests
Date Tue, 23 Mar 2010 13:47:27 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848707#action_12848707
] 

Robert Muir commented on LUCENE-1709:
-------------------------------------

Thanks Jason.

So for newtrunk I applied a similar patch to speed up Solr's tests.
You can see it here: http://svn.apache.org/viewvc?rev=926470&view=rev

In this case the output is not interleaved because it uses a special formatter.
So it basically looks just like you are not using parallel at all.
Additionally -Dtestpackage, -Dtestpackageroot, -Dtestcase all work, the former two are also
parallelized.

So, I propose we do the same thing for Lucene tests.
Solr was simple because it does not have these junit failed flag files.
I propose we just remove these, like how Solr does contrib.
Hudson hasn't failed in over a month by the way.


> Parallelize Tests
> -----------------
>
>                 Key: LUCENE-1709
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1709
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.4.1
>            Reporter: Jason Rutherglen
>             Fix For: 3.1
>
>         Attachments: LUCENE-1709.patch, runLuceneTests.py
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> The Lucene tests can be parallelized to make for a faster testing system.  
> This task from ANT can be used: http://ant.apache.org/manual/CoreTasks/parallel.html
> Previous discussion: http://www.gossamer-threads.com/lists/lucene/java-dev/69669
> Notes from Mike M.:
> {quote}
> I'd love to see a clean solution here (the tests are embarrassingly
> parallelizable, and we all have machines with good concurrency these
> days)... I have a rather hacked up solution now, that uses
> "-Dtestpackage=XXX" to split the tests up.
> Ideally I would be able to say "use N threads" and it'd do the right
> thing... like the -j flag to make.
> {quote}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message