lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom Burton-West (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-1709) Parallelize Tests
Date Thu, 08 Apr 2010 15:42:36 GMT

    [ https://issues.apache.org/jira/browse/LUCENE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854957#action_12854957
] 

Tom Burton-West commented on LUCENE-1709:
-----------------------------------------

I am having the same issue Shai reported in LUCENE-2353 with the parallel tests apparently
causing the tests to hang on my Windows box with both Revision 931573 and Revision   931304
when running the tests from root.

Tests  hang in WriteLineDocTaskTest, on this line:
[junit] ------------> config properties:
[junit] directory = RAMDirectory
[junit] doc.maker = org.apache.lucene.benchmark.byTask.tasks.WriteLineDocTaskTest$JustDateDocMaker
[junit] line.file.out = D:\dev\lucene\lucene-trunk\build\contrib\benchmark\test\W\one-line
[junit] ------------------------------- 


I just ran the test last night with Revision  931708 and had no problem.   Ran it again this
morning and got the hanging behavior.  The difference is that last night the only thing running
on my computer besides a couple of ssh terminal windows was the  tests.  Today when I ran
the tests and got the hanging behavior, I have firefox, outlook, exceed, wordpad open.  The
tests are taking 98-99.9% of my cpu while hanging.  I suspect there is some kind of resource
issue when running the tests in parallel.

Tom Burton-West

> Parallelize Tests
> -----------------
>
>                 Key: LUCENE-1709
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1709
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 2.4.1
>            Reporter: Jason Rutherglen
>            Assignee: Robert Muir
>             Fix For: 3.1
>
>         Attachments: LUCENE-1709-2.patch, LUCENE-1709.patch, LUCENE-1709.patch, LUCENE-1709.patch,
LUCENE-1709.patch, LUCENE-1709.patch, LUCENE-1709.patch, runLuceneTests.py
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> The Lucene tests can be parallelized to make for a faster testing system.  
> This task from ANT can be used: http://ant.apache.org/manual/CoreTasks/parallel.html
> Previous discussion: http://www.gossamer-threads.com/lists/lucene/java-dev/69669
> Notes from Mike M.:
> {quote}
> I'd love to see a clean solution here (the tests are embarrassingly
> parallelizable, and we all have machines with good concurrency these
> days)... I have a rather hacked up solution now, that uses
> "-Dtestpackage=XXX" to split the tests up.
> Ideally I would be able to say "use N threads" and it'd do the right
> thing... like the -j flag to make.
> {quote}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message