Return-Path: Delivered-To: apmail-lucene-java-dev-archive@www.apache.org Received: (qmail 35304 invoked from network); 26 Jun 2009 02:19:50 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 26 Jun 2009 02:19:50 -0000 Received: (qmail 63608 invoked by uid 500); 26 Jun 2009 02:20:00 -0000 Delivered-To: apmail-lucene-java-dev-archive@lucene.apache.org Received: (qmail 63527 invoked by uid 500); 26 Jun 2009 02:19:59 -0000 Mailing-List: contact java-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: java-dev@lucene.apache.org Delivered-To: mailing list java-dev@lucene.apache.org Received: (qmail 63457 invoked by uid 99); 26 Jun 2009 02:19:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Jun 2009 02:19:59 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jason.rutherglen@gmail.com designates 209.85.200.169 as permitted sender) Received: from [209.85.200.169] (HELO wf-out-1314.google.com) (209.85.200.169) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Jun 2009 02:19:49 +0000 Received: by wf-out-1314.google.com with SMTP id 24so647928wfg.20 for ; Thu, 25 Jun 2009 19:19:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=Eej3HBKroVzpih/ZWtCtw/amxGPym8Koc/2p5IQPC6E=; b=c8/KGQcQCieuTP0nWy0fcl0CxwSrJI5r2f+Ig7lwhWPnqappX2WFCcRUv0qFrMEuG6 J5Mb4l+W25Ejyp0/T0eJYtVBMefxay6eJD9BdzVgepm1DhdZjJWzK3CLGa6qvJK+cyij Ek4xRbBhJ7WVRb2unRpmbyA10uLNgJNpIU3Qc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=sxhT+Sdmas8ELeBtd9DMm7bZcAtGIFBifHPeUrbNt3KculfzUbLsJP+U57fLc7ST/u kwMmVSLZO3ZdQd6dVCIq2mKYeov7gSX3C4b51qooWVNJPjjVTdcBXlj57PKAUl2VqbD5 JEZIehBD4rzE98BLTBPtc67UpCzhRjXtwircU= MIME-Version: 1.0 Received: by 10.140.139.4 with SMTP id m4mr610283rvd.2.1245982769582; Thu, 25 Jun 2009 19:19:29 -0700 (PDT) In-Reply-To: <4A442EFC.7070605@gmail.com> References: <958295682.1245969127360.JavaMail.jira@brutus> <4A442EFC.7070605@gmail.com> Date: Thu, 25 Jun 2009 19:19:29 -0700 Message-ID: <85d3c3b60906251919l1d98cdf4m6d3c07b9fa3c662e@mail.gmail.com> Subject: Re: [jira] Commented: (LUCENE-1709) Parallelize Tests From: Jason Rutherglen To: java-dev@lucene.apache.org Content-Type: multipart/alternative; boundary=000e0cd22ab060936a046d36f892 X-Virus-Checked: Checked by ClamAV on apache.org --000e0cd22ab060936a046d36f892 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit There's this foreach parallel ant-contrib task. Perhaps we have a winner! http://www.jadeliquid.com/liquidtest/docs/doku.php?id=developers:cookbooks:scaling_liquidtest_with_junit_parallel:home http://ant-contrib.sourceforge.net/tasks/tasks/foreach.html On Thu, Jun 25, 2009 at 7:14 PM, Mark Miller wrote: > JUnit also supports parallelizing tasks, but its only in the very latest > release. I'd check out that. There are generally more issues than just > firing off multiple tests at once. > > -- > - Mark > > http://www.lucidimagination.com > > > > > Jason Rutherglen (JIRA) wrote: > >> [ >> https://issues.apache.org/jira/browse/LUCENE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12724325#action_12724325] >> Jason Rutherglen commented on LUCENE-1709: >> ------------------------------------------ >> >> {quote} Do you mean that you would implement your own task? In >> which module would you put this custom ant task? {quote} >> >> Yes, seems creating a custom task should work? In contrib/ant? >> Last time I tried to use Maven I couldn't get it to work (was >> running into a bug) so my knowledge isn't very good. We're using >> ant and ivy for our webapp dev. I don't know what Lucene's >> position is on Maven, but am interested pursuing whatever makes >> sense. >> >> >> >>> Parallelize Tests >>> ----------------- >>> >>> Key: LUCENE-1709 >>> URL: https://issues.apache.org/jira/browse/LUCENE-1709 >>> Project: Lucene - Java >>> Issue Type: Improvement >>> Components: Index >>> Affects Versions: 2.4.1 >>> Reporter: Jason Rutherglen >>> Fix For: 3.0 >>> >>> Original Estimate: 48h >>> Remaining Estimate: 48h >>> >>> The Lucene tests can be parallelized to make for a faster testing system. >>> This task from ANT can be used: >>> http://ant.apache.org/manual/CoreTasks/parallel.html >>> Previous discussion: >>> http://www.gossamer-threads.com/lists/lucene/java-dev/69669 >>> Notes from Mike M.: >>> {quote} >>> I'd love to see a clean solution here (the tests are embarrassingly >>> parallelizable, and we all have machines with good concurrency these >>> days)... I have a rather hacked up solution now, that uses >>> "-Dtestpackage=XXX" to split the tests up. >>> Ideally I would be able to say "use N threads" and it'd do the right >>> thing... like the -j flag to make. >>> {quote} >>> >>> >> >> >> > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org > For additional commands, e-mail: java-dev-help@lucene.apache.org > > --000e0cd22ab060936a046d36f892 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable There's this foreach parallel ant-contrib task.=A0 Perhaps we have a wi= nner!

http= ://www.jadeliquid.com/liquidtest/docs/doku.php?id=3Ddevelopers:cookbooks:sc= aling_liquidtest_with_junit_parallel:home

http://ant-contrib.sourceforge.net/tasks/tasks/foreach.html

On Thu, Jun 25, 2009 at 7:14 PM, Mark Miller <markrmiller@gmail.= com> wrote:
JUnit also suppor= ts parallelizing tasks, but its only in the very latest release. I'd ch= eck out that. There are generally more issues than just firing off multiple= tests at once.

--
- Mark

http://www.lu= cidimagination.com




Jason Rutherglen (JIRA) wrote:
=A0 =A0[ https://issues.= apache.org/jira/browse/LUCENE-1709?page=3Dcom.atlassian.jira.plugin.system.= issuetabpanels:comment-tabpanel&focusedCommentId=3D12724325#action_1272= 4325 ]
Jason Rutherglen commented on LUCENE-1709:
------------------------------------------

{quote} Do you mean that you would implement your own task? In
which module would you put this custom ant task? {quote}

Yes, seems creating a custom task should work? In contrib/ant?
Last time I tried to use Maven I couldn't get it to work (was
running into a bug) so my knowledge isn't very good. We're using ant and ivy for our webapp dev. I don't know what Lucene's
position is on Maven, but am interested pursuing whatever makes
sense.

=A0
Parallelize Tests
-----------------

=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0Key: LUCENE-1709
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0URL: https://issues.apache.org/jira/br= owse/LUCENE-1709
=A0 =A0 =A0 =A0 =A0 =A0Project: Lucene - Java
=A0 =A0 =A0 =A0 Issue Type: Improvement
=A0 =A0 =A0 =A0 Components: Index
=A0 Affects Versions: 2.4.1
=A0 =A0 =A0 =A0 =A0 Reporter: Jason Rutherglen
=A0 =A0 =A0 =A0 =A0 =A0Fix For: 3.0

=A0Original Estimate: 48h
=A0Remaining Estimate: 48h

The Lucene tests can be parallelized to make for a faster testing system. = =A0This task from ANT can be used: http://ant.apache.org/manual/Cor= eTasks/parallel.html
Previous discussion: http://www.gossamer-threads.com/lists/l= ucene/java-dev/69669
Notes from Mike M.:
{quote}
I'd love to see a clean solution here (the tests are embarrassingly
parallelizable, and we all have machines with good concurrency these
days)... I have a rather hacked up solution now, that uses
"-Dtestpackage=3DXXX" to split the tests up.
Ideally I would be able to say "use N threads" and it'd do th= e right
thing... like the -j flag to make.
{quote}
=A0 =A0

=A0



---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


--000e0cd22ab060936a046d36f892--