Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@lucene.apache.org
Received-SPF: pass (nike.apache.org: domain of dawid.weiss@gmail.com
 designates 209.85.213.176 as permitted sender)
MIME-Version: 1.0
Sender: dawid.weiss@gmail.com
In-Reply-To: 
 <CALfq-2TbU1gyqa7XdvYdm+eomoMFPyNg-huAefrUBMmee=w1Tw@mail.gmail.com>
References: 
 <CALfq-2R2Juma0eAHpvysVYb=WtK2TLtAz5WRCK0vTpR45gBUcA@mail.gmail.com>
 <CAM21Rt-u1SKZ3kWG3bHAMmzviLy9QLRB2tjVh6bu1XSDVmXphg@mail.gmail.com>
 <CALfq-2TbU1gyqa7XdvYdm+eomoMFPyNg-huAefrUBMmee=w1Tw@mail.gmail.com>
From: Dawid Weiss <dawid.weiss@cs.put.poznan.pl>
Date: Wed, 16 May 2012 16:35:34 +0200
Message-ID: 
 <CAM21Rt-VhVcZhS+kOBsGaExFnTvn2BBhMiMgMWMQ1PPrZ_E=HQ@mail.gmail.com>
Subject: Re: -Dtests.iters not working?
To: dev@lucene.apache.org
Content-Type: text/plain; charset=UTF-8

> eclipse and it worked with -Dtests.iters. I wonder why it didn't work from
> cmd-line though, as testmethod is an alias to tests.method.

It should work with both.

> Isn't there a way to make running a single test-method still runnable with
> -Dtests.iters? This is something that used to work, how come that we lost

It did not work properly. It was a loop that rerun the test method but
didn't really play nice with rules, hooks etc. It's virtually as if
you put:

for (int i = 0; i < n; i++) {
 invokeTestMethod();
}

into another method and ran it as a test. The new option (that's part
of the reason it was named slightly differently) is a real JUnit
compatible test reiteration -- it picks the same or different seeds,
is repeatable, invokes hooks and rules, puts every reiteration into a
separate entry into reports, etc.

I consider this a step forward rather than backward but of course you
can argue otherwise.

> ensuring that at least what used to work doesn't stop working. And also try
> to avoid unnecessary changes like the tests.iter rename - it's something
> that was working and we got used to it, why change?

Explained above. It's not the same thing.

> Now I need to adapt the way I run tests in eclipse, by never running a
> single test-method, but always running classes with -Dtests.method. If this

You can run a single test method and it will work identically as
before as long as you don't run with multiple iterations. Multiple
iterations (and parameters, and different @Seed annotations) will
expand into different test names and Eclipse filters them out seeking
for an exact method name match.

Unfortunately this cannot be fixed or worked around, this is how JUnit
is internally designed. I consider this a flaw but pushing JUnit
changes is quite hard because of backcompat concerns.

> is something that you can fix, I'd appreciate if you can try.

No. This isn't something that I came up with overnight -- it's a
tedious trial and error of what work and what doesn't. This is the
best compromise I could find.

> Is tests.iter(s).min back working, or is it still disabled? This was a very
> useful feature too.

It doesn't exist anymore. Again -- because of how JUnit is designed
(tests are collected by the core before anything is run, then there is
no way to interrupt execution). I could probably provide a workaround
in which tests would be ignored after the first detected failure if
more people miss that feature (nobody was complaining so far).

Dawid

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org