Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E2E14200C22 for ; Tue, 21 Feb 2017 21:00:35 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id E15AC160B74; Tue, 21 Feb 2017 20:00:35 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0D80E160B4F for ; Tue, 21 Feb 2017 21:00:34 +0100 (CET) Received: (qmail 27442 invoked by uid 500); 21 Feb 2017 20:00:33 -0000 Mailing-List: contact dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@lucene.apache.org Delivered-To: mailing list dev@lucene.apache.org Received: (qmail 27431 invoked by uid 99); 21 Feb 2017 20:00:33 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2017 20:00:33 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 12F98C0258 for ; Tue, 21 Feb 2017 20:00:33 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.379 X-Spam-Level: *** X-Spam-Status: No, score=3.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_LIVE=1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id FvA8O8oUNeg6 for ; Tue, 21 Feb 2017 20:00:31 +0000 (UTC) Received: from mail-yw0-f176.google.com (mail-yw0-f176.google.com [209.85.161.176]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id C2A315F1B8 for ; Tue, 21 Feb 2017 20:00:30 +0000 (UTC) Received: by mail-yw0-f176.google.com with SMTP id l19so69599914ywc.2 for ; Tue, 21 Feb 2017 12:00:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=vkjxdb4uqte19U/RQlyBTlPz3UxchPvcrZ8dY7Q57tE=; b=b4E9hbtVB+tktzqdimmuh0Py8pM1QZPhmYH6FUlCj6s5Ofd+SPD7ufIsaLFLzfncpI 7+CjkCC4CLOyomMs2KjRYIV3rGgGAXVE2IGAEZ3jwdDqB5yYkXQZXuxi+yCNqp5dVkhO gsgryTbDkn3AUU4sFYc9sgGCJld10cwHs07QqvX8HV/1RvFXExdEz9jCfs+2UxCpcgnu mKyhfK9yMosjivKW+I5X+8DcK9qwQm5yj3mPawXREE0aygXax7ax+VoCP8owHk0Zd7QO Z7cFrHN8wleQQSezT5sHWIYFo2olSqKlXXnszPUucDaHoVZ07jOP1TTIKUinDoE8IjMI K5/g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=vkjxdb4uqte19U/RQlyBTlPz3UxchPvcrZ8dY7Q57tE=; b=XmYm7P/qSVwhgUhUbFAed0v70Z71JXh2FaiWgrCjE7KAooTbfIVg6vlvbe7RkrSCqR 1y3FwYtTouwpvrsVrRPCtEH8+LfV1U1Byn575ojXa+aBbE4t/At5fR8hvOUB+1HvqECW g08QRB2eN5ws2PaLW7X1xORggcTGQ461ddLCTbYRc8+ysCUIBbFsiXFk6iTiuFFG3G02 BYJqGd/NAUElJWw/5I1s/+cP+Z8X1aVQ/OBpdAod5jp6xV0BQ2RSfbTDP16qtaZlUA/C Qr0+MdHEd79wiJ1AMOcU/TKlXAQX84+Da8tlij0U2VBCVTD6hPrnUKFJryQFmaA8WOge 8x9Q== X-Gm-Message-State: AMke39kpxeiJ4hFjNWTD8l6M+ztkEPuGcIEsnLz4d1PVrKXjJZRggXn1enxBiDv7udmeMn07Wc4DUxZYo9ki0Q== X-Received: by 10.13.255.194 with SMTP id p185mr17943582ywf.72.1487707228903; Tue, 21 Feb 2017 12:00:28 -0800 (PST) MIME-Version: 1.0 Received: by 10.129.118.15 with HTTP; Tue, 21 Feb 2017 12:00:28 -0800 (PST) In-Reply-To: References: From: Joel Bernstein Date: Tue, 21 Feb 2017 15:00:28 -0500 Message-ID: Subject: Re: Test framework ignoring -Dtestmethod To: lucene dev Content-Type: multipart/alternative; boundary=94eb2c088930e8a16205490fd49c archived-at: Tue, 21 Feb 2017 20:00:36 -0000 --94eb2c088930e8a16205490fd49c Content-Type: text/plain; charset=UTF-8 I traced the issue to a specific change that was made to the StreamExpressionTest. I'm figuring out the best way to address the issue. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Feb 21, 2017 at 2:52 PM, Joel Bernstein wrote: > Hi Dawid, > > It does appear to be related to an assumption. I researching what the > issue is. Also I was using -Dtestmethod to specify the method which does > not seem to be correct. I have a reproduce method that looks like this: > > NOTE: reproduce with: ant test -Dtestcase=StreamExpressionTest > -Dtests.method=testSignificantTermsStream -Dtests.seed=144DBB9558834AFE > -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=Africa/Johannesburg > -Dtests.asserts=true -Dtests.file.encoding=UTF-8 > > > Using -Dtests.method still gives me problems with the assumption. I'm > starting to think that the StreamExpressionTest testcase isn't structured > properly to run individual methods. But this would be a recent issue. > > Joel Bernstein > http://joelsolr.blogspot.com/ > > On Tue, Feb 21, 2017 at 2:36 PM, Dawid Weiss > wrote: > >> Joel, >> >> your test is being executed, but there is some kind of assumption that >> is thrown within the body of the method (or in setup/ teardown) that >> is causing the test to be ignored. Assumptions are regular exceptions >> -- try wrapping in try/catch and dumping the stack trace if you can't >> locate it easily. Alternatively, I think the test execution dumps may >> carry a full stack already? >> >> Dawid >> >> >> On Tue, Feb 21, 2017 at 7:23 PM, Joel Bernstein >> wrote: >> > >> > A test I've just added is being ignored when it's being called with the >> > -Dtestmethod. >> > >> > Here is the command line: >> > >> > ant test -Dtestcase=StreamExpressionTest >> > -Dtestmethod=testSignifcantTermsStream >> > >> > >> > Here are some snippets from the output: >> > ------------------------------ >> > ------------------------------ >> > >> > [junit4] 2> 6440 INFO >> > (TEST-StreamExpressionTest.testSignifcantTermsStream-seed#[ >> 619661D6DA496076]) >> > [ ] o.a.s.SolrTestCaseJ4 ###Ending testSignifcantTermsStream >> > >> > [junit4] IGNOR/A 0.18s | StreamExpressionTest.testSigni >> fcantTermsStream >> > >> > [junit4] > Assumption #1: got: , expected: is >> > >> > .... >> > >> > [junit4] Tests summary: 1 suite, 1 test, 1 ignored (1 assumption) >> > >> > ------------------------------------- >> > >> > ------------------------------------- >> > >> > Is anyone else seeing this behavior or have any idea why this might be >> > happening? >> > >> > >> > >> > Thanks >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org >> For additional commands, e-mail: dev-help@lucene.apache.org >> >> > --94eb2c088930e8a16205490fd49c Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I traced the issue to a specific change that was made to t= he StreamExpressionTest. I'm figuring out the best way to address the i= ssue.

<= div dir=3D"ltr">Joel Bernstein
=

On Tue, Feb 21, 2017 at 2:52 PM, Joel Bernst= ein <joelsolr@gmail.com> wrote:
Hi Dawid,

It does appear to be r= elated to an assumption. I researching what the issue is. Also I was using = -Dtestmethod to specify the method which does not seem to be correct. I hav= e a reproduce method that looks like this:

NOTE: reproduce with: ant test=C2=A0 -Dtestcase=3DStre= amExpressionTest -Dtests.method=3DtestSignificantTermsStream -Dtests.s= eed=3D144DBB9558834AFE -Dtests.slow=3Dtrue -Dtests.locale=3Dro -Dtests.time= zone=3DAfrica/Johannesburg -Dtests.asserts=3Dtrue -Dtests.file.encodin= g=3DUTF-8


Using -Dtests.method still gives me problems with the a= ssumption. I'm starting to think that the StreamExpressionTest testcase= isn't structured properly to run individual methods. But this would be= a recent issue.



On Tue, Feb 21, 2017 at 2:36 PM, Dawid Weiss= <dawid.weiss@gmail.com> wrote:
Joel,

your test is being executed, but there is some kind of assumption that
is thrown within the body of the method (or in setup/ teardown) that
is causing the test to be ignored. Assumptions are regular exceptions
-- try wrapping in try/catch and dumping the stack trace if you can't locate it easily. Alternatively, I think the test execution dumps may
carry a full stack already?

Dawid


On Tue, Feb 21, 2017 at 7:23 PM, Joel Bernstein <joelsolr@gmail.com> wrote:
>
> A test I've just added is being ignored when it's being called= with the
> -Dtestmethod.
>
> Here is the command line:
>
> ant test -Dtestcase=3DStreamExpressionTest
> -Dtestmethod=3DtestSignifcantTermsStream
>
>
> Here are some snippets from the output:
> ------------------------------
> ------------------------------
>
> [junit4]=C2=A0 =C2=A02> 6440 INFO
> (TEST-StreamExpressionTest.testSignifcantTermsStream-seed#[6= 19661D6DA496076])
> [=C2=A0 =C2=A0 ] o.a.s.SolrTestCaseJ4 ###Ending testSignifcantTermsStr= eam
>
>=C2=A0 =C2=A0 [junit4] IGNOR/A 0.18s | StreamExpressionTest.testSignifcantTermsStream
>
>=C2=A0 =C2=A0 [junit4]=C2=A0 =C2=A0 > Assumption #1: got: <false&= gt;, expected: is <true>
>
> ....
>
>=C2=A0 [junit4] Tests summary: 1 suite, 1 test, 1 ignored (1 assumption= )
>
> -------------------------------------
>
> -------------------------------------
>
> Is anyone else seeing this behavior or have any idea why this might be=
> happening?
>
>
>
> Thanks

-------------------------------------------------= --------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org



--94eb2c088930e8a16205490fd49c--