Return-Path: 
 <users-return-125996-apmail-maven-users-archive=maven.apache.org@maven.apache.org>
X-Original-To: apmail-maven-users-archive@www.apache.org
Delivered-To: apmail-maven-users-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 7768496EC
	for <apmail-maven-users-archive@www.apache.org>;
 Fri,  2 Mar 2012 20:08:12 +0000 (UTC)
Received: (qmail 53364 invoked by uid 500); 2 Mar 2012 20:08:10 -0000
Delivered-To: apmail-maven-users-archive@maven.apache.org
Received: (qmail 53299 invoked by uid 500); 2 Mar 2012 20:08:10 -0000
Mailing-List: contact users-help@maven.apache.org; run by ezmlm
Precedence: bulk
List-Unsubscribe: <mailto:users-unsubscribe@maven.apache.org>
List-Help: <mailto:users-help@maven.apache.org>
List-Post: <mailto:users@maven.apache.org>
List-Id: "Maven Users List" <users.maven.apache.org>
Reply-To: "Maven Users List" <users@maven.apache.org>
Delivered-To: mailing list users@maven.apache.org
Received: (qmail 53289 invoked by uid 99); 2 Mar 2012 20:08:10 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Mar 2012 20:08:10 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
	tests=SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [67.111.226.163] (HELO secure.casenetinc.com) (67.111.226.163)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 02 Mar 2012 20:08:02 +0000
X-IronPort-AV: E=Sophos;i="4.73,519,1325480400";
   d="scan'208";a="1073516"
Received: from casenet5.cninc.com (HELO mail.casenetinc.com) ([10.12.10.77])
  by secure.casenetinc.com with ESMTP/TLS/RC4-MD5; 02 Mar 2012 15:07:41 -0500
Received: from casenet5.cninc.com ([10.12.10.77]) by casenet5.cninc.com
 ([10.12.10.77]) with mapi; Fri, 2 Mar 2012 15:07:42 -0500
From: Steven Blundy <sblundy@casenetllc.com>
To: "users@maven.apache.org" <users@maven.apache.org>
Date: Fri, 2 Mar 2012 15:07:40 -0500
Subject: Surefire + TestNG: Success Percentage not handled correctly
Thread-Topic: Surefire + TestNG: Success Percentage not handled correctly
Thread-Index: Acz4sB8gw+KQtp6eRZap09hQOwYe7Q==
Message-ID: <045C0444B9B4C044BA5864D0AF9BA8E6053328BD38@casenet5.cninc.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Virus-Checked: Checked by ClamAV on apache.org

I have a wait test that I expect to fail on occasion because the test threa=
ds get too out of sync. So, using TestNG, I'm setting the successPercentage=
 and invocationCount to handle the occasional acceptable failure. If the co=
de's broken, none of the invocations will pass.

When I run the test in IntelliJ, everything's fine. But when I try and do a=
 build in maven, I get the following

Tests run: 1407, Failures: 0, Errors: 1, Skipped: 0

[INFO] --------------------------------------------------------------------=
----
[ERROR] BUILD FAILURE
[INFO] --------------------------------------------------------------------=
----
[INFO] There are test failures.

Looking in restng-results.xml, I see this:

  <test-method status=3D"SUCCESS_PERCENTAGE_FAILURE" signature=3D"waits()" =
name=3D"waits" duration-ms=3D"1000" started-at=3D"2012-03-02T13:51:58Z" fin=
ished-at=3D"2012-03-02T13:51:59Z">

And in TEST-TestSuite.xml, I see:

  <testcase classname=3D"com.casenet.integration.filesystem.TriggerFileList=
enerTest" time=3D"1" name=3D"waits">
    <error type=3D"java.lang.AssertionError" message=3D"expected:&lt;EXECUT=
E&gt; but was:&lt;TIMED_OUT&gt;">java.lang.AssertionError: expected:&lt;EXE=
CUTE&gt; but was:&lt;TIMED_OUT&gt;

The rest of the testng generated files seem to think everything passed. But=
 it looks like that surefire is getting confused by SUCCESS_PERCENTAGE_FAIL=
URE or the <error/> element into thinking something's gone wrong when in fa=
ct nothing unexpected happened.

Anyone know if this is a known problem or if there's a solution available?


Steve

CONFIDENTIALITY NOTICE:  This e-mail and the information transmitted within=
 including any attachments is only for the recipient(s) to which it is inte=
nded and may contain confidential and/or privileged material. Any review, r=
etransmission, dissemination or other use of; or taking of any action in re=
liance upon this information by persons or entities other than the intended=
 recipient is prohibited. If you received this in error, please send the e-=
mail back by replying to the sender and permanently delete the entire messa=
ge and its attachments from all computers and network systems involved in i=
ts receipt.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org