maven-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SUREFIRE-1306) JUnit4RerunFailingTestsIT does not execute with the JUnit version configured in the test
Date Fri, 25 Nov 2016 19:42:58 GMT

    [ https://issues.apache.org/jira/browse/SUREFIRE-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696558#comment-15696558
] 

ASF GitHub Bot commented on SUREFIRE-1306:
------------------------------------------

Github user britter commented on the issue:

    https://github.com/apache/maven-surefire/pull/132
  
    @Tibor17 find the build log for running the tests with JUnit 4.7 below. I have not investigated
whether it is a regression in JUnit 4.7 or in whether it is a defect in mavne-sureifre. It
works with JUnit 4.4 and JUnit 4.12. So probably a regression in 4.7?
    
    ```
    /Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/bin/java -ea -Dsurefire.version=2.19.1
-Dtestng.version=5.7 "-Dmaven.home=/Applications/IntelliJ IDEA.app/Contents/plugins/maven/lib/maven3"
-Dmaven.settings.file=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/private/it-settings.xml
-Dmaven.repo.local=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/it-repo
-Dmaven.test.tmpdir=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target
-Duser.localRepository=/Users/bene/.m2/repository -DuseInterpolatedSettings=false -DtestBuildDirectory=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/test-classes
-Dverifier.forkMode=auto -Didea.launcher.port=7534 "-Didea.launcher.bin.path=/Applications/IntelliJ
IDEA.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath "/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar:/Applications/IntelliJ
IDEA.app/Contents/plugins/junit/lib/junit-rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/tools.jar:/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/test-classes:/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/classes:/Users/bene/workspace/apache/maven/maven-surefire/surefire-report-parser/target/classes:/Users/bene/workspace/apache/maven/maven-surefire/surefire-logger-api/target/classes:/Users/bene/.m2/repository/org/apache/maven/reporting/maven-reporting-api/3.0/maven-reporting-api-3.0.jar:/Users/bene/.m2/repository/org/apache/maven/doxia/doxia-sink-api/1.0/doxia-sink-api-1.0.jar:/Users/bene/.m2/repository/org/apache/maven/shared/maven-verifier/1.6/maven-verifier-1.6.jar:/Users/bene/.m2/repository/org/apache/maven/maven-settings/2.0.6/maven-settings-2.0.6.jar:/Users/bene/.m2/repository/org/apache/maven/maven-model/2.2.1/maven-model-2.2.1.jar:/Users/bene/.m2/repository/org/codehaus/plexus/plexus-utils/1.4.1/plexus-utils-1.4.1.jar:/Users/bene/.m2/repository/org/codehaus/plexus/plexus-container-default/1.0-alpha-9-stable-1/plexus-container-default-1.0-alpha-9-stable-1.jar:/Users/bene/.m2/repository/classworlds/classworlds/1.1-alpha-2/classworlds-1.1-alpha-2.jar:/Users/bene/.m2/repository/net/sourceforge/htmlunit/htmlunit/2.8/htmlunit-2.8.jar:/Users/bene/.m2/repository/xalan/xalan/2.7.1/xalan-2.7.1.jar:/Users/bene/.m2/repository/xalan/serializer/2.7.1/serializer-2.7.1.jar:/Users/bene/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/Users/bene/.m2/repository/commons-lang/commons-lang/2.4/commons-lang-2.4.jar:/Users/bene/.m2/repository/org/apache/httpcomponents/httpclient/4.0.1/httpclient-4.0.1.jar:/Users/bene/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar:/Users/bene/.m2/repository/org/apache/httpcomponents/httpmime/4.0.1/httpmime-4.0.1.jar:/Users/bene/.m2/repository/org/apache/james/apache-mime4j/0.6/apache-mime4j-0.6.jar:/Users/bene/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/Users/bene/.m2/repository/net/sourceforge/htmlunit/htmlunit-core-js/2.8/htmlunit-core-js-2.8.jar:/Users/bene/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/Users/bene/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/Users/bene/.m2/repository/net/sourceforge/nekohtml/nekohtml/1.9.14/nekohtml-1.9.14.jar:/Users/bene/.m2/repository/net/sourceforge/cssparser/cssparser/0.9.5/cssparser-0.9.5.jar:/Users/bene/.m2/repository/org/w3c/css/sac/1.3/sac-1.3.jar:/Users/bene/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar:/Users/bene/.m2/repository/org/apache/maven/maven-artifact/2.2.1/maven-artifact-2.2.1.jar:/Users/bene/.m2/repository/org/apache/maven/shared/maven-shared-utils/0.9/maven-shared-utils-0.9.jar:/Users/bene/.m2/repository/com/google/code/findbugs/jsr305/2.0.1/jsr305-2.0.1.jar:/Users/bene/.m2/repository/commons-io/commons-io/2.2/commons-io-2.2.jar:/Users/bene/.m2/repository/org/apache/commons/commons-lang3/3.1/commons-lang3-3.1.jar:/Users/bene/.m2/repository/junit/junit/4.12/junit-4.12.jar:/Users/bene/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/Users/bene/.m2/repository/org/hamcrest/hamcrest-library/1.3/hamcrest-library-1.3.jar:/Users/bene/.m2/repository/org/easytesting/fest-assert/1.4/fest-assert-1.4.jar:/Users/bene/.m2/repository/org/easytesting/fest-util/1.1.6/fest-util-1.1.6.jar"
com.intellij.rt.execution.application.AppMain com.intellij.rt.execution.junit.JUnitStarter
-ideVersion5 org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT
    
    org.apache.maven.surefire.its.fixture.SurefireVerifierException: org.apache.maven.it.VerificationException:
Text not found in log: Run 1: FlakyFirstTimeTest.testFailingTestOne
    
    	at org.apache.maven.surefire.its.fixture.OutputValidator.verifyTextInLog(OutputValidator.java:60)
    	at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.verifyFailuresOneRetry(JUnit4RerunFailingTestsIT.java:220)
    	at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.verifyFailuresOneRetryAllClasses(JUnit4RerunFailingTestsIT.java:193)
    	at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.testRerunFailingErrorTestsWithOneRetry(JUnit4RerunFailingTestsIT.java:58)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
    	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
    	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
    	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
    	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
    	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
    	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
    	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
    	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
    	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
    	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
    	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
    	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
    	at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
    	at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51)
    	at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237)
    	at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
    Caused by: org.apache.maven.it.VerificationException: Text not found in log: Run 1: FlakyFirstTimeTest.testFailingTestOne
    	at org.apache.maven.it.Verifier.verifyTextInLog(Verifier.java:325)
    	at org.apache.maven.surefire.its.fixture.OutputValidator.verifyTextInLog(OutputValidator.java:56)
    	... 30 more
    
    
    org.apache.maven.surefire.its.fixture.SurefireVerifierException: Exit code was non-zero:
1; command line and log = 
    /Applications/IntelliJ IDEA.app/Contents/plugins/maven/lib/maven3/bin/mvn -e --batch-mode
-Dmaven.repo.local=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/it-repo
org.apache.maven.plugins:maven-clean-plugin:clean -Dsurefire.version=2.19.1 -DtestNgVersion=5.7
-DtestNgClassifier=jdk15 -Dprovider=surefire-junit4 -Djunit.version=4.7 -Dsurefire.rerunFailingTestsCount=2
-Dparallel=methods -DuseUnlimitedThreads=true test
    Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was
removed in 8.0
    [INFO] Error stacktraces are turned on.
    [INFO] Scanning for projects...
    [WARNING] 
    [WARNING] Some problems were encountered while building the effective model for org.apache.maven.plugins.surefire:junit4-rerun-failing-tests:jar:1.0-SNAPSHOT
    [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin
is missing. @ line 42, column 15
    [WARNING] 
    [WARNING] It is highly recommended to fix these problems because they threaten the stability
of your build.
    [WARNING] 
    [WARNING] For this reason, future Maven versions might no longer support building such
malformed projects.
    [WARNING] 
    [INFO]                                                                         
    [INFO] ------------------------------------------------------------------------
    [INFO] Building Test for rerun failing tests in JUnit 4 1.0-SNAPSHOT
    [INFO] ------------------------------------------------------------------------
    [INFO] 
    [INFO] --- maven-clean-plugin:2.5:clean (default-cli) @ junit4-rerun-failing-tests ---
    [INFO] Deleting /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target
    [INFO] 
    [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ junit4-rerun-failing-tests
---
    [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build
is platform dependent!
    [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/main/resources
    [INFO] 
    [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ junit4-rerun-failing-tests
---
    [INFO] No sources to compile
    [INFO] 
    [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ junit4-rerun-failing-tests
---
    [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build
is platform dependent!
    [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/test/resources
    [INFO] 
    [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ junit4-rerun-failing-tests
---
    [INFO] Changes detected - recompiling the module!
    [WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is
platform dependent!
    [INFO] Compiling 2 source files to /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/test-classes
    [INFO] 
    [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ junit4-rerun-failing-tests
---
    [INFO] Surefire report directory: /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/surefire-reports
    [INFO] parallel='methods', perCoreThreadCount=true, threadCount=0, useUnlimitedThreads=true,
threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true
    
    -------------------------------------------------------
     T E S T S
    -------------------------------------------------------
    Running junit4.FlakyFirstTimeTest
    Error test
    Failing test
    Passing test
    Tests run: 3, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 0.005 sec <<<
FAILURE! - in junit4.FlakyFirstTimeTest
    testErrorTestOne(junit4.FlakyFirstTimeTest)  Time elapsed: 0.005 sec  <<< ERROR!
    java.lang.IllegalArgumentException: ...
    	at junit4.FlakyFirstTimeTest.testErrorTestOne(FlakyFirstTimeTest.java:53)
    
    testFailingTestOne(junit4.FlakyFirstTimeTest)  Time elapsed: 0.005 sec  <<< FAILURE!
    java.lang.AssertionError: Failing test
    	at junit4.FlakyFirstTimeTest.testFailingTestOne(FlakyFirstTimeTest.java:41)
    
    Running junit4.PassingTest
    Passing test one
    Passing test two
    Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in junit4.PassingTest
    
    Results :
    
    Failed tests: 
      FlakyFirstTimeTest.testFailingTestOne:41 Failing test
    Tests in error: 
      FlakyFirstTimeTest.testErrorTestOne:53 IllegalArgument ...
    
    Tests run: 5, Failures: 1, Errors: 1, Skipped: 0
    
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 2.470 s
    [INFO] Finished at: 2016-11-25T20:39:31+01:00
    [INFO] Final Memory: 16M/209M
    [INFO] ------------------------------------------------------------------------
    [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
(default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
failed: There was an error in the forked process
    [ERROR] java.lang.NullPointerException
    [ERROR] at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
    [ERROR] -> [Help 1]
    org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
(default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
failed: There was an error in the forked process
    java.lang.NullPointerException
    	at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
    	at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
    	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
    	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
    	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
    
    	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
    	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
    	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
    	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
    	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
    	at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
    	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
    	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
    	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
    	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
    	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
    	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
    	at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
    Caused by: org.apache.maven.plugin.PluginExecutionException: Execution default-test of
goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error
in the forked process
    java.lang.NullPointerException
    	at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
    	at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
    	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
    	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
    	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
    
    	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145)
    	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
    	... 20 more
    Caused by: java.lang.RuntimeException: There was an error in the forked process
    java.lang.NullPointerException
    	at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
    	at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
    	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
    	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
    	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
    
    	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:584)
    	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:460)
    	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:229)
    	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:201)
    	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1026)
    	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:862)
    	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:755)
    	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
    	... 21 more
    [ERROR] 
    [ERROR] Re-run Maven using the -X switch to enable full debug logging.
    [ERROR] 
    [ERROR] For more information about the errors and possible solutions, please read the
following articles:
    [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
    
    
    	at org.apache.maven.surefire.its.fixture.MavenLauncher.executeCurrentGoals(MavenLauncher.java:308)
    	at org.apache.maven.surefire.its.fixture.MavenLauncher.execute(MavenLauncher.java:262)
    	at org.apache.maven.surefire.its.fixture.MavenLauncher.conditionalExec(MavenLauncher.java:231)
    	at org.apache.maven.surefire.its.fixture.MavenLauncher.executeTest(MavenLauncher.java:223)
    	at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.testRerunFailingErrorTestsTwoRetry(JUnit4RerunFailingTestsIT.java:85)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
    	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
    	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
    	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
    	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
    	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
    	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
    	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
    	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
    	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
    	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
    	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
    	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
    	at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
    	at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51)
    	at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237)
    	at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
    Caused by: org.apache.maven.it.VerificationException: Exit code was non-zero: 1; command
line and log = 
    /Applications/IntelliJ IDEA.app/Contents/plugins/maven/lib/maven3/bin/mvn -e --batch-mode
-Dmaven.repo.local=/Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/../surefire-setup-integration-tests/target/it-repo
org.apache.maven.plugins:maven-clean-plugin:clean -Dsurefire.version=2.19.1 -DtestNgVersion=5.7
-DtestNgClassifier=jdk15 -Dprovider=surefire-junit4 -Djunit.version=4.7 -Dsurefire.rerunFailingTestsCount=2
-Dparallel=methods -DuseUnlimitedThreads=true test
    Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was
removed in 8.0
    [INFO] Error stacktraces are turned on.
    [INFO] Scanning for projects...
    [WARNING] 
    [WARNING] Some problems were encountered while building the effective model for org.apache.maven.plugins.surefire:junit4-rerun-failing-tests:jar:1.0-SNAPSHOT
    [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin
is missing. @ line 42, column 15
    [WARNING] 
    [WARNING] It is highly recommended to fix these problems because they threaten the stability
of your build.
    [WARNING] 
    [WARNING] For this reason, future Maven versions might no longer support building such
malformed projects.
    [WARNING] 
    [INFO]                                                                         
    [INFO] ------------------------------------------------------------------------
    [INFO] Building Test for rerun failing tests in JUnit 4 1.0-SNAPSHOT
    [INFO] ------------------------------------------------------------------------
    [INFO] 
    [INFO] --- maven-clean-plugin:2.5:clean (default-cli) @ junit4-rerun-failing-tests ---
    [INFO] Deleting /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target
    [INFO] 
    [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ junit4-rerun-failing-tests
---
    [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build
is platform dependent!
    [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/main/resources
    [INFO] 
    [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ junit4-rerun-failing-tests
---
    [INFO] No sources to compile
    [INFO] 
    [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ junit4-rerun-failing-tests
---
    [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build
is platform dependent!
    [INFO] skip non existing resourceDirectory /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/src/test/resources
    [INFO] 
    [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ junit4-rerun-failing-tests
---
    [INFO] Changes detected - recompiling the module!
    [WARNING] File encoding has not been set, using platform encoding UTF-8, i.e. build is
platform dependent!
    [INFO] Compiling 2 source files to /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/test-classes
    [INFO] 
    [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ junit4-rerun-failing-tests
---
    [INFO] Surefire report directory: /Users/bene/workspace/apache/maven/maven-surefire/surefire-integration-tests/target/JUnit4RerunFailingTestsIT_testRerunFailingErrorTestsTwoRetry/target/surefire-reports
    [INFO] parallel='methods', perCoreThreadCount=true, threadCount=0, useUnlimitedThreads=true,
threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true
    
    -------------------------------------------------------
     T E S T S
    -------------------------------------------------------
    Running junit4.FlakyFirstTimeTest
    Error test
    Failing test
    Passing test
    Tests run: 3, Failures: 1, Errors: 1, Skipped: 0, Time elapsed: 0.005 sec <<<
FAILURE! - in junit4.FlakyFirstTimeTest
    testErrorTestOne(junit4.FlakyFirstTimeTest)  Time elapsed: 0.005 sec  <<< ERROR!
    java.lang.IllegalArgumentException: ...
    	at junit4.FlakyFirstTimeTest.testErrorTestOne(FlakyFirstTimeTest.java:53)
    
    testFailingTestOne(junit4.FlakyFirstTimeTest)  Time elapsed: 0.005 sec  <<< FAILURE!
    java.lang.AssertionError: Failing test
    	at junit4.FlakyFirstTimeTest.testFailingTestOne(FlakyFirstTimeTest.java:41)
    
    Running junit4.PassingTest
    Passing test one
    Passing test two
    Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in junit4.PassingTest
    
    Results :
    
    Failed tests: 
      FlakyFirstTimeTest.testFailingTestOne:41 Failing test
    Tests in error: 
      FlakyFirstTimeTest.testErrorTestOne:53 IllegalArgument ...
    
    Tests run: 5, Failures: 1, Errors: 1, Skipped: 0
    
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 2.470 s
    [INFO] Finished at: 2016-11-25T20:39:31+01:00
    [INFO] Final Memory: 16M/209M
    [INFO] ------------------------------------------------------------------------
    [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
(default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
failed: There was an error in the forked process
    [ERROR] java.lang.NullPointerException
    [ERROR] at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
    [ERROR] at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
    [ERROR] at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
    [ERROR] -> [Help 1]
    org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
(default-test) on project junit4-rerun-failing-tests: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
failed: There was an error in the forked process
    java.lang.NullPointerException
    	at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
    	at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
    	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
    	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
    	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
    
    	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
    	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
    	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
    	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
    	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
    	at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
    	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
    	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
    	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
    	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
    	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
    	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
    	at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
    	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
    Caused by: org.apache.maven.plugin.PluginExecutionException: Execution default-test of
goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test failed: There was an error
in the forked process
    java.lang.NullPointerException
    	at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
    	at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
    	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
    	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
    	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
    
    	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145)
    	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
    	... 20 more
    Caused by: java.lang.RuntimeException: There was an error in the forked process
    java.lang.NullPointerException
    	at org.apache.maven.surefire.common.junit4.JUnit4RunListener.rethrowAnyTestMechanismFailures(JUnit4RunListener.java:205)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:138)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
    	at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
    	at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
    	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
    	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
    	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
    
    	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:584)
    	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:460)
    	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:229)
    	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:201)
    	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1026)
    	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:862)
    	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:755)
    	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
    	... 21 more
    [ERROR] 
    [ERROR] Re-run Maven using the -X switch to enable full debug logging.
    [ERROR] 
    [ERROR] For more information about the errors and possible solutions, please read the
following articles:
    [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
    
    	at org.apache.maven.it.Verifier.executeGoals(Verifier.java:1369)
    	at org.apache.maven.surefire.its.fixture.MavenLauncher.executeCurrentGoals(MavenLauncher.java:299)
    	... 31 more
    
    
    junit.framework.AssertionFailedError: wrong number of tests 
    Expected :1
    Actual   :3
     <Click to see difference>
    
    
    	at junit.framework.Assert.fail(Assert.java:57)
    	at junit.framework.Assert.failNotEquals(Assert.java:329)
    	at junit.framework.Assert.assertEquals(Assert.java:78)
    	at junit.framework.Assert.assertEquals(Assert.java:234)
    	at org.apache.maven.surefire.its.fixture.HelperAssertions.assertTestSuiteResults(HelperAssertions.java:84)
    	at org.apache.maven.surefire.its.fixture.HelperAssertions.assertTestSuiteResults(HelperAssertions.java:98)
    	at org.apache.maven.surefire.its.fixture.HelperAssertions.assertTestSuiteResults(HelperAssertions.java:56)
    	at org.apache.maven.surefire.its.fixture.OutputValidator.assertTestSuiteResults(OutputValidator.java:151)
    	at org.apache.maven.surefire.its.JUnit4RerunFailingTestsIT.testRerunOneTestMethod(JUnit4RerunFailingTestsIT.java:177)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
    	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
    	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
    	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
    	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
    	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
    	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
    	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
    	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
    	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
    	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
    	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
    	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
    	at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68)
    	at com.intellij.rt.execution.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:51)
    	at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:237)
    	at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:70)
    	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    	at java.lang.reflect.Method.invoke(Method.java:498)
    	at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
    
    
    Process finished with exit code 255
    ```


> JUnit4RerunFailingTestsIT does not execute with the JUnit version configured in the test
> ----------------------------------------------------------------------------------------
>
>                 Key: SUREFIRE-1306
>                 URL: https://issues.apache.org/jira/browse/SUREFIRE-1306
>             Project: Maven Surefire
>          Issue Type: Test
>            Reporter: Benedikt Ritter
>            Assignee: Tibor Digana
>             Fix For: 2.19.2
>
>
> All the test methods in JUnit4RerunFailingTestsIT set JUnit Version explicitly to 4.7
by calling {{setJUnitVersion( "4.7" )}}. This will in turn set the system property {{junit.version}}.
The problem with this is, that the pom.xml in the test project (junit4-rerun-failing-tests)
uses the property {{junitVersion}} instead. The version is set to 4.4 in pom.xml. Furthermore
using JUnit 4.7 version in pom.xml results in test failures.
> Suggested solution: Drop the {{junitVersion}} property from pom.xml and use {{junit.version}}
instead, making it possible to set the version from the test cases. Use version 4.12, since
there seems to be a regression in 4.7 causing the test to fail with this version.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message