flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vijikarthi <vijikar...@yahoo.com>
Subject Re: Shading Plugin + Hadoop Dependency
Date Fri, 24 Jun 2016 15:09:11 GMT
Any modifications to "flink-shaded-include-yarn-tests" with respect to the
dependency inclusion/exclusion does not get reflected in the
"flink-yarn-tests" test case since the referenced packages from
"flink-shaded-include-yarn-tests" are not being used (though the pom file
establish the dependency). I am able to confirm by deleting the dependency
chain from the "flink-shaded-include-yarn-tests" and rerun the
"flink-yarn-tests" IT test cases. The reason why this works because of the
reference to the "flink-shaded-includeyarn-tests" packages from "local"
maven repository being in the classpath.

I would like to understand if this has been designed like this or is it a
bug? I am not able to succesfully include a new package (hadoop-minikdc) and
write new test cases to run "Yarn" test module. Any help is highly

I use below commands to run the "test" module and in case if that is
incorrect please let me know the right way to run the tests.

mvn clean package (to build the source and run unit test)
mvn clean verify -pl flink-yarn-tests -Pinclude-yarn-tests (to run Yarn
I also use the filter ( -Dtest=YARNSessionFIFOITCase#testJavaAPI ) to run
specific test case.

P.S: I have also noticed the surefile plugin is not stable and sometimes it
throws some wierd issues which is very difficult to debug.


View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Shading-Plugin-Hadoop-Dependency-tp12174p12232.html
Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.

View raw message