flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nick Dimiduk <ndimi...@apache.org>
Subject flink-dist packaging including unshaded classes
Date Tue, 08 Dec 2015 20:25:18 GMT
Hi there,

I'm attempting to build locally a flink based on release-0.10.0 +
FLINK-3147. When I build from this sandbox, the resulting flink-dist.jar
contains both shanded and unshaded jars. In my case, this results in a
runtime conflict in my application, where com.google.common.base.Stopwatch
from both Guava-12 and Guava-18 are in my classpath.

Is there some additional profile required to build a dist package with only
the shaded jars?

Thanks,
Nick

$ tar xvzf flink-0.10.0-bin-hadoop27-scala_2.11.tgz
$ cd flink-0.10.0
$ $ unzip -t lib/flink-dist_2.11-0.10.0.jar | grep Stopwatch
    testing:
org/apache/flink/shaded/com/google/common/base/Stopwatch$1.class   OK
    testing: org/apache/flink/shaded/com/google/common/base/Stopwatch.class
  OK
    testing:
org/apache/flink/shaded/com/google/common/util/concurrent/RateLimiter$SleepingStopwatch$1.class
  OK
    testing:
org/apache/flink/shaded/com/google/common/util/concurrent/RateLimiter$SleepingStopwatch.class
  OK
    testing:
org/apache/flink/hadoop/shaded/com/google/common/base/Stopwatch$1.class   OK
    testing:
org/apache/flink/hadoop/shaded/com/google/common/base/Stopwatch.class   OK
    testing: com/google/inject/internal/util/$Stopwatch.class   OK

vs.

$ git status
HEAD detached from release-0.10.0
$ git log --decorate=short --oneline | head -n3
dccdbd8 (HEAD) [FLINK-3147] HadoopOutputFormatBase should expose fields as
protected
ab2cca4 (tag: release-0.10.0, origin/release-0.10.0-rc8,
ndimiduk/release-0.10.0-rc8) Commit for release 0.10.0
c0fe305 [FLINK-2992] Remove use of SerializationUtils
$ mvn clean install -DskipTests
...
$ cd flink-dist/target/flink-0.10.0-bin/flink-0.10.0
$ unzip -t lib/flink-dist-0.10.0.jar | grep Stopwatch
    testing:
org/apache/flink/shaded/com/google/common/base/Stopwatch$1.class   OK
    testing: org/apache/flink/shaded/com/google/common/base/Stopwatch.class
  OK
    testing:
org/apache/flink/shaded/com/google/common/util/concurrent/RateLimiter$SleepingStopwatch$1.class
  OK
    testing:
org/apache/flink/shaded/com/google/common/util/concurrent/RateLimiter$SleepingStopwatch.class
  OK
    testing:
org/apache/flink/hadoop/shaded/com/google/common/base/Stopwatch$1.class   OK
    testing:
org/apache/flink/hadoop/shaded/com/google/common/base/Stopwatch.class   OK
    testing: com/google/inject/internal/util/$Stopwatch.class   OK
    testing: com/google/common/base/Stopwatch$1.class   OK
    testing: com/google/common/base/Stopwatch.class   OK
    testing:
com/google/common/util/concurrent/RateLimiter$SleepingStopwatch$1.class   OK
    testing:
com/google/common/util/concurrent/RateLimiter$SleepingStopwatch.class   OK

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message