Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3B8FA1826B for ; Tue, 19 May 2015 10:50:10 +0000 (UTC) Received: (qmail 29755 invoked by uid 500); 19 May 2015 10:50:10 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 29688 invoked by uid 500); 19 May 2015 10:50:10 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 29673 invoked by uid 99); 19 May 2015 10:50:10 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 May 2015 10:50:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id A0B18C20B3 for ; Tue, 19 May 2015 10:50:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.999 X-Spam-Level: *** X-Spam-Status: No, score=3.999 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H2=-0.001] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id V9GHNHTQNuva for ; Tue, 19 May 2015 10:50:06 +0000 (UTC) Received: from mail-yh0-f43.google.com (mail-yh0-f43.google.com [209.85.213.43]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id AF13E23151 for ; Tue, 19 May 2015 10:50:05 +0000 (UTC) Received: by yhda23 with SMTP id a23so2890679yhd.2 for ; Tue, 19 May 2015 03:49:58 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to :content-type; bh=ab5bcW887P+BLm4+OEfnmX3kz5HaPXB0P28rh7bqNhE=; b=UbBaDVTbO766c0YFuJHA2QR2h2B6IjtxGsC4dnZFeRMT/fCTUqOB0BMofv8svu+FmD 4cNr1hWHwZyD6CrPPmgIy0yvV43quUtikF5Lr//ref9KKqX0OQ/f+oYihk04c+kSTWsv gxRnv221hfRouqw8iOfgud7D6TWzFTKTGTKFMn3If5b5/hep0OnIdAxeCs9dRUlaTZ2x rx6NLSj1HX6QGfv8liNI7fNUYh7Kl0Qz0LdnGYRSAmukkLglbxQrU2RYcGQUBrAARSoh mFwLYu5IkyLioHKAOqejvCvnZJF83MGWR8QkFqi+OU1PWIYLdJy07HBftHJt40du4iZY kreg== X-Gm-Message-State: ALoCoQnRL+cKxCk6MV5h5NZtQbC4je2wWn1lUeaFSLu03+lrWdmszFFGJakHVZj4jpfUPojZnI0T X-Received: by 10.170.194.9 with SMTP id l9mr29392373yke.28.1432032598200; Tue, 19 May 2015 03:49:58 -0700 (PDT) MIME-Version: 1.0 Received: by 10.13.220.135 with HTTP; Tue, 19 May 2015 03:49:37 -0700 (PDT) X-Originating-IP: [213.203.177.29] From: Flavio Pompermaier Date: Tue, 19 May 2015 12:49:37 +0200 Message-ID: Subject: ClassReader could not be created To: user Content-Type: multipart/alternative; boundary=001a1139f6e252a5fa05166d127b --001a1139f6e252a5fa05166d127b Content-Type: text/plain; charset=UTF-8 Hi to all, I tried to run my job on a brand new Flink cluster (0.9-SNAPSHOT) from the web client using the shading strategy of the quickstart example but I get this exception: Caused by: java.lang.RuntimeException: Could not create ClassReader: java.io.IOException: Class not found at org.apache.flink.api.java.ClosureCleaner.getClassReader(ClosureCleaner.java:42) at org.apache.flink.api.java.ClosureCleaner.cleanThis0(ClosureCleaner.java:67) at org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:54) It seems that it cannot find some kryo class..how do I fix this? this is my shade plugin section of pom.xml: org.apache.maven.plugins maven-shade-plugin 1.4 package shade org.apache.flink:flink-shaded-* org.apache.flink:flink-core org.apache.flink:flink-java org.apache.flink:flink-scala org.apache.flink:flink-runtime org.apache.flink:flink-optimizer org.apache.flink:flink-clients org.apache.flink:flink-spargel org.apache.flink:flink-avro org.apache.flink:flink-java-examples org.apache.flink:flink-scala-examples org.apache.flink:flink-streaming-examples org.apache.flink:flink-streaming-core org.scala-lang:scala-library org.scala-lang:scala-compiler org.scala-lang:scala-reflect com.amazonaws:aws-java-sdk com.typesafe.akka:akka-actor_* com.typesafe.akka:akka-remote_* com.typesafe.akka:akka-slf4j_* io.netty:netty-all io.netty:netty org.eclipse.jetty:jetty-server org.eclipse.jetty:jetty-continuation org.eclipse.jetty:jetty-http org.eclipse.jetty:jetty-io org.eclipse.jetty:jetty-util org.eclipse.jetty:jetty-security org.eclipse.jetty:jetty-servlet commons-fileupload:commons-fileupload org.apache.avro:avro commons-collections:commons-collections org.codehaus.jackson:jackson-core-asl org.codehaus.jackson:jackson-mapper-asl com.thoughtworks.paranamer:paranamer org.xerial.snappy:snappy-java org.apache.commons:commons-compress org.tukaani:xz com.esotericsoftware.kryo:kryo com.esotericsoftware.minlog:minlog org.objenesis:objenesis com.twitter:chill_* com.twitter:chill-java com.twitter:chill-avro_* com.twitter:chill-bijection_* com.twitter:bijection-core_* com.twitter:bijection-avro_* com.twitter:chill-protobuf com.google.protobuf:protobuf-java com.twitter:chill-thrift org.apache.thrift:libthrift commons-lang:commons-lang junit:junit de.javakaffee:kryo-serializers joda-time:joda-time org.apache.commons:commons-lang3 org.slf4j:slf4j-api org.slf4j:slf4j-log4j12 log4j:log4j org.apache.commons:commons-math org.apache.sling:org.apache.sling.commons.json commons-logging:commons-logging org.apache.httpcomponents:httpclient org.apache.httpcomponents:httpcore commons-codec:commons-codec com.fasterxml.jackson.core:jackson-core com.fasterxml.jackson.core:jackson-databind com.fasterxml.jackson.core:jackson-annotations org.codehaus.jettison:jettison stax:stax-api com.typesafe:config org.uncommons.maths:uncommons-maths com.github.scopt:scopt_* org.mortbay.jetty:servlet-api commons-io:commons-io commons-cli:commons-cli org.apache.flink:* org/apache/flink/shaded/** web-docs/** false XXXX XXX --001a1139f6e252a5fa05166d127b Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi to all,
=

I tried to run my job on a brand new Flink cluster (0.9-SNAPSHOT) from= the web client using the shading strategy of the quickstart example but I = get this exception:

Caused by: java.lang.Runt= imeException: Could not create ClassReader: java.io.IOException: Class not = found
at org.a= pache.flink.api.java.ClosureCleaner.getClassReader(ClosureCleaner.java:42)<= /div>
at org.apache.= flink.api.java.ClosureCleaner.cleanThis0(ClosureCleaner.java:67)
= at org.apache.flink.api.= java.ClosureCleaner.clean(ClosureCleaner.java:54)

It seems that it cannot find some kryo class..how do I fix this? this= is my shade plugin section of pom.xml:


<= /div>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>= ;maven-shade-plugin</artifactId>
<version>1.4</version>
<executions>
= <execution>
=
<phase>pack= age</phase>
<= /span><goals>
= <goal>shade</goal>
</goals>
<configuration>
<artifactSet>
<excludes>
=
<!-- This l= ist contains all dependencies of flink-dist Everything=C2=A0
else will be packaged = into the fat-jar -->
<exclude>org.apache.flink:flink-shaded-*</exclude&g= t;
<ex= clude>org.apache.flink:flink-core</exclude>
<exclude>org.apache.flin= k:flink-java</exclude>
<exclude>org.apache.flink:flink-scala</exclude= >
<= exclude>org.apache.flink:flink-runtime</exclude>
<exclude>org.apache.= flink:flink-optimizer</exclude>
<exclude>org.apache.flink:flink-clients&= lt;/exclude>
= <exclude>org.apache.flink:flink-spargel</exclude>
<= div> <exclude>= org.apache.flink:flink-avro</exclude>
<exclude>org.apache.flink:flink-ja= va-examples</exclude>
<exclude>org.apache.flink:flink-scala-examples<= /exclude>
<exclude>org.apache.flink:flink-streaming-examples</exclude>= ;
<exc= lude>org.apache.flink:flink-streaming-core</exclude>
<!--= Also exclude very big transitive dependencies of Flink WARNING:=C2=A0
You have to = remove these excludes if your code relies on other versions of=C2=A0
<= div> these dependen= cies. -->
<exclude>org.scala-lang:scala-library</exclude>
<= span class=3D"" style=3D"white-space:pre"> <exclude>org.s= cala-lang:scala-compiler</exclude>
<exclude>org.scala-lang:scala-refle= ct</exclude>
= <exclude>com.amazonaws:aws-java-sdk</exclude>
<exclude>c= om.typesafe.akka:akka-actor_*</exclude>
<exclude>com.typesafe.akka:akka-= remote_*</exclude>
<exclude>com.typesafe.akka:akka-slf4j_*</exclude&g= t;
<ex= clude>io.netty:netty-all</exclude>
<exclude>io.netty:netty</exclud= e>
<= ;exclude>org.eclipse.jetty:jetty-server</exclude>
<exclude>org.eclips= e.jetty:jetty-continuation</exclude>
<exclude>org.eclipse.jetty:jetty-ht= tp</exclude>
= <exclude>org.eclipse.jetty:jetty-io</exclude>
<exclude>o= rg.eclipse.jetty:jetty-util</exclude>
<exclude>org.eclipse.jetty:jetty-s= ecurity</exclude>
<exclude>org.eclipse.jetty:jetty-servlet</exclude&g= t;
<ex= clude>commons-fileupload:commons-fileupload</exclude>
<exclude>org.ap= ache.avro:avro</exclude>
<exclude>commons-collections:commons-collection= s</exclude>
= <exclude>org.codehaus.jackson:jackson-core-asl</exclude&g= t;
<ex= clude>org.codehaus.jackson:jackson-mapper-asl</exclude>
= <exclude>com.= thoughtworks.paranamer:paranamer</exclude>
<exclude>org.xerial.snappy:sn= appy-java</exclude>
<exclude>org.apache.commons:commons-compress</exc= lude>
= <exclude>org.tukaani:xz</exclude>
<exclude>com.esotericsoftware.kr= yo:kryo</exclude>
<exclude>com.esotericsoftware.minlog:minlog</exclud= e>
<= ;exclude>org.objenesis:objenesis</exclude>
<exclude>com.twitter:chi= ll_*</exclude>
= <exclude>com.twitter:chill-java</exclude>
<exclude>com= .twitter:chill-avro_*</exclude>
<exclude>com.twitter:chill-bijection_*&l= t;/exclude>
<= /span><exclude>com.twitter:bijection-core_*</exclude>
<exclude>com= .twitter:bijection-avro_*</exclude>
<exclude>com.twitter:chill-protobuf= </exclude>
= <exclude>com.google.protobuf:protobuf-java</exclude>
<exclude= >com.twitter:chill-thrift</exclude>
<exclude>org.apache.thrift:libthr= ift</exclude>
= <exclude>commons-lang:commons-lang</exclude>
<exclude>j= unit:junit</exclude>
<exclude>de.javakaffee:kryo-serializers</exclude= >
<= exclude>joda-time:joda-time</exclude>
<exclude>org.apache.commons:com= mons-lang3</exclude>
<exclude>org.slf4j:slf4j-api</exclude>
<= div> <exclude>= org.slf4j:slf4j-log4j12</exclude>
<exclude>log4j:log4j</exclude>
<exclud= e>org.apache.commons:commons-math</exclude>
<exclude>org.apache.slin= g:org.apache.sling.commons.json</exclude>
<exclude>commons-logging:commo= ns-logging</exclude>
<exclude>org.apache.httpcomponents:httpclient</e= xclude>
<exclude>org.apache.httpcomponents:httpcore</exclude>
<exclude>c= ommons-codec:commons-codec</exclude>
<exclude>com.fasterxml.jackson.core= :jackson-core</exclude>
<exclude>com.fasterxml.jackson.core:jackson-data= bind</exclude>
= <exclude>com.fasterxml.jackson.core:jackson-annotations&l= t;/exclude>
<= /span><exclude>org.codehaus.jettison:jettison</exclude>
<exclude>s= tax:stax-api</exclude>
<exclude>com.typesafe:config</exclude>
<exclude&g= t;org.uncommons.maths:uncommons-maths</exclude>
<exclude>com.github.scop= t:scopt_*</exclude>
<exclude>org.mortbay.jetty:servlet-api</exclude&g= t;
<ex= clude>commons-io:commons-io</exclude>
<exclude>commons-cli:commons-cl= i</exclude>
= </excludes>
</artifactSet>
<filters>
<filter>
<artifact>org.apache.flink:*&l= t;/artifact>
= <excludes>
<exclude>org/apache/flink/shaded/**</exclude>
<exclu= de>web-docs/**</exclude>
</excludes>
</filter>
</filters>
<createDependencyReducedPom&= gt;false</createDependencyReducedPom>
<finalName>XXXX</finalName>
<transform= ers>
&l= t;!-- add Main-Class to manifest file -->
<transformer
implementation=3D"org.apache= .maven.plugins.shade.resource.ManifestResourceTransformer">
<manifestEntr= ies>
= <Main-Class>XXX</Main-Class>
</manifestEntries>
</transformer>
=
</transformer= s>
</c= onfiguration>
</execution>
</executions>
</plugin>
--001a1139f6e252a5fa05166d127b--