flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Flink Java 8 problem (no lambda, simple code)
Date Fri, 24 Apr 2015 09:34:48 GMT
One thing I noticed a while back with ASM version 4 and Java 8 had issues -
but those were related to Java 8 lambdas.

Back then, bumping ASM to version 5 helped it. Not sure if this is the same
problem, though, since you do not seem to use Java 8 lambdas...

On Fri, Apr 24, 2015 at 11:32 AM, Aljoscha Krettek <aljoscha@apache.org>
wrote:

> I'm looking into it,
>
> On Fri, Apr 24, 2015 at 11:13 AM, LINZ, Arnaud <ALINZ@bouyguestelecom.fr>
> wrote:
> > Hi,
> >
> >
> >
> > I have the following simple code that works well in Java 7 :
> >
> >
> >
> >         final ExecutionEnvironment cluster =
> > ExecutionEnvironment.createLocalEnvironment();
> >
> >         final DataSet<String> textFile =
> > cluster.readTextFile(MiscTools.chercher("jeuDeDonnees.txt"));
> >
> >         final DataSet<Tuple2<String, Integer>> words = textFile
> >
> >             .flatMap(new FlatMapFunction<String, Tuple2<String,
> Integer>>()
> > {
> >
> >                 @Override
> >
> >                 public void flatMap(String ligne,
> Collector<Tuple2<String,
> > Integer>> out) {
> >
> >                     for (final String word : ligne.split("\\s")) {
> >
> >                         out.collect(new Tuple2<String, Integer>(word,
> 1));
> >
> >                     }
> >
> >                 }
> >
> >             });
> >
> >         final DataSet<Tuple2<String, Integer>> wordsCount =
> > words.groupBy(0).sum(1);
> >
> >         wordsCount.print();
> >
> >         cluster.execute("testFlink");
> >
> >
> >
> > When compiled in Java 8 and executed (Oracle JDK or Eclipse JDT compiler,
> > same result) I have the following stack trace (under eclipse or with
> maven
> > test) :
> >
> >
> >
> > java.lang.IllegalArgumentException: null
> >
> >        at
> > org.apache.flink.shaded.org.objectweb.asm.ClassReader.<init>(Unknown
> Source)
> >
> >        at
> > org.apache.flink.shaded.org.objectweb.asm.ClassReader.<init>(Unknown
> Source)
> >
> >        at
> > org.apache.flink.shaded.org.objectweb.asm.ClassReader.<init>(Unknown
> Source)
> >
> >        at
> >
> org.apache.flink.api.java.ClosureCleaner.getClassReader(ClosureCleaner.java:40)
> >
> >        at
> >
> org.apache.flink.api.java.ClosureCleaner.cleanThis0(ClosureCleaner.java:67)
> >
> >        at
> > org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:54)
> >
> >        at org.apache.flink.api.java.DataSet.clean(DataSet.java:185)
> >
> >        at org.apache.flink.api.java.DataSet.flatMap(DataSet.java:266)
> >
> >
> >
> >
> >
> > Any idea why ?
> >
> >
> >
> > Here is my pom.xml :
> >
> >
> >
> >        <build>
> >
> >              <plugins>
> >
> >                     <!-- Surefire plugin -->
> >
> >                     <plugin>
> >
> >                            <groupId>org.apache.maven.plugins</groupId>
> >
> >                            <artifactId>maven-surefire-plugin</artifactId>
> >
> >                            <version>2.15</version>
> >
> >                            <configuration>
> >
> >                                   <jvm>${env.JAVA_HOME}/bin/java</jvm>
> >
> >                                   <forkMode>once</forkMode>
> >
> >                            </configuration>
> >
> >                     </plugin>
> >
> >
> >
> >
> >
> >                     <plugin>
> >
> >                            <groupId>org.apache.maven.plugins</groupId>
> >
> >                            <artifactId>maven-compiler-plugin</artifactId>
> >
> >                            <version>3.1</version>
> >
> >
> >
> >                            <configuration>
> >
> >                                   <source>1.8</source>
> >
> >                                   <target>1.8</target>
> >
> >                                   <compilerId>jdt</compilerId>
> >
> >                                   <!--
> > executable>${env.JAVA_HOME}/bin/javac</executable> -->
> >
> >                            </configuration>
> >
> >                            <dependencies>
> >
> >                                   <!-- This dependency provides the
> > implementation of compiler "jdt": -->
> >
> >                                   <dependency>
> >
> >
>  <groupId>org.eclipse.tycho</groupId>
> >
> >
> > <artifactId>tycho-compiler-jdt</artifactId>
> >
> >                                         <version>0.21.0</version>
> >
> >                                   </dependency>
> >
> >                            </dependencies>
> >
> >                     </plugin>
> >
> >              </plugins>
> >
> >              <pluginManagement>
> >
> >                     <plugins>
> >
> >                            <!--This plugin's configuration is used to
> store
> > Eclipse m2e settings
> >
> >                                   only. It has no influence on the Maven
> > build itself. -->
> >
> >                            <plugin>
> >
> >                                   <groupId>org.eclipse.m2e</groupId>
> >
> >
>  <artifactId>lifecycle-mapping</artifactId>
> >
> >                                   <version>1.0.0</version>
> >
> >                                   <configuration>
> >
> >                                         <lifecycleMappingMetadata>
> >
> >                                                <pluginExecutions>
> >
> >                                                       <pluginExecution>
> >
> >
> > <pluginExecutionFilter>
> >
> >
> <groupId>
> >
> >
> > org.apache.maven.plugins
> >
> >
> > </groupId>
> >
> >
> > <artifactId>
> >
> >
> > maven-compiler-plugin
> >
> >
> > </artifactId>
> >
> >
> > <versionRange>
> >
> >
> > [3.1,)
> >
> >
> > </versionRange>
> >
> >
> <goals>
> >
> >
> > <goal>compile</goal>
> >
> >
> </goals>
> >
> >
> > </pluginExecutionFilter>
> >
> >                                                             <action>
> >
> >
> > <ignore></ignore>
> >
> >                                                             </action>
> >
> >                                                       </pluginExecution>
> >
> >                                                </pluginExecutions>
> >
> >                                         </lifecycleMappingMetadata>
> >
> >                                   </configuration>
> >
> >                            </plugin>
> >
> >                     </plugins>
> >
> >              </pluginManagement>
> >
> >        </build>
> >
> >
> >
> >        <dependencies>
> >
> >              <dependency>
> >
> >                     <groupId>junit</groupId>
> >
> >                     <artifactId>junit</artifactId>
> >
> >                     <version>4.10</version>
> >
> >                     <scope>test</scope>
> >
> >              </dependency>
> >
> >
> >
> >              <!-- Flink -->
> >
> >              <dependency>
> >
> >                     <groupId>org.apache.flink</groupId>
> >
> >                     <artifactId>flink-java</artifactId>
> >
> >                     <version>0.9.0-milestone-1</version>
> >
> >              </dependency>
> >
> >              <dependency>
> >
> >                     <groupId>org.apache.flink</groupId>
> >
> >                     <artifactId>flink-clients</artifactId>
> >
> >                     <version>0.9.0-milestone-1</version>
> >
> >              </dependency>
> >
> >
> >
> >
> >
> >        </dependencies>
> >
> >
> >
> > A simple replacement of “1.8” by “1.7” in the pom makes the program work.
> >
> >
> >
> > Regards,
> >
> > Arnaud
> >
> >
> > ________________________________
> >
> > L'intégrité de ce message n'étant pas assurée sur internet, la société
> > expéditrice ne peut être tenue responsable de son contenu ni de ses
> pièces
> > jointes. Toute utilisation ou diffusion non autorisée est interdite. Si
> vous
> > n'êtes pas destinataire de ce message, merci de le détruire et d'avertir
> > l'expéditeur.
> >
> > The integrity of this message cannot be guaranteed on the Internet. The
> > company that sent this message cannot therefore be held liable for its
> > content nor attachments. Any unauthorized use or dissemination is
> > prohibited. If you are not the intended recipient of this message, then
> > please delete it and notify the sender.
>

Mime
View raw message