flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hanan Meyer <ha...@scalabill.it>
Subject Flink's Checking and uploading JAR files Issue
Date Thu, 24 Sep 2015 11:31:56 GMT
Hello All

I use Flink in order to filter data from Hdfs and write it back as CSV.

I keep getting the "Checking and uploading JAR files" on every DataSet
filtering action or
executionEnvironment execution.

I use ExecutionEnvironment.createRemoteEnvironment(ip+jars..) because I
launch Flink from
a J2EE Aplication Server .

The Jars serialization and transportation takes a huge part of the
execution time .
Is there a way to force Flink to pass the Jars only once?

Please advise


Hanan Meyer

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message