flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Flink Kafka cannot find org/I0Itec/zkclient/serialize/ZkSerializer
Date Fri, 24 Jul 2015 09:14:32 GMT
Wendong,

Sorry to hear that you are having such trouble with the example.

We are using the Kafka connector with many people, building the examples
with Maven. It works without any problems.

Maybe SBT is just not handling these dependencies correctly, or the SBT
script defines the dependencies incorrectly.

Stephan



On Fri, Jul 24, 2015 at 7:30 AM, Wendong <wendong.zhu@gmail.com> wrote:

> Thanks Stephan and Till.
>
> Since I couldn't make a working example of Flink and Kafka after struggling
> a week, I have to temporarily stop the evaluation work and switch to other
> tasks. I hope in the near future, someone can come up with a working sample
> of KafkaWordCount, similar to that of Spark sample, and it would greatly
> benefit the community.
>
> Wendong
>
>
> Here are some comments on Java Classloading:
>
>  - The Zookeeper code is implicitly loaded by the Kafka code.
>  - When java implicitly loads a class at some point in the program, is uses
> the classloader of the class of that point in the program. Here it will use
> the class loader that loaded the Kafka code.
>  - You have to make sure that the zookeeper dependency is where the kafka
> connector is. It will not work to have kafka in /lib and zookeeper in the
> fat jar, for example.
>
> But putting everything into the /lib folder should work. Note: Its
> important that this is available on all worker machines.
>
>
>
>
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-cannot-find-org-I0Itec-zkclient-serialize-ZkSerializer-tp2199p2259.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

Mime
View raw message