flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Metzger <rmetz...@apache.org>
Subject Re: Flink Kafka cannot find org/I0Itec/zkclient/serialize/ZkSerializer
Date Fri, 24 Jul 2015 09:17:14 GMT
Can you share your full sbt build file with me?

I'm trying to reproduce the issue, but I have never used sbt before.
I was able to configure the assembly plugin, but the produced fat jar
didn't contain the zkclient. Maybe your full sbt build file would help me
to identify the issue faster.

Let me know if you would like to work with maven. I'm pretty sure that we
can get it to work with maven.

On Fri, Jul 24, 2015 at 11:14 AM, Stephan Ewen <sewen@apache.org> wrote:

> Wendong,
>
> Sorry to hear that you are having such trouble with the example.
>
> We are using the Kafka connector with many people, building the examples
> with Maven. It works without any problems.
>
> Maybe SBT is just not handling these dependencies correctly, or the SBT
> script defines the dependencies incorrectly.
>
> Stephan
>
>
>
> On Fri, Jul 24, 2015 at 7:30 AM, Wendong <wendong.zhu@gmail.com> wrote:
>
>> Thanks Stephan and Till.
>>
>> Since I couldn't make a working example of Flink and Kafka after
>> struggling
>> a week, I have to temporarily stop the evaluation work and switch to other
>> tasks. I hope in the near future, someone can come up with a working
>> sample
>> of KafkaWordCount, similar to that of Spark sample, and it would greatly
>> benefit the community.
>>
>> Wendong
>>
>>
>> Here are some comments on Java Classloading:
>>
>>  - The Zookeeper code is implicitly loaded by the Kafka code.
>>  - When java implicitly loads a class at some point in the program, is
>> uses
>> the classloader of the class of that point in the program. Here it will
>> use
>> the class loader that loaded the Kafka code.
>>  - You have to make sure that the zookeeper dependency is where the kafka
>> connector is. It will not work to have kafka in /lib and zookeeper in the
>> fat jar, for example.
>>
>> But putting everything into the /lib folder should work. Note: Its
>> important that this is available on all worker machines.
>>
>>
>>
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-cannot-find-org-I0Itec-zkclient-serialize-ZkSerializer-tp2199p2259.html
>> Sent from the Apache Flink User Mailing List archive. mailing list
>> archive at Nabble.com.
>>
>
>

Mime
View raw message