flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alam, Zeeshan" <Zeeshan.A...@fmr.com>
Subject RE: How to read AVRO data from Kafka using Flink
Date Wed, 03 Aug 2016 09:34:24 GMT
Hi Shannon,

There was an issue with the data written in the Kafka topic, some were in JSON format and
some in AVRO. I ran my code for a different Kafka topic where there was homogeneous data and
my code worked fine. Thanks for your time.

Thanks & Regards,
Zeeshan Alam

From: Shannon Carey [mailto:scarey@expedia.com]
Sent: Tuesday, August 02, 2016 8:49 PM
To: Alam, Zeeshan; user@flink.apache.org
Subject: Re: How to read AVRO data from Kafka using Flink

I can tell you that we are reading Avro data from Kafka on Flink without problems. It seems
like you have a mistake somewhere in your system. If I were you I would try your serialization
& deserialization code in a simple program within the same JVM, then gradually add the
other components in order to narrow down where the problem is coming from.


From: "Alam, Zeeshan" <Zeeshan.Alam@fmr.com<mailto:Zeeshan.Alam@fmr.com>>
Date: Tuesday, August 2, 2016 at 5:28 AM
To: "user@flink.apache.org<mailto:user@flink.apache.org>" <user@flink.apache.org<mailto:user@flink.apache.org>>
Subject: How to read AVRO data from Kafka using Flink

Hi All,

I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting error. I have
posted this issue in Stack Overflow: http://stackoverflow.com/questions/38715286/how-to-decode-kafka-messages-using-avro-and-flink
. Is there any mistake we can try to look into or there a better way to read AVR data from
Kafka using Flink?

Thanks & Regards
Zeeshan Alam

View raw message