flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Swapnil Chougule <the.swapni...@gmail.com>
Subject Re: RawSchema as deserialization schema
Date Thu, 22 Sep 2016 13:17:00 GMT
It will be good to have RawSchema as one of the deserialization schema in
streaming framework (like SimpleStringSchema).
Many use cases needs data in byte array format after reading from source
like kafka.

Any inputs for same ?

On Mon, Sep 12, 2016 at 11:42 AM, Swapnil Chougule <the.swapnil09@gmail.com>
wrote:

> Thanks Maximilian. I implemented same & it worked for me. I was under
> impression that RawSchema is available from flink.
>
> Regards,
> Swapnil
>
> On Mon, Sep 5, 2016 at 8:48 PM, Maximilian Michels <mxm@apache.org> wrote:
>
>> Just implement DeserializationSchema and return the byte array from
>> Kafka. Byte array serialization poses no problem to the Flink
>> serialization.
>>
>> On Mon, Sep 5, 2016 at 3:50 PM, Swapnil Chougule
>> <the.swapnil09@gmail.com> wrote:
>> > I am using Kafka consumer in flink 1.1.1 with Kafka 0.8.2. I want to
>> read
>> > byte array as it is in datastream. I tried to use RawSchema as
>> > desrialization schema but couldn't find same 1.1.1.
>> > I want to know whether I have to write my custom  implementation for
>> same ?
>> > Can somebody help me to sort out same ?
>> >
>> > Also passing byte[] to next operator is supported as far as
>> serialization is
>> > concerned ?
>>
>
>

Mime
View raw message