flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: RawSchema as deserialization schema
Date Thu, 22 Sep 2016 13:42:52 GMT
/cc Robert, he is looking into extending the Kafka Connectors to support
more of Kafka's direct utilities

On Thu, Sep 22, 2016 at 3:17 PM, Swapnil Chougule <the.swapnil09@gmail.com>
wrote:

> It will be good to have RawSchema as one of the deserialization schema in
> streaming framework (like SimpleStringSchema).
> Many use cases needs data in byte array format after reading from source
> like kafka.
>
> Any inputs for same ?
>
> On Mon, Sep 12, 2016 at 11:42 AM, Swapnil Chougule <
> the.swapnil09@gmail.com> wrote:
>
>> Thanks Maximilian. I implemented same & it worked for me. I was under
>> impression that RawSchema is available from flink.
>>
>> Regards,
>> Swapnil
>>
>> On Mon, Sep 5, 2016 at 8:48 PM, Maximilian Michels <mxm@apache.org>
>> wrote:
>>
>>> Just implement DeserializationSchema and return the byte array from
>>> Kafka. Byte array serialization poses no problem to the Flink
>>> serialization.
>>>
>>> On Mon, Sep 5, 2016 at 3:50 PM, Swapnil Chougule
>>> <the.swapnil09@gmail.com> wrote:
>>> > I am using Kafka consumer in flink 1.1.1 with Kafka 0.8.2. I want to
>>> read
>>> > byte array as it is in datastream. I tried to use RawSchema as
>>> > desrialization schema but couldn't find same 1.1.1.
>>> > I want to know whether I have to write my custom  implementation for
>>> same ?
>>> > Can somebody help me to sort out same ?
>>> >
>>> > Also passing byte[] to next operator is supported as far as
>>> serialization is
>>> > concerned ?
>>>
>>
>>
>

Mime
View raw message