flume-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebastian Alfers (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLUME-2942) AvroEventDeserializer ignores header from spool source
Date Wed, 15 Mar 2017 14:14:41 GMT

    [ https://issues.apache.org/jira/browse/FLUME-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926235#comment-15926235

Sebastian Alfers commented on FLUME-2942:


> AvroEventDeserializer ignores header from spool source
> ------------------------------------------------------
>                 Key: FLUME-2942
>                 URL: https://issues.apache.org/jira/browse/FLUME-2942
>             Project: Flume
>          Issue Type: Bug
>    Affects Versions: v1.6.0
>            Reporter: Sebastian Alfers
>         Attachments: FLUME-2942-0.patch
> I have a spool file source and use avro for de-/serialization
> In detail, serialized events store the topic of the kafka sink in the header.
> When I load the events from the spool directory, the header are ignored. 
> Please see: https://github.com/apache/flume/blob/caa64a1a6d4bc97be5993cb468516e9ffe862794/flume-ng-core/src/main/java/org/apache/flume/serialization/AvroEventDeserializer.java#L122
> You can see, it uses the whole event as body but does not distinguish between the header
and body encoded by avro.
> Please verify that this is a bug.
> I fixed this but by using the record that stores header and body separately.

This message was sent by Atlassian JIRA

View raw message