avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-2076) Combine already serialized Avro records to an Avro file
Date Thu, 14 Sep 2017 19:30:00 GMT

    [ https://issues.apache.org/jira/browse/AVRO-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166858#comment-16166858

Doug Cutting commented on AVRO-2076:

Doesn't DataFileWriter#appendEncoded() already provide this?


> Combine already serialized Avro records to an Avro file
> -------------------------------------------------------
>                 Key: AVRO-2076
>                 URL: https://issues.apache.org/jira/browse/AVRO-2076
>             Project: Avro
>          Issue Type: Wish
>            Reporter: Erik van Oosten
> In some use cases Avro events arrive already serialized (e.g. when listening to a Kafka
topic). It would be great if there would an API that allows writing an Avro file without the
need for deserializing and serializing these Avro records.
> Providing such an API allows for very efficient creation of Avro files: given that these
Avro records are written with the same schema, an Avro file would write will the exact same
bytes anyway (before block compression).

This message was sent by Atlassian JIRA

View raw message