avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: Extracting records as bytes from avro file
Date Fri, 24 Oct 2014 18:18:38 GMT
On Thu, Oct 16, 2014 at 9:58 AM, Ivan Balashov <ibalashov@gmail.com> wrote:
> Could adding length prefix be considered feasible enough to file a
> feature request?

Adding a length prefix to each record in a file would be an
incompatible change to the file format, so we'd be unlikely to make
this, as older implementations would no longer be able to read data
written by newer versions.  You could achieve this effect by flushing
the file after each item is written so that there's only a single
record per block, but there are other per-block overheads that may or
may not make this practical for your application.

Doug

Mime
View raw message