avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: OutOfMemoryError while writing a large map to a file
Date Thu, 28 Jan 2016 16:59:03 GMT
On Thu, Jan 28, 2016 at 7:51 AM, David Kincaid <kincaid.dave@gmail.com> wrote:
> Does anyone have a suggestion for making the write not try to copy the data
> in memory as it's writing?

BlockingBinaryEncoder is meant to do this, but I don't know how much
it's been used.

https://avro.apache.org/docs/current/api/java/org/apache/avro/io/BlockingBinaryEncoder.html

Doug

Mime
View raw message