avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: Is DataFileWriter#append(datum) reentrant?
Date Wed, 10 Jul 2013 16:05:29 GMT
The documentation for AppendWriteException says, "When this is thrown,
the file is unaltered and may continue to be appended to."  So, yes,
after you have caught this exception you may safely continue to append
entries to the still-open file.


On Wed, Jul 10, 2013 at 7:37 AM, Josh Spiegel <jojspieg@gmail.com> wrote:
> Hi,
> I am using AvroKeyRecordWriter, which wraps DataFileWriter#append(datum), to
> create Avro.  As I write data, sometimes an error will occur due to an
> encoding problem (e.g. a non-nullable field isn't set in a record).  I would
> like to be able to log the AppendWriteException and continue writing the
> remaining records.  Is this supported?  In other words, is
> AvroKeyRecordWriter#write() guaranteed to be reentrant with respect to
> AppendWriteException?
> If not, is there a way to validate a datum against the schema before
> writing?
> Thanks,
> Josh

View raw message