avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Spiegel <jojsp...@gmail.com>
Subject Re: Is DataFileWriter#append(datum) reentrant?
Date Wed, 10 Jul 2013 16:28:56 GMT
Sorry I missed that and thanks for the reply.

Thanks,
Josh


On Wed, Jul 10, 2013 at 9:05 AM, Doug Cutting <cutting@apache.org> wrote:

> The documentation for AppendWriteException says, "When this is thrown,
> the file is unaltered and may continue to be appended to."  So, yes,
> after you have caught this exception you may safely continue to append
> entries to the still-open file.
>
> Doug
>
> On Wed, Jul 10, 2013 at 7:37 AM, Josh Spiegel <jojspieg@gmail.com> wrote:
> > Hi,
> >
> > I am using AvroKeyRecordWriter, which wraps
> DataFileWriter#append(datum), to
> > create Avro.  As I write data, sometimes an error will occur due to an
> > encoding problem (e.g. a non-nullable field isn't set in a record).  I
> would
> > like to be able to log the AppendWriteException and continue writing the
> > remaining records.  Is this supported?  In other words, is
> > AvroKeyRecordWriter#write() guaranteed to be reentrant with respect to
> > AppendWriteException?
> >
> > If not, is there a way to validate a datum against the schema before
> > writing?
> >
> > Thanks,
> > Josh
>

Mime
View raw message