avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Scott Carey <scottca...@apache.org>
Subject Re: Sync() between records? How do we recover from a bad record, using DataFileReader?
Date Tue, 08 Jan 2013 10:31:40 GMT
For the corruption test, try corrupting the records, not the sync marker.
The features added to DataFileReader for corruption recovery were for the
case when decoding a record fails (corrupted record), not for when a sync
marker is corrupted.  Perhaps we should add that too, but it does not
surprise me that that case has a bug.

On 1/6/13 7:38 PM, "Russell Jurney" <russell.jurney@gmail.com> wrote:

>We are trying to recover, report bad record, and move to the next record
>of an Avro file in PIG-3015 and PIG-3059. It seems that sync blocks don't
>exist between files, however.
>How should we recover from a bad record using Avro's DataFileReader?
>Russell Jurney http://datasyndrome.com

View raw message