avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1387) Avro container file format update to write checksums for individual record
Date Fri, 18 Oct 2013 16:50:43 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799283#comment-13799283
] 

Brock Noland commented on AVRO-1387:
------------------------------------

Whoops that should have been:

{noformat}
  Reader in = ..
  Record rec = null;
  do {
     try {
       rec = in.read();
       if(rec != null)
         doSomething(rec);
     } catch(InvalidRecordException ex) {
      in.seekNext();
    }
 } while(rec != null);
{noformat}

> Avro container file format update to write checksums for individual record
> --------------------------------------------------------------------------
>
>                 Key: AVRO-1387
>                 URL: https://issues.apache.org/jira/browse/AVRO-1387
>             Project: Avro
>          Issue Type: Bug
>            Reporter: Hari Shreedharan
>
> We are considering changes in Flume's file channel to use Avro, one of the requirements
is that each event (which maps to one avro record) be checksummed so we know if the data is
corrupt. 
> We'd probably have to add a new version for this, since this will change the data format
on disk. I can start working on a Java version if there are no objections



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message