avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1387) DataFileWriter must allow files not to be flushed at the end of every block.
Date Fri, 25 Oct 2013 22:15:30 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13805752#comment-13805752
] 

ASF subversion and git services commented on AVRO-1387:
-------------------------------------------------------

Commit 1535888 from [~cutting] in branch 'avro/trunk'
[ https://svn.apache.org/r1535888 ]

AVRO-1387. Java: Add DataFileWriter option to inhibit flush per block.  Contributed by Hari
Shreedharan.

> DataFileWriter must allow files not to be flushed at the end of every block.
> ----------------------------------------------------------------------------
>
>                 Key: AVRO-1387
>                 URL: https://issues.apache.org/jira/browse/AVRO-1387
>             Project: Avro
>          Issue Type: Bug
>            Reporter: Hari Shreedharan
>            Assignee: Hari Shreedharan
>             Fix For: 1.7.6
>
>         Attachments: AVRO-1387.patch
>
>
> We are considering changes in Flume's file channel to use Avro, one of the requirements
is that each event (which maps to one avro record) be checksummed so we know if the data is
corrupt. 
> We'd probably have to add a new version for this, since this will change the data format
on disk. I can start working on a Java version if there are no objections



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message