avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1388) Avro container files should allow fsync-ing files to disk
Date Sat, 19 Oct 2013 20:33:43 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799999#comment-13799999

Doug Cutting commented on AVRO-1388:

If this is a new method whose contract is to call FileDescriptor#sync() then throwing an exception
might be reasonable.

On the other hand, it might be better to generalize this, so that it can be used with HDFS
too.  We might:
 - add a Syncable interface
 - cast to that in the DataFileWriter#sync()
 - add a SyncableFileOutputStream implementation
 - change DataFileWriter#create(Schema,File) to call create(schema, new SyncableFileOutputStream(file)).

> Avro container files should allow fsync-ing files to disk
> ---------------------------------------------------------
>                 Key: AVRO-1388
>                 URL: https://issues.apache.org/jira/browse/AVRO-1388
>             Project: Avro
>          Issue Type: Bug
>            Reporter: Hari Shreedharan
> Another feature we require in Avro data files in addition to AVRO-1387 is that we be
able to fsync the files to disk. Currently we cannot do this, but this can be achieved without
API changes. If there are no objections,  I will submit a patch

This message was sent by Atlassian JIRA

View raw message