avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Douglas Britsch (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AVRO-828) The 16-byte, sync marker for file not generated till first record written.
Date Thu, 26 May 2011 17:44:48 GMT

     [ https://issues.apache.org/jira/browse/AVRO-828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Douglas Britsch resolved AVRO-828.
----------------------------------

       Resolution: Invalid
    Fix Version/s: 1.5.1

> The 16-byte, sync marker for file not generated till first record written.
> --------------------------------------------------------------------------
>
>                 Key: AVRO-828
>                 URL: https://issues.apache.org/jira/browse/AVRO-828
>             Project: Avro
>          Issue Type: Improvement
>          Components: java
>    Affects Versions: 1.5.1
>         Environment: Java 1.6
>            Reporter: Douglas Britsch
>              Labels: empty, file, header, marker, sync
>             Fix For: 1.5.1
>
>
> When opening an avro file to be written, the 16-byte, sync marker for file not generated
till first record written or the file properly closed. Our usecase has the logs being rotated
if they have no open filehandles which means if we open a file and experience an unclean shutdown
we get files that throw exceptions on processing. When records are written the sync marker
is written on each write which prevents this from being a problem on non-empty files. Can
we write the sync marker when the header is written instead of on first record write?

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message