avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thiruvalluvan M. G. (JIRA)" <j...@apache.org>
Subject [jira] Created: (AVRO-524) DataFileWriter.appendTo leads to intermittent IOException during write()
Date Sat, 24 Apr 2010 02:33:49 GMT
DataFileWriter.appendTo leads to intermittent IOException during write()

                 Key: AVRO-524
                 URL: https://issues.apache.org/jira/browse/AVRO-524
             Project: Avro
          Issue Type: Bug
          Components: java
            Reporter: Thiruvalluvan M. G.
            Assignee: Thiruvalluvan M. G.
             Fix For: 1.4.0

To append to a data file, we first open the file as RandomAccessFile in read-write mode, read
some information such sync, seek to the end of the file and then use its FileDescriptor to
create a FileOutputStream. Sharing a FileDescriptor this way could lead to problem if one
of its containers is garbage-collected while the other is still in use. Please see: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6322678.
The bug got fixed in Java 7 (b06). In our case, RandomAccessFile sometimes gets garbage-collected
leading to write errors. If the Java unit-tests are run multiple times, this occurs about
25% of the time on my Windows machine and about 50% on my Ubuntu Linux box.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message