hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Howard Lee (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-15073) SequenceFile.Reader will unexpectedly quit next() iterator while the file ends with sync and appended
Date Wed, 29 Nov 2017 08:55:00 GMT
Howard Lee created HADOOP-15073:
-----------------------------------

             Summary: SequenceFile.Reader will unexpectedly quit next() iterator while the
file ends with sync and appended
                 Key: HADOOP-15073
                 URL: https://issues.apache.org/jira/browse/HADOOP-15073
             Project: Hadoop Common
          Issue Type: Bug
          Components: common
    Affects Versions: 3.0.0-alpha3, 2.8.2, 2.7.4, 2.6.3
            Reporter: Howard Lee


The SequenceFile.Writer will insert SYNC into file every SYNC_INTERVAL.
In the case that SequenceFile ends with SYNC coincidentally, and another Writer open it with
mode AppendIfExits, there meets the BUG.
For the AppendIfExits set _appendMode _ to _true_ , the init method will insert another SYNC.
In such case, there will be two SYNC MAKR continuously.
In SequenceFile.Reader, the method readRecordLength will only test SYNC once, when there's
two SYNC MARK, the _length_ will be -1(The begining of another SYNC), which means the end
of file causing the next method quit unexpectedly.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message