orc-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitry Zhaldakov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ORC-481) Why does writer not use HDFS hflush when close file?
Date Tue, 19 Mar 2019 07:22:00 GMT
Dmitry Zhaldakov created ORC-481:
------------------------------------

             Summary: Why does writer not use HDFS hflush when close file?
                 Key: ORC-481
                 URL: https://issues.apache.org/jira/browse/ORC-481
             Project: ORC
          Issue Type: Bug
          Components: Java
    Affects Versions: 1.2.1
         Environment: HDP 2.6.5
            Reporter: Dmitry Zhaldakov


We use ORC for writing to HDFS. Today we found some corrupted files without PostScript.

Code that writes files is looked as:
{code:java}
writer.close()
moveFile(){code}
So it is guaranted file was closed without error. The only idea I have is that footer had not
been flushed before file was moved. Is it possible because writer does not call HDFS hflush()?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message