hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bogdan Raducanu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-7268) Can't append with SYNC_BLOCK
Date Mon, 20 Oct 2014 16:32:34 GMT
Bogdan Raducanu created HDFS-7268:

             Summary: Can't append with SYNC_BLOCK
                 Key: HDFS-7268
                 URL: https://issues.apache.org/jira/browse/HDFS-7268
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: hdfs-client
    Affects Versions: 2.4.1
            Reporter: Bogdan Raducanu
            Assignee: Bogdan Raducanu

It seems to me that currently it's not possible to start appending to a file with CreateFlag.SYNC_BLOCK
behavior (i.e. hsync after each block). This means proper fsync is not possible when appending
(unless doing hsync after every write, I guess).
FileSystem.append doesn't accept a CreateFlag argument (probably shouldn't anyway).
FileSystem.create ignores CreateFlag.APPEND
It seems it might work through FileContext but in the end DFSOutputStream can't be passed
a CreateFlag for appending anyway.
Am I missing something?
I will think of a way to fix it. An immediate thought is to add a setSyncBlock() method to
DFSOutputStream and remove CreateFlag.SYNC_BLOCK.

This message was sent by Atlassian JIRA

View raw message