hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brandon Li (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-5563) NFS gateway should commit the buffered data when read request comes after write to the same file
Date Mon, 25 Nov 2013 19:04:35 GMT
Brandon Li created HDFS-5563:
--------------------------------

             Summary: NFS gateway should commit the buffered data when read request comes
after write to the same file
                 Key: HDFS-5563
                 URL: https://issues.apache.org/jira/browse/HDFS-5563
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: nfs
            Reporter: Brandon Li
            Assignee: Brandon Li


HDFS write is asynchronous and data may not be available to read immediately after write.
One of the main reason is that DFSClient doesn't flush data to DN until its local buffer is
full.

To workaround this problem, when a read comes after write to the same file, NFS gateway should
sync the data so the read request can get the latest content. The drawback is that, the frequent
hsync() call can slow down data write.




--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message