hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5563) NFS gateway should commit the buffered data when read request comes after write to the same file
Date Wed, 27 Nov 2013 23:20:38 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13834319#comment-13834319
] 

Hadoop QA commented on HDFS-5563:
---------------------------------

{color:green}+1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12616150/HDFS-5563.003.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified
test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  The javadoc tool did not generate any warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:green}+1 core tests{color}.  The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs-nfs.

    {color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/5597//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/5597//console

This message is automatically generated.

> NFS gateway should commit the buffered data when read request comes after write to the
same file
> ------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-5563
>                 URL: https://issues.apache.org/jira/browse/HDFS-5563
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: nfs
>            Reporter: Brandon Li
>            Assignee: Brandon Li
>         Attachments: HDFS-5563.001.patch, HDFS-5563.002.patch, HDFS-5563.003.patch
>
>
> HDFS write is asynchronous and data may not be available to read immediately after write.
> One of the main reason is that DFSClient doesn't flush data to DN until its local buffer
is full.
> To workaround this problem, when a read comes after write to the same file, NFS gateway
should sync the data so the read request can get the latest content. The drawback is that,
the frequent hsync() call can slow down data write.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message