hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7387) NFS may only do partial commit due to a race between COMMIT and write
Date Wed, 12 Nov 2014 15:17:46 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208114#comment-14208114
] 

Hudson commented on HDFS-7387:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk #1955 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1955/])
HDFS-7387. NFS may only do partial commit due to a race between COMMIT and write. Contributed
by Brandon Li (brandonli: rev 99d9d0c2d19b9f161b765947f3fb64619ea58090)
* hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java


> NFS may only do partial commit due to a race between COMMIT and write
> ---------------------------------------------------------------------
>
>                 Key: HDFS-7387
>                 URL: https://issues.apache.org/jira/browse/HDFS-7387
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: nfs
>    Affects Versions: 2.6.0
>            Reporter: Brandon Li
>            Assignee: Brandon Li
>            Priority: Critical
>             Fix For: 2.7.0
>
>         Attachments: HDFS-7387.001.patch, HDFS-7387.002.patch
>
>
> The requested range may not be committed when the following happens:
> 1. the last pending write is removed from the queue to write to hdfs
> 2. a commit request arrives, NFS sees there is not pending write, and it will do a sync
> 3. this sync request could flush only part of the last write to hdfs
> 4. if a file read happens immediately after the above steps, the user may not see all
the data.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message