hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure
Date Thu, 07 Dec 2017 23:21:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282695#comment-16282695
] 

Hudson commented on HDFS-11915:
-------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13343 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/13343/])
HDFS-11915. Sync rbw dir on the first hsync() to avoid file lost on (weichiu: rev d6c31a3e6b60c4b8af9ae4661f16614805654e59)
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockReceiver.java


> Sync rbw dir on the first hsync() to avoid file lost on power failure
> ---------------------------------------------------------------------
>
>                 Key: HDFS-11915
>                 URL: https://issues.apache.org/jira/browse/HDFS-11915
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Kanaka Kumar Avvaru
>            Assignee: Vinayakumar B
>            Priority: Critical
>             Fix For: 3.1.0
>
>         Attachments: HDFS-11915-01.patch, HDFS-11915-branch-2-01.patch
>
>
> As discussed in HDFS-5042, there is a chance to lose blocks on power failure if rbw file
creation entry is not yet sync to device. Then the block created is nowhere exists on disk.
Neither in rbw nor in finalized. 
> As suggested by [~kihwal], will discuss and track it in this JIRA.
> As suggested by [~vinayrpet], May be first hsync() request on block file can call fsync
on its parent directory (rbw) directory.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message