Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Fri, 2 Jun 2017 08:03:04 +0000 (UTC)
From: "Kanaka Kumar Avvaru (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.13076760.1496390556000.349547.1496390584422@Atlassian.JIRA>
In-Reply-To: <JIRA.13076760.1496390556000@Atlassian.JIRA>
References: <JIRA.13076760.1496390556000@Atlassian.JIRA> <JIRA.13076760.1496390556817@jira-lw-us.apache.org>
Subject: [jira] [Created] (HDFS-11915) Sync rbw dir on the first hsync() to
 avoid file lost on power failure
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Fri, 02 Jun 2017 08:03:11 -0000

Kanaka Kumar Avvaru created HDFS-11915:
------------------------------------------

             Summary: Sync rbw dir on the first hsync() to avoid file lost on power failure
                 Key: HDFS-11915
                 URL: https://issues.apache.org/jira/browse/HDFS-11915
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Kanaka Kumar Avvaru
            Priority: Critical


As discussed in HDFS-5042, there is a chance to loose blocks on power failure if rbw file creation entry is not yet sync to device. Then the block created is nowhere exists on disk. Neither in rbw nor in finalized. 

As suggested by [~kihwal], will discuss and track it in this JIRA.

As suggested by [~vinayrpet], May be first hsync() request on block file can call fsync on its parent directory (rbw) directory.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org