Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-issues@hadoop.apache.org
Date: Thu, 19 Mar 2015 02:03:38 +0000 (UTC)
From: "Hudson (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.12765196.1420575114000.138959.1426730618733@Atlassian.JIRA>
In-Reply-To: <JIRA.12765196.1420575114000@Atlassian.JIRA>
References: <JIRA.12765196.1420575114000@Atlassian.JIRA>
 <JIRA.12765196.1420575114182@arcas>
Subject: [jira] [Commented] (HDFS-7587) Edit log corruption can happen if
 append fails with a quota violation
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14368351#comment-14368351 ] 

Hudson commented on HDFS-7587:
------------------------------

FAILURE: Integrated in Hadoop-trunk-Commit #7368 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/7368/])
HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contributed by Jing Zhao. (jing9: rev c7c71cdba50cb7d8282622cd496cc913c80cff54)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestDiskspaceQuotaUpdate.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java


> Edit log corruption can happen if append fails with a quota violation
> ---------------------------------------------------------------------
>
>                 Key: HDFS-7587
>                 URL: https://issues.apache.org/jira/browse/HDFS-7587
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>            Reporter: Kihwal Lee
>            Assignee: Jing Zhao
>            Priority: Blocker
>             Fix For: 2.7.0
>
>         Attachments: HDFS-7587.001.patch, HDFS-7587.002.patch, HDFS-7587.003.patch, HDFS-7587.patch
>
>
> We have seen a standby namenode crashing due to edit log corruption. It was complaining that {{OP_CLOSE}} cannot be applied because the file is not under-construction.
> When a client was trying to append to the file, the remaining space quota was very small. This caused a failure in {{prepareFileForWrite()}}, but after the inode was already converted for writing and a lease added. Since these were not undone when the quota violation was detected, the file was left in under-construction with an active lease without edit logging {{OP_ADD}}.
> A subsequent {{append()}} eventually caused a lease recovery after the soft limit period. This resulted in {{commitBlockSynchronization()}}, which closed the file with {{OP_CLOSE}} being logged.  Since there was no corresponding {{OP_ADD}}, edit replaying could not apply this.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)