Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 698FD9D56 for ; Fri, 6 Jul 2012 02:49:37 +0000 (UTC) Received: (qmail 92185 invoked by uid 500); 6 Jul 2012 02:49:37 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 92046 invoked by uid 500); 6 Jul 2012 02:49:36 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 91369 invoked by uid 99); 6 Jul 2012 02:49:35 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Jul 2012 02:49:35 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id 6839814286F for ; Fri, 6 Jul 2012 02:49:35 +0000 (UTC) Date: Fri, 6 Jul 2012 02:49:35 +0000 (UTC) From: "Uma Maheswara Rao G (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <1494818268.12208.1341542975428.JavaMail.jiratomcat@issues-vm> In-Reply-To: <428496468.77343.1341210285210.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Commented] (HDFS-3584) Blocks are getting marked as corrupt with append operation under high load. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13407665#comment-13407665 ] Uma Maheswara Rao G commented on HDFS-3584: ------------------------------------------- Hi All, Do you have any comments on this issue? > Blocks are getting marked as corrupt with append operation under high load. > --------------------------------------------------------------------------- > > Key: HDFS-3584 > URL: https://issues.apache.org/jira/browse/HDFS-3584 > Project: Hadoop HDFS > Issue Type: Bug > Components: name-node > Affects Versions: 2.0.1-alpha > Reporter: Brahma Reddy Battula > > Scenario: > ========= > 1. There are 2 clients cli1 and cli2 cli1 write a file F1 and not closed > 2. The cli2 will call append on unclosed file and triggers a leaserecovery > 3. Cli1 is closed > 4. Lease recovery is completed and with updated GS in DN and got BlockReport since there is a mismatch in GS the block got corrupted > 5. Now we got a CommitBlockSync this will also fail since the File is already closed by cli1 and state in NN is Finalized -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira