Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CA49FD528 for ; Tue, 25 Sep 2012 00:46:08 +0000 (UTC) Received: (qmail 80060 invoked by uid 500); 25 Sep 2012 00:46:08 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 80011 invoked by uid 500); 25 Sep 2012 00:46:08 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 79918 invoked by uid 99); 25 Sep 2012 00:46:08 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Sep 2012 00:46:08 +0000 Date: Tue, 25 Sep 2012 11:46:08 +1100 (NCT) From: "Uma Maheswara Rao G (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <1503558038.119794.1348533968437.JavaMail.jiratomcat@arcas> In-Reply-To: <1005358690.90507.1343040694858.JavaMail.jiratomcat@issues-vm> Subject: [jira] [Updated] (HDFS-3701) HDFS may miss the final block when reading a file opened for writing if one of the datanode is dead MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-3701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-3701: -------------------------------------- Attachment: HDFS-3701.branch-1.v4.patch Oops, Its my mistake. Prepared it on hurry. Really sorry for my mistake here. Actually I might have removed thinking that updateBlkInfo will throw exception in failure. did not looked bak once changed updateBlkInfo. Removed comment along with this patch. In trunk, waitFor is throwing IOException, do you think, I can file a small trivial bug and change for consistency in code? > HDFS may miss the final block when reading a file opened for writing if one of the datanode is dead > --------------------------------------------------------------------------------------------------- > > Key: HDFS-3701 > URL: https://issues.apache.org/jira/browse/HDFS-3701 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs client > Affects Versions: 1.0.3 > Reporter: nkeywal > Assignee: nkeywal > Priority: Critical > Attachments: HDFS-3701.branch-1.v2.merged.patch, HDFS-3701.branch-1.v3.patch, HDFS-3701.branch-1.v4.patch, HDFS-3701.ontopof.v1.patch, HDFS-3701.patch > > > When the file is opened for writing, the DFSClient calls one of the datanode owning the last block to get its size. If this datanode is dead, the socket exception is shallowed and the size of this last block is equals to zero. This seems to be fixed on trunk, but I didn't find a related Jira. On 1.0.3, it's not fixed. It's on the same area as HDFS-1950 or HDFS-3222. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira