Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 99456 invoked from network); 23 Mar 2011 14:44:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 23 Mar 2011 14:44:47 -0000 Received: (qmail 96475 invoked by uid 500); 23 Mar 2011 14:44:46 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 96218 invoked by uid 500); 23 Mar 2011 14:44:46 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 96174 invoked by uid 99); 23 Mar 2011 14:44:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Mar 2011 14:44:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Mar 2011 14:44:42 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id C96DE431A6 for ; Wed, 23 Mar 2011 14:44:05 +0000 (UTC) Date: Wed, 23 Mar 2011 14:44:05 +0000 (UTC) From: "Uma Maheswara Rao G (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <1754194135.6119.1300891445821.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Created] (HDFS-1779) After NameNode restart , Clients can not read partial files even after client invokes Sync. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 After NameNode restart , Clients can not read partial files even after client invokes Sync. ------------------------------------------------------------------------------------------- Key: HDFS-1779 URL: https://issues.apache.org/jira/browse/HDFS-1779 Project: Hadoop HDFS Issue Type: Bug Components: data-node, name-node Affects Versions: 0.20-append Environment: Linux Reporter: Uma Maheswara Rao G In Append HDFS-200 issue, If file has 10 blocks and after writing 5 blocks if client invokes sync method then NN will persist the blocks information in edits. After this if we restart the NN, All the DataNodes will reregister with NN. But DataNodes are not sending the blocks being written information to NN. DNs are sending the blocksBeingWritten information in DN startup. So, here NameNode can not find that the 5 persisted blocks belongs to which datanodes. This information can build based on block reports from DN. Otherwise we will loose this 5 blocks information even NN persisted that block information in edits. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira