hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Edited] (HDFS-1779) After NameNode restart , Clients can not read partial files even after client invokes Sync.
Date Tue, 20 Sep 2011 17:06:09 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13108827#comment-13108827
] 

Eli Collins edited comment on HDFS-1779 at 9/20/11 5:06 PM:
------------------------------------------------------------

Nit, in recoverBlocksBeingWritten we should remove the comment wrt sending block received
messages since this was removed.

{noformat}
-     * ongoingCreates. Also, send a blockreceived message to the NN
-     * for each of these blocks because these are not part of a 
-     * block report.
+     * ongoingCreates.
{noformat}

      was (Author: eli):
    Nit, in recoverBlocksBeingWritten we should remove the comment wrt sending block received
messages since this was removed.

-     * ongoingCreates. Also, send a blockreceived message to the NN
-     * for each of these blocks because these are not part of a 
-     * block report.
+     * ongoingCreates.

  
> After NameNode restart , Clients can not read partial files even after client invokes
Sync.
> -------------------------------------------------------------------------------------------
>
>                 Key: HDFS-1779
>                 URL: https://issues.apache.org/jira/browse/HDFS-1779
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node, name-node
>    Affects Versions: 0.20-append
>         Environment: Linux
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>             Fix For: 0.20-append, 0.20.205.0
>
>         Attachments: HDFS-1779-20.security.3.patch, HDFS-1779.1.patch, HDFS-1779.2.patch,
HDFS-1779.2a.patch, HDFS-1779.patch, bbwReportAppend.patch
>
>
> In Append HDFS-200 issue,
> If file has 10 blocks and after writing 5 blocks if client invokes sync method then NN
will persist the blocks information in edits. 
> After this if we restart the NN, All the DataNodes will reregister with NN. But DataNodes
are not sending the blocks being written information to NN. DNs are sending the blocksBeingWritten
information in DN startup. So, here NameNode can not find that the 5 persisted blocks belongs
to which datanodes. This information can build based on block reports from DN. Otherwise we
will loose this 5 blocks information even NN persisted that block information in edits. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message