hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5192) Block reciever should not remove a finalized block when block replication fails
Date Fri, 06 Feb 2009 20:14:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12671292#action_12671292
] 

Hairong Kuang commented on HADOOP-5192:
---------------------------------------

Good catch Raghu! It seems that BlockReceiver should not remove the block in case of the following
two exceptions thrown by FSDataset#writeToBlock
1.         throw new IOException("Block " + b + " is valid, and cannot be written to.");
2.        throw new IOException("Block " + b +  " has already been started (though not completed),
and thus cannot be created.");

My patch handles only 1.


> Block reciever should not remove a finalized block when block replication fails
> -------------------------------------------------------------------------------
>
>                 Key: HADOOP-5192
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5192
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.18.3
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>             Fix For: 0.18.4
>
>         Attachments: blockRemove.patch
>
>
> HADOOP-4702 makes block receivers to remove the received block in case of a block replication
failure. But the block should not be removed if the cause of the failure is that the block
to be received already exists. The key is that a block receiver should allow to remove only
partial blocks in case of block replication failures. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message