hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-125) Consistency of different replicas of the same block is not checked.
Date Mon, 21 Jul 2014 18:14:39 GMT

    [ https://issues.apache.org/jira/browse/HDFS-125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068950#comment-14068950
] 

Allen Wittenauer edited comment on HDFS-125 at 7/21/14 6:12 PM:
----------------------------------------------------------------

This feels like a special case of the problems mentioned in HDFS-366 and friends.


was (Author: aw):
This feels like a special case of the problems mentioned in HDFS-366 .

> Consistency of different replicas of the same block is not checked.
> -------------------------------------------------------------------
>
>                 Key: HDFS-125
>                 URL: https://issues.apache.org/jira/browse/HDFS-125
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Konstantin Shvachko
>
> HDFS currently detects corrupted replicas by verifying that its contents matches the
checksum stored in the block meta-file. This is done independently for each replica of the
block on the data-node it belongs to. But we do not check that the replicas are identical
across data-nodes as long as they have the same size.
> This is not common but can happen as a result of a software bug or an operator mismanagement.
And in this case different clients will read different data from the same file.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message