hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block
Date Sat, 02 May 2015 15:35:13 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525322#comment-14525322
] 

Hudson commented on HDFS-7281:
------------------------------

SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2131 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2131/])
HDFS-7281. Missing block is marked as corrupted block (Ming Ma via Yongjun Zhang) (yzhang:
rev 279958b772c25e0633bd967828b7d27d5c0a6a56)
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java


> Missing block is marked as corrupted block
> ------------------------------------------
>
>                 Key: HDFS-7281
>                 URL: https://issues.apache.org/jira/browse/HDFS-7281
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: HDFS
>    Affects Versions: 3.0.0
>            Reporter: Ming Ma
>            Assignee: Ming Ma
>              Labels: supportability
>             Fix For: 3.0.0
>
>         Attachments: HDFS-7281-2.patch, HDFS-7281-3.patch, HDFS-7281-4.patch, HDFS-7281-5.patch,
HDFS-7281-6.patch, HDFS-7281.patch
>
>
> In the situation where the block lost all its replicas, fsck shows the block is missing
as well as corrupted. Perhaps it is better not to mark the block corrupted in this case. The
reason it is marked as corrupted is numCorruptNodes == numNodes == 0 in the following code.
> {noformat}
> BlockManager
>     final boolean isCorrupt = numCorruptNodes == numNodes;
> {noformat}
> Would like to clarify if it is the intent to mark missing block as corrupted or it is
just a bug.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message