hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rushabh S Shah (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-11617) Datanode should delete the block from rbw direcotry when it finds duplicate in finalized directory.
Date Mon, 03 Apr 2017 20:58:41 GMT
Rushabh S Shah created HDFS-11617:
-------------------------------------

             Summary: Datanode should delete the block from rbw direcotry when it finds duplicate
in finalized directory.
                 Key: HDFS-11617
                 URL: https://issues.apache.org/jira/browse/HDFS-11617
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: datanode
    Affects Versions: 2.7.3
            Reporter: Rushabh S Shah


Recently we had power failure event and we hit HDFS-5042.
There were missing blocks but datanode had the copy of the block (and meta file) in rbw directory.
I manually copied the block and meta file to finalized directory and restarted the datanode.
But after restart, the block somehow got deleted from the finalized directory.
So I think the datanode tried to resolve duplicate replicas and in process of resolving it
deleted the replica from finalized directory.
In my opinion, if we have to choose between rbw replica and finalized replica (assuming size
and genstamp are same), we should delete rbw replica,  not finalized replica.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message