hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vivek Ghatala (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-12679) Namenode stale memory Datanode gets Wipes out
Date Wed, 18 Oct 2017 17:38:00 GMT
Vivek Ghatala created HDFS-12679:
------------------------------------

             Summary: Namenode stale memory Datanode gets Wipes out
                 Key: HDFS-12679
                 URL: https://issues.apache.org/jira/browse/HDFS-12679
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: namenode
    Affects Versions: 2.8.1
            Reporter: Vivek Ghatala


Namenode stale mapping information about datanodes commands wiping out datanode.

LOG LINES:

2017-10-11 23:01:45,969 DEBUG org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager:
remove datanode XXX.XX.XX.1:YYYYY

2017-10-11 23:01:45,969 DEBUG org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager:
DatanodeManager.wipeDatanode(XXX.XX.XX.1:YYYYY): storage ##STORAGE_ID1## is removed from datanodeMap.

Scenario: Our environment uses shared storage. Whenever some datanode restarts, some other
node comes up with that storage with different Ip address. It is possible that multiple datanodes
restarts at same time. 

Case: the node 1 serving some storage X is now serving storage Y. node 2 comes up and is serving
storage X now. Namenode here commands storage Y to get wiped out.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message