hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Xiaoqiao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-14702) Datanode.ReplicaMap memory leak
Date Mon, 05 Aug 2019 14:10:00 GMT
He Xiaoqiao created HDFS-14702:
----------------------------------

             Summary: Datanode.ReplicaMap memory leak
                 Key: HDFS-14702
                 URL: https://issues.apache.org/jira/browse/HDFS-14702
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: datanode
    Affects Versions: 2.7.1
            Reporter: He Xiaoqiao


DataNode memory is occupied by ReplicaMaps and cause GC high frequency then write performance
degrade.
It is about 600K block replicas located at DataNode, but when dump heap, there are over 8M
items of ReplicaMaps and footprint over 500MB. It seems that memory leak. One more situation,
the block w/r ops is very high.
Do not test HDFS-8859 and no idea if it can solve this issue.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org


Mime
View raw message