hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen Liang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-11923) Stress test of DFSNetworkTopology
Date Fri, 02 Jun 2017 20:59:04 GMT
Chen Liang created HDFS-11923:
---------------------------------

             Summary: Stress test of DFSNetworkTopology
                 Key: HDFS-11923
                 URL: https://issues.apache.org/jira/browse/HDFS-11923
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Chen Liang
            Assignee: Chen Liang


I wrote a stress test with {{DFSNetworkTopology}} to verify its correctness under huge number
of datanode changes e.g., data node insert/delete, storage addition/removal etc. The goal
is to show that the topology maintains the correct counters all time. The test is written
that, unless manually terminated, it will keep randomly performing the operations nonstop.
(and because of this, the test is ignored in the patch).

My local test lasted 40 min before I stopped it, it involved more than one million datanode
changes, and no error happened. We believe this should be sufficient to show the correctness
of {{DFSNetworkTopology}}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message