hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Min Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-2425) Distributed simulator for stressing JobTracker and NameNode
Date Fri, 08 Apr 2011 04:02:05 GMT
Distributed simulator for stressing JobTracker and NameNode
-----------------------------------------------------------

                 Key: MAPREDUCE-2425
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2425
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
          Components: benchmarks
            Reporter: Min Zhou
             Fix For: 0.22.0


Hadoop need a tool for stressing JobTracker and NameNode. Mumak introduced a simulated JobTracker,
whose behavior doesn't exactly like that of the real JobTracker. Even more, mumak can't simulate
a large cluster with quite a lot of jobs run on it. On the other hand, Gridmix v3 need hundreds
of physical nodes to replay job stories. 

You can think this tool a complementation of mumak and gridmix v3. We successfully used this
tool to simulate a 12000 nodes cluster through 4 real machines. 
I've talk to Hong Tang and Scott Chen offline, they suggested me contributing this tool to
the hadoop community.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message