hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Min Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-2425) Distributed simulator for stressing JobTracker and NameNode
Date Fri, 08 Apr 2011 04:02:05 GMT
Distributed simulator for stressing JobTracker and NameNode

                 Key: MAPREDUCE-2425
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2425
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
          Components: benchmarks
            Reporter: Min Zhou
             Fix For: 0.22.0

Hadoop need a tool for stressing JobTracker and NameNode. Mumak introduced a simulated JobTracker,
whose behavior doesn't exactly like that of the real JobTracker. Even more, mumak can't simulate
a large cluster with quite a lot of jobs run on it. On the other hand, Gridmix v3 need hundreds
of physical nodes to replay job stories. 

You can think this tool a complementation of mumak and gridmix v3. We successfully used this
tool to simulate a 12000 nodes cluster through 4 real machines. 
I've talk to Hong Tang and Scott Chen offline, they suggested me contributing this tool to
the hadoop community.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message