hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From arun k <arunk...@gmail.com>
Subject Benchmarks for IO and CPU Intensive workload
Date Fri, 09 Dec 2011 06:26:17 GMT
Hi guys !

I want to see the behavior of a single node of Hadoop cluster when IO
intensive / CPU intensive workload and mix of both is submitted to the
single node alone.
These workloads must stress the nodes.
I see that TestDFSIO benchmark is good for IO intensive workload.
Which benchmarks do i need to use for this ?
What amount of input data will be fair enough for seeing the behavior under
these workloads for each type of boxes if i have boxes with :-
 B1: 4 GB RAM, Dual  core ,150-250 GB DISK ,
 B2 : 1GB RAM, 50-80 GB Disk.


View raw message