hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From alo alt <wget.n...@googlemail.com>
Subject Re: Choosing IO intensive and CPU intensive workloads
Date Fri, 09 Dec 2011 07:53:13 GMT
Hi Arun,

Micheal has write up a good tutorial about, including stress test and IO.
http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/

- Alex

On Fri, Dec 9, 2011 at 8:24 AM, ArunKumar <arunk786@gmail.com> wrote:

> Hi guys !
>
> I want to see the behavior of a single node of Hadoop cluster when IO
> intensive / CPU intensive workload and mix of both is submitted to the
> single node alone.
> These workloads must stress the nodes.
> I see that TestDFSIO benchmark is good for IO intensive workload.
> 1> Which benchmarks do i need to use for this ?
> 2> What amount of input data will be fair enough for seeing the behavior
> under these workloads for each type of boxes if i have boxes with :-
>  B1: 4 GB RAM, Dual  core ,150-250 GB DISK ,
>  B2 : 1GB RAM, 50-80 GB Disk.
>
> Arun
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Choosing-IO-intensive-and-CPU-intensive-workloads-tp3572282p3572282.html
> Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
>



-- 
Alexander Lorenz
http://mapredit.blogspot.com

*P **Think of the environment: please don't print this email unless you
really need to.*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message