hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "王志祥" <wangchi...@gmail.com>
Subject Test Hadoop performance on EC2
Date Tue, 01 Jul 2008 02:52:29 GMT
Hi all,
I've made some experiments on Hadoop on Amazon EC2.
I would like to share the result and any feedback would be appreciated.

Environment:
-Xen VM (Amazon EC2 instance ami-ee53b687)
-1.7Ghz Xeon CPU, 1.75GB of RAM, 160GB of local disk, and 250Mb/s of network
bandwidth (small instance)
-Hadoop 0.17.0
-storage: HDFS
-Test example: wordcount

Experiment 1: (fixed # of instances (8), variant data size (2MB~512MB), # of
maps: 8, # of reduces: 8)
Data Size(MB) | Time(s)
128
256
512

Experiment 2:

Experiment 3:

-- 
Best Regards,
Shawn

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message