hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gray, Adam" <adamg...@amazon.com>
Subject Announcing HPC Instances on Amazon Elastic MapReduce
Date Tue, 16 Nov 2010 23:57:57 GMT
We are excited to announce that Amazon Elastic MapReduce<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=NXKY2U8PLMAUGM8QAAA9WMJ1E7WA&T=TC&U=http%3A%2F%2Faws.amazon.com%2Felasticmapreduce%2F%3Fref_%3Dpe_2170_17587710>
can now take advantage of Cluster Compute (cc1) and Cluster GPU (cg1) instances, giving you
the ability to combine Hadoop's massively parallelized architecture with high performance
computing. You can focus on developing HPC applications and Elastic MapReduce will handle
workload parallelization, node configuration and scaling, and cluster management. Further,
Elastic MapReduce applications that are I/O intensive have the opportunity to realize performance
improvement by leveraging the low latency, full bisection bandwidth 10 Gbps Ethernet network
between the instances in the cluster.

Cluster Compute Quadruple Extra Large (cc1.4xlarge) instances have the following configuration:

 *   A pair of quad-core Intel "Nehalem"<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=BUV0FAACQNE2OOH6G3SD1W0HEWIA&T=TC&U=http%3A%2F%2Fen.wikipedia.org%2Fwiki%2FNehalem_%2528microarchitecture%2529>
processors with a total of 33.5 ECU (EC2 Compute Units)
 *   23 GB of RAM
 *   1690 GB of local instance storage
 *   10 Gbps networking with network locality between nodes

Cluster GPU Quadruple Extra Large (cg1.4xlarge) instances add a pair of NVIDIA Tesla® M2050
and when launched with Elastic MapReduce have the NVIDIA GPU driver and CUDA<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=JELGRTSTGCVAOGTHZEPWVJOYMSUA&T=TC&U=http%3A%2F%2Fwww.nvidia.com%2Fobject%2Fwhat_is_cuda_new.html>
runtime installed.

Please refer to the High Performance Computing<http://www.amazon.com/gp/r.html?R=3Q89S9WPYQKE1&C=34S4XKTAXGMJV&H=3Q8IO9AMW2GTY8BTZBPTAXHVAXSA&T=TC&U=http%3A%2F%2Faws.amazon.com%2Fhpc-applications%2F%3Fref_%3Dpe_2170_17587710>
AWS Solutions page for more details on how HPC instances can be leveraged.


The Amazon Elastic MapReduce Team

Amazon Web Services LLC is a subsidiary of Amazon.com, Inc. Amazon.com is a registered trademark
of Amazon.com, Inc. This message produced and distributed by Amazon Web Services, LLC, 1200
12th Ave South, Seattle, WA 98144.
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message