hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: How does NVidia GPU compare to Hadoop/MapReduce
Date Fri, 27 Feb 2009 19:21:17 GMT
I think they're complementary.

Hadoop's MapReduce lets you run computations on up to thousands of 
computers potentially processing petabytes of data.  It gets data from 
the grid to your computation, reliably stores output back to the grid, 
and supports grid-global computations (e.g., sorting).

CUDA can make computations on a single computer run faster by using its 
GPU.  It does not handle co-ordination of multiple computers, e.g., the 
flow of data in and out of a distributed filesystem, distributed 
reliability, global computations, etc.

So you might use CUDA within mapreduce to more efficiently run 
compute-intensive tasks over petabytes of data.


Mark Kerzner wrote:
> Hi, this from Dr. Dobbs caught my attention, 240 CPU for $1,700
> http://www.ddj.com/focal/NVIDIA-CUDA
> What are your thoughts?
> Thank you,
> Mark

View raw message