hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "CUDA On Hadoop" by ChenHe
Date Thu, 17 Mar 2011 18:26:01 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "CUDA On Hadoop" page has been changed by ChenHe.
http://wiki.apache.org/hadoop/CUDA%20On%20Hadoop?action=diff&rev1=15&rev2=16

--------------------------------------------------

  Here, I will share some experiences about [[http://cse.unl.edu/~che/slides/cuda.pdf|CUDA
performance study on Hadoop MapReduce clusters]].
  
  == Methodology ==
- From the parallel programming point of view, CUDA can hlep us to parallelize program in
the second level if we regard the MapReduce framework as the first level parallelization [[Figure
1]]. In our study, we provide Hadoop+CUDA solution for programming languages: Java and C/C++.
The scheduling of GPU threads among grids and blocks is not concerned in our study.
+ From the parallel programming point of view, CUDA can hlep us to parallelize program in
the second level if we regard the MapReduce framework as the first level parallelization [[http://cse.unl.edu/~che/images/method.jpg|Figure
1]]. In our study, we provide Hadoop+CUDA solution for programming languages: Java and C/C++.
The scheduling of GPU threads among grids and blocks is not concerned in our study.
  
  === For Java programmers ===
  If your MapReduce program is written in Java, you may need [[http://download.oracle.com/javase/6/docs/technotes/guides/jni/spec/jniTOC.html|JNI]]
to make use of CUDA. However, [[http://www.jcuda.org|JCuda]] provides an easy solution for
us. We introduce CUDA to our Map stage. The CUDA code is called by map() method within Map
class. It is easy to extend to Reduce stage if necessary. There are two ways to compile your
CUDA code.

Mime
View raw message