hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lance Norskog <goks...@gmail.com>
Subject Re: CUDA on Hadoop
Date Thu, 10 Feb 2011 09:18:57 GMT
If you want to use Python, one of the Py+CUDA projects generates CUDA
C from the Python byte-codes. You don't have to write any C. I don't
remember which project it is.

This lets you debug the CUDA code in isolation, then run it from the
Hadoop streaming mode.


On 2/9/11, Adarsh Sharma <adarsh.sharma@orkash.com> wrote:
> He Chen wrote:
>> Hi sharma
>>
>> I shared our slides about CUDA performance on Hadoop clusters. Feel
>> free to modified it, please mention the copyright!
>>
>> Chen
>>
>> On Wed, Feb 9, 2011 at 11:13 AM, He Chen <airbots@gmail.com
>> <mailto:airbots@gmail.com>> wrote:
>>
>>     Hi  Sharma
>>
>>     I have some experiences on working Hybrid Hadoop with GPU. Our
>>     group has tested CUDA performance on Hadoop clusters. We obtain 20
>>     times speedup and save up to 95% power consumption in some
>>     computation-intensive test case.
>>
>>     You can parallel your Java code by using JCUDA which is a kind of
>>     API to help you call CUDA in your Java code.
>>
>>     Chen
>>
>>
>>     On Wed, Feb 9, 2011 at 8:45 AM, Steve Loughran <stevel@apache.org
>>     <mailto:stevel@apache.org>> wrote:
>>
>>         On 09/02/11 13:58, Harsh J wrote:
>>
>>             You can check-out this project which did some work for
>>             Hama+CUDA:
>>             http://code.google.com/p/mrcl/
>>
>>
>>         Amazon let you bring up a Hadoop cluster on machines with GPUs
>>         you can code against, but I haven't heard of anyone using it.
>>         The big issue is bandwidth; it just doesn't make sense for a
>>         classic "scan through the logs" kind of problem as the
>>         disk:GPU bandwidth ratio is even worse than disk:CPU.
>>
>>         That said, if you were doing something that involved a lot of
>>         compute on a block of data (e.g. rendering tiles in a map),
>>         this could work.
>>
>>
>>
> Thanks Chen , I am looking for some White-Papers on the mentioned topic
> or concerning.
> I think no one has write any white paper on this topic Or I'm wrong.
>
> However U'r Ppt is very nice.
> Thanx Once again .
>
> Adarsh
>


-- 
Lance Norskog
goksron@gmail.com

Mime
View raw message