Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C6D4310D39 for ; Wed, 15 Jan 2014 13:10:06 +0000 (UTC) Received: (qmail 2608 invoked by uid 500); 15 Jan 2014 13:09:59 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 2093 invoked by uid 500); 15 Jan 2014 13:09:58 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 2085 invoked by uid 99); 15 Jan 2014 13:09:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jan 2014 13:09:57 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of bepcyc@gmail.com designates 74.125.82.41 as permitted sender) Received: from [74.125.82.41] (HELO mail-wg0-f41.google.com) (74.125.82.41) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jan 2014 13:09:53 +0000 Received: by mail-wg0-f41.google.com with SMTP id n12so5102867wgh.4 for ; Wed, 15 Jan 2014 05:09:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=F9b0jBJ5XtzMbAOuhMjWztCtkxwoD9zjj8d/Cj8Tn4g=; b=ciEiix6ZOD1K36z9i2QWiJqF1DYc+Dj5C0ct3rihKJfr2Mc0A/noxIYxXWQ9b9T0Mr kbjWfIgKQJRouDiwKYMAwevnm+BBkgpT/93x2oc5X6P/QBg1ExA4wtreIjRzvrdhlImI ja+wJNLRlbvtUsRZfZcBqii3flBgDq+NsxomdmfRRWQ1R/mn+136IciPrAaW3ZQRANDC OcldlyuSAFq+Rr1omO3K891B+nXEMIQJFKX40d+nfi3BJmk7d7g3pAADHPZGj1CfX3uI VDCry8s2d/Aw9lePIyDNlewmixGvWvPx7g3Xa3B1pR202xRI7P9w6C1CeuGKc3/5v3kx uOXw== MIME-Version: 1.0 X-Received: by 10.194.48.74 with SMTP id j10mr2247218wjn.41.1389791371881; Wed, 15 Jan 2014 05:09:31 -0800 (PST) Received: by 10.216.139.1 with HTTP; Wed, 15 Jan 2014 05:09:31 -0800 (PST) In-Reply-To: References: Date: Wed, 15 Jan 2014 14:09:31 +0100 Message-ID: Subject: Re: HADOOP & CUDA From: Slava Rodionov To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7ba975c808736704f00205d1 X-Virus-Checked: Checked by ClamAV on apache.org --047d7ba975c808736704f00205d1 Content-Type: text/plain; charset=ISO-8859-1 Hi Massimo, I don't see why should anyone actually need any interface between Hadoop and CUDA in case that you're using C++? Why don't you just make sure that all of your data nodes are able to run CUDA locally, then write some function that uses CUDA and then just call this function inside your mapper or reducer? Best regards, Viacheslav 2014/1/15 Massimo Simoniello > Hi, I'm working on hadoop 2.2.0 and I'm writting a C++ application with > pipes. I would like to use also CUDA in my mapper/reducer but I'm not able > to find enough info. > I'have found this interesting slide: > http://www.slideshare.net/airbots/cuda-29330283 and this page in the wiki > http://wiki.apache.org/hadoop/CUDA%20On%20Hadoop. > > I don't understand where are these functions: > > - void processHadoopData(string& input); > - void cudaCompute(std::map& output); > > > I don't understand where I have to write the code and if it is really > possible. > > Is there any tutorial to learning how to configure hadoop+cuda, write the > code, compile it, execute it? > > Is there any example? > --047d7ba975c808736704f00205d1 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Massimo,

I don't see why should = anyone actually need any interface between Hadoop and CUDA in case that you= 're using C++?
Why don't you just make sure that all of y= our data nodes are able to run CUDA locally, then write some function that = uses CUDA and then just call this function inside your mapper or reducer?

Best regards,
Viacheslav


2014/1/15 Massimo Simo= niello <massimo.simoniello@gmail.com>
Hi, I'm working on hado= op 2.2.0 and I'm writting a C++ application with pipes. I would like to= use also CUDA in my mapper/reducer but I'm not able to find enough inf= o.
I'have found this interesting slide:=A0http://www.slideshare.net/air= bots/cuda-29330283=A0and this page in the wiki=A0http://wiki.apache= .org/hadoop/CUDA%20On%20Hadoop.

I don't understand where are these functions:=A0
  • void processHadoopDat= a(string& input);
  • void cudaCompute(std::map<string,string>& output);

I don't understand where I have to = write the code and if it is really possible.

Is th= ere any tutorial to learning how to configure hadoop+cuda, write the code, = compile it, execute it?

Is there any example?

--047d7ba975c808736704f00205d1--