Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 8939 invoked from network); 4 Dec 2009 23:33:08 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 4 Dec 2009 23:33:08 -0000 Received: (qmail 26413 invoked by uid 500); 4 Dec 2009 23:33:05 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 26317 invoked by uid 500); 4 Dec 2009 23:33:05 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 26307 invoked by uid 99); 4 Dec 2009 23:33:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Dec 2009 23:33:05 +0000 X-ASF-Spam-Status: No, hits=-5.7 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_MED X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of awittenauer@linkedin.com designates 69.28.149.25 as permitted sender) Received: from [69.28.149.25] (HELO esv4-mav03.corp.linkedin.com) (69.28.149.25) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Dec 2009 23:33:01 +0000 DomainKey-Signature: s=prod; d=linkedin.com; c=nofws; q=dns; h=X-IronPort-AV:Received:User-Agent:Date:Subject:From:To: Message-ID:Thread-Topic:Thread-Index:In-Reply-To: Mime-version:Content-type:Content-transfer-encoding; b=OrChg0QTI8vte9MNskam+Tm7/Gv0NIBxVzcI3oqxnRz26lWg5Z47iuCb RxCLBLPU6pOFXzgl/PZWoFyGbE3zhtLqO1pcWdx0GlsejgqFL5WylYaD1 oN1fQvZa7cvo0+1; DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=linkedin.com; i=awittenauer@linkedin.com; q=dns/txt; s=proddkim; t=1259969581; x=1291505581; h=from:sender:reply-to:subject:date:message-id:to:cc: mime-version:content-transfer-encoding:content-id: content-description:resent-date:resent-from:resent-sender: resent-to:resent-cc:resent-message-id:in-reply-to: references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:list-owner:list-archive; z=From:=20Allen=20Wittenauer=20 |Subject:=20Re:=20streaming=20job=20written=20in=20c++ |Date:=20Fri,=2004=20Dec=202009=2015:31:56=20-0800 |Message-ID:=20 |To:=20|Mime-version:=201. 0|Content-transfer-encoding:=207bit|In-Reply-To:=20; bh=lqfxq1EDpI37eOkpasyjed/kSCuBe0ZNWCveqFF5Bms=; b=ehkSUNrRUNw/BP4dJZd+42xapdXoenHmxI4UZzNXIfkfk3L0vw6K22AJ FQpwgvh8QiI90t1WkZMKjiNtLGZvJuej7pQeTtAvPZ7rPyhdx5ME9dA1q lf/1luoihd7AOuc; X-IronPort-AV: E=Sophos;i="4.47,344,1257148800"; d="scan'208";a="9817375" Received: from 172.16.19.135 ([172.16.19.135]) by CORP-MAIL.linkedin.biz ([172.18.46.135]) via Exchange Front-End Server mail-access.linkedin.biz ([172.18.46.133]) with Microsoft Exchange Server HTTP-DAV ; Fri, 4 Dec 2009 23:31:59 +0000 User-Agent: Microsoft-Entourage/12.10.0.080409 Date: Fri, 04 Dec 2009 15:31:56 -0800 Subject: Re: streaming job written in c++ From: Allen Wittenauer To: Message-ID: Thread-Topic: streaming job written in c++ Thread-Index: Acp1OfeIjkMvJZjgW0WWQY8jGXjOxQ== In-Reply-To: Mime-version: 1.0 Content-type: text/plain; charset="US-ASCII" Content-transfer-encoding: 7bit Absolutely none. You just read stdin/stdout as you would in any other language. But since C/C++ has its own interface, it is just more common to use that interface than using the one built for 'everything else'. On 12/4/09 3:29 PM, "Upendra Dadi" wrote: > Thank you Allen for you reply. I am trying to use MapReduce on Amazon EC2. > EC2 don't seem to support Pipes using their simple web GUI interface (is it > possible to use Pipes using their CLI or API?!). What is the problem with > using C++ with streaming? > > Upendra > > ----- Original Message ----- > From: "Allen Wittenauer" > To: > Sent: Friday, December 04, 2009 6:17 PM > Subject: Re: streaming job written in c++ > > >> >> For C/C++, you should be using the pipes interface. >> >> >> >> On 12/4/09 3:09 PM, "Upendra Dadi" wrote: >> >>> Hi, >>> Can anybody please give an example of a streaming mapper/reducer >>> written in >>> C++? I don't seem to find even a single example on web. Thanks. >>> Upendra >> >