Return-Path: Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: (qmail 81913 invoked from network); 24 Sep 2010 22:43:34 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 24 Sep 2010 22:43:34 -0000 Received: (qmail 12285 invoked by uid 500); 24 Sep 2010 22:43:34 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 12237 invoked by uid 500); 24 Sep 2010 22:43:33 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 12229 invoked by uid 99); 24 Sep 2010 22:43:33 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Sep 2010 22:43:33 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of georgekola@gmail.com designates 209.85.216.169 as permitted sender) Received: from [209.85.216.169] (HELO mail-qy0-f169.google.com) (209.85.216.169) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Sep 2010 22:43:24 +0000 Received: by qyk7 with SMTP id 7so2369021qyk.14 for ; Fri, 24 Sep 2010 15:43:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:subject:date :message-id:mime-version:content-type:x-mailer:thread-index :content-language; bh=/hYN02guPGOGdlSSLmqLdsIIk4mEdPXil2X62iUj6g0=; b=hLQzybvByLtzllhbkxwwf/u8eiRNx0Ep18R9TfmsWoE4kD9Bib1ua9RhSAM0KSFd28 9a92pBvUj7Asxbj/k0ns7eLMDAS4kqNEoiDnY6pvP92Ct9k+7wAOGKBpiX5zPiWHedtq qIpSAvRxaXsYmI9Pp9dlLfkwgBiZP0w5LSfR4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:subject:date:message-id:mime-version:content-type:x-mailer :thread-index:content-language; b=Agmj8gc/eqE42+b/lJngtVvK0H38/j7Rbxn2QtOnS7BE4i4+ARhVH1E0Ueb3PCMeR4 umQJPKHJqOTIGhwG0LAK6UxnLNOh6C2AyfxjeCJTIB9bK43dqySxrfGx+M9fugvZw9vN 28m+G0yUt4fGkej9O3r3ItJZ7duMVPFD8w1Zc= Received: by 10.229.1.106 with SMTP id 42mr2984231qce.237.1285368182765; Fri, 24 Sep 2010 15:43:02 -0700 (PDT) Received: from SPEED (h-64-236-138-3.aoltw.net [64.236.138.3]) by mx.google.com with ESMTPS id r36sm2900018qcs.27.2010.09.24.15.43.01 (version=TLSv1/SSLv3 cipher=RC4-MD5); Fri, 24 Sep 2010 15:43:02 -0700 (PDT) From: "George Kola" To: Subject: Multiple output with hadoop pipes Date: Fri, 24 Sep 2010 15:43:01 -0700 Message-ID: <005201cb5c39$d93ff610$8bbfe230$@com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_0053_01CB5BFF.2CE11E10" X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: ActcOdfvKEcS0JQWRHmGeo+O2rLyQQ== Content-Language: en-us X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. ------=_NextPart_000_0053_01CB5BFF.2CE11E10 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit I want to know if it is possible to write to multiple outputs from a hadoop pipes job. If it possible, any links to relevant document is appreciated. Most of our jobs are in C++ and we use hadoop pipes. Scanning through the document, I found this -- http://hadoop.apache.org/mapreduce/docs/r0.21.0/api/org/apache/hadoop/mapred /lib/MultipleOutputs.html I am not sure how I can use it in hadoop pipes. Thanks, George ------=_NextPart_000_0053_01CB5BFF.2CE11E10 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

 I want to know if it is possible to write to = multiple outputs from a hadoop pipes job. If it possible, any links to relevant = document is appreciated. 

Most of our jobs are in C++ and we use hadoop = pipes.  Scanning through the document, I found this  --  http://hadoop.apache.org/mapreduce/= docs/r0.21.0/api/org/apache/hadoop/mapred/lib/MultipleOutputs.html

I am not sure how I can use it  in hadoop = pipes.

 

 

 

Thanks,

George

------=_NextPart_000_0053_01CB5BFF.2CE11E10--