Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 96347 invoked from network); 26 Jun 2008 04:24:47 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 26 Jun 2008 04:24:47 -0000 Received: (qmail 33996 invoked by uid 500); 26 Jun 2008 04:24:46 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 33390 invoked by uid 500); 26 Jun 2008 04:24:45 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 33379 invoked by uid 99); 26 Jun 2008 04:24:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Jun 2008 21:24:44 -0700 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS,WHOIS_MYPRIVREG X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of slitzferrari@gmail.com designates 64.233.166.182 as permitted sender) Received: from [64.233.166.182] (HELO py-out-1112.google.com) (64.233.166.182) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Jun 2008 04:23:53 +0000 Received: by py-out-1112.google.com with SMTP id f47so1987862pye.8 for ; Wed, 25 Jun 2008 21:24:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type:references; bh=Dhbn7AY/MoN7aBQ9n06wAXmvr4hYDD6OMR13mHRHicI=; b=Bbrpl9fYwWZ+Av/IP2jREpHqoJW/SCLnsdS/KIx6jiI3J/U8WNJfQFV/EZI8vkY9Ft YI9CnCuUM721BNKyrlV8vJZGOspKe1c2OUtdvyug0jq74/lwy0w2QBsICqfoj988VZvF nDga9PutOogpC5npgD3Px/fwC6Cl90in8FcgY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:references; b=TXg4PKL75Yof5mHCqpIbNWfi5y8rSZEIV+8zrdS2ju+LxKNsDAgnuhnxOGHyHppv1A XB35/LxVU4JQPa1BAgM8kqzEjRmT3FWxth7/eHtuUEeZBoF3ap0EebnuJHcTWIo4rPwg xPy80Mn/mljPPg9DHGBMVwUK811jiDmj55k2M= Received: by 10.114.38.2 with SMTP id l2mr2167337wal.200.1214454252163; Wed, 25 Jun 2008 21:24:12 -0700 (PDT) Received: by 10.115.48.10 with HTTP; Wed, 25 Jun 2008 21:24:12 -0700 (PDT) Message-ID: Date: Thu, 26 Jun 2008 05:24:12 +0100 From: slitz To: core-user@hadoop.apache.org Subject: Re: MultipleOutputFormat example In-Reply-To: <18119478.post@talk.nabble.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_771_29319819.1214454252165" References: <18119478.post@talk.nabble.com> X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_771_29319819.1214454252165 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hello, I just did! Thank you! And indeed it is A LOT easier, or maybe it's just the included snippets that help a lot, or maybe both things help :) Although i would still like to learn how to use MultipleOutputFormat/MultipleTextOutputFormat since it should be more flexible and i whould like to know how to use this kind of things in hadoop as this could help me understand other classes and patterns. So it would be great if someone could give me an example of how to use it. slitz On Wed, Jun 25, 2008 at 7:53 PM, montag wrote: > > Hi, > > You should check out the MultipleOutputs thread and patch of > https://issues.apache.org/jira/browse/HADOOP-3149 HADOOP-3149 There are > some relevant and useful code snippets that address the issue of splitting > output to multiple files within the discussion as well as in the patch > documentation. I found implementing this patch easier than dealing with > MultipleTextOutputFormat. > > Cheers, > Mike > > > > slitz wrote: > > > > Hello, > > I need the reduce to output to different files depending on the key, > after > > reading some jira entries and some previous threads of the mailing list i > > think that the MultipleTextOutputFormat class would fit my needs, the > > problem is that i can't find any example of how to use it. > > > > Could someone please show me a quick example of how to use this class or > > MultipleOutputFormat subclasses in general? i'm somewhat lost... > > > > slitz > > > > > > -- > View this message in context: > http://www.nabble.com/MultipleOutputFormat-example-tp18118780p18119478.html > Sent from the Hadoop core-user mailing list archive at Nabble.com. > > ------=_Part_771_29319819.1214454252165--