Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: local policy)
From: Tony Burton <TBurton@SportingIndex.com>
To: "user@hadoop.apache.org" <user@hadoop.apache.org>
Date: Tue, 28 Aug 2012 14:36:48 +0100
Subject: RE: hadoop 1.0.3 equivalent of MultipleTextOutputFormat
Thread-Topic: hadoop 1.0.3 equivalent of MultipleTextOutputFormat
Thread-Index: Ac2FGvliZZ8vbwMTRAWBA6HJn2c+RwABsSjw
Message-ID: 
 <556325346CA26341B6F0530E07F90D96016C64CD95C9@GBGH-EXCH-CMS.sig.ads>
References: <20120828115859.240490@gmx.net>
 <556325346CA26341B6F0530E07F90D96016C64CD95C7@GBGH-EXCH-CMS.sig.ads>
 <CAOcnVr0s9U8NbTuNpkmn1Tf-O5QmeT9YLSVJbVt2ajRg+PebvQ@mail.gmail.com>
In-Reply-To: 
 <CAOcnVr0s9U8NbTuNpkmn1Tf-O5QmeT9YLSVJbVt2ajRg+PebvQ@mail.gmail.com>
Accept-Language: en-US, en-GB
Content-Language: en-US
acceptlanguage: en-US, en-GB
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Hi Harsh

Thanks for the reply - my understanding is that with MultipleOutputs I can =
write differently named files into the same target directory. With Multiple=
TextOutputFormat I was able to override the target directory name to perfor=
m the segmentation, by overriding generateFileNameForKeyValue().

Does the 1.0.3 MultipleOutputs give me the ability to alter the target dire=
ctory name as well as the file name?

Thanks,

Tony


-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]=20
Sent: 28 August 2012 13:44
To: user@hadoop.apache.org
Subject: Re: hadoop 1.0.3 equivalent of MultipleTextOutputFormat

The Multiple*OutputFormat have been deprecated in favor of the generic
MultipleOutputs API. Would using that instead work for you?

On Tue, Aug 28, 2012 at 6:05 PM, Tony Burton <TBurton@sportingindex.com> wr=
ote:
> Hi,
>
> I've seen that org.apache.hadoop.mapred.lib.MultipleTextOutputFormat is g=
ood for writing results into (for example) different directories created on=
 the fly. However, now I'm implementing a MapReduce job using Hadoop 1.0.3,=
 I see that the new API no longer supports MultipleTextOutputFormat. Is the=
re an equivalent that I can use, or will it be supported in a future releas=
e?
>
> Thanks,
>
> Tony
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright a=
nd may be legally privileged.  If you are not the intended recipient, then =
the dissemination or copying of this email is prohibited. If you have recei=
ved this in error, please notify the sender by replying by email and then d=
elete the email completely from your system.  Neither Sporting Index nor th=
e sender accepts responsibility for any virus, or any other defect which mi=
ght affect any computer or IT system into which the email is received and/o=
r opened.  It is the responsibility of the recipient to scan the email and =
no responsibility is accepted for any loss or damage arising in any way fro=
m receipt or use of this email.  Sporting Index Ltd is a company registered=
 in England and Wales with company number 2636842, whose registered office =
is at Gateway House, Milverton Street, London, SE11 4AP.  Sporting Index Lt=
d is authorised and regulated by the UK Financial Services Authority (reg. =
no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001).  An=
y financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
>


--=20
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM=20
=
**********************************************************************=0D=
=0AThis email and any attachments are confidential, protected by copyri=
ght and may be legally privileged.  If you are not the intended recipie=
nt, then the dissemination or copying of this email is prohibited. If y=
ou have received this in error, please notify the sender by replying by=
 email and then delete the email completely from your system.  Neither =
Sporting Index nor the sender accepts responsibility for any virus, or =
any other defect which might affect any computer or IT system into whic=
h the email is received and/or opened.  It is the responsibility of the=
 recipient to scan the email and no responsibility is accepted for any =
loss or damage arising in any way from receipt or use of this email.  S=
porting Index Ltd is a company registered in England and Wales with com=
pany number 2636842, whose registered office is at Gateway House, Milve=
rton Street, London, SE11 4AP.  Sporting Index Ltd is authorised and re=
gulated by the UK Financial Services Authority (reg. no. 150404) and Ga=
mbling Commission (reg. no. 000-027343-R-308898-001).  Any financial pr=
omotion contained herein has been issued=20=0D=0Aand approved by Sporti=
ng Index Ltd.=0D=0A=0D=0AOutbound email has been scanned for viruses an=
d SPAM=0D=0A=