Mailing-List: contact user-help@avro.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@avro.apache.org
Received-SPF: pass (athena.apache.org: domain of eychih@hotmail.com designates
 65.54.51.81 as permitted sender)
Message-ID: <SNT113-W444857F0D82E543962AFCD99D0@phx.gbl>
Content-Type: multipart/alternative;
	boundary="_512c1dc0-9c7b-4c57-9664-692cfea02764_"
From: ey-chih chow <eychih@hotmail.com>
To: <user@avro.apache.org>
Subject: RE: how to specify MultipleOutputs, MultipleInputs in using Avro
 mapred API
Date: Wed, 18 Aug 2010 06:15:12 -0700
Importance: Normal
In-Reply-To: <SNT113-W53D13582EAE74A603348EFD99C0@phx.gbl>
References: 
 <SNT113-W45A6505608AEED72E35A73D99C0@phx.gbl>,<SNT113-W165D0633D83E84F6BA0E5AD99C0@phx.gbl>,<SNT113-W53D13582EAE74A603348EFD99C0@phx.gbl>
MIME-Version: 1.0

--_512c1dc0-9c7b-4c57-9664-692cfea02764_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable


Hi=2C
Let me rephrase my question to see if anybody is interested in answering it=
.  For the new version of Avro 1.4.0=2C the class hierarchy of AvroMapper a=
nd AvroReducer have been changed to subclass from Configured=2C rather than=
 from MapReduceBase to implement the interfaces Mapper and Reducer respecti=
vely.  The configuration of Avro mapred jobs are also different from that o=
f the other mapred jobs.  Furthermore=2C text log files have to be imported=
 to become Avro formats for Avro mapred jobs to process.  If I get a mapred=
 job that requires a reducer-side join of a two inputs=2C one from HBase an=
d the other from an imported log file with the Avro format=2C how can I con=
figure the two mappers to process inputs from HBase and the log file respec=
tively?  Also how can I configure an Avro reducer to generate multiple outp=
uts?  For multiple inputs and outputs=2C I got some examples programs from =
Tom White's Hadoop book.  But I simply don't know what kind of changes I sh=
ould make for the Avro case.  =20
Ey-Chih =20

From: eychih@hotmail.com
To: user@avro.apache.org
Subject: how to specify MultipleOutputs=2C MultipleInputs in using Avro map=
red API
Date: Mon=2C 16 Aug 2010 18:22:24 -0700


Hi=2C
I got a Map/Reduce job that require multiple inputs and outputs.  One of th=
e inputs will be processed by a mapper and a reducer that are subclasses of=
 AvroMapper/AvroReducer respectively.  And the reducer has multiple outputs=
.  I appreciate if anybody could let me know how to configure the job to do=
 this.
Ey-Chih    		 	   		  =

--_512c1dc0-9c7b-4c57-9664-692cfea02764_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style><!--
.hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 10pt=3B
font-family:Tahoma
}
--></style>
</head>
<body class=3D'hmmessage'>
Hi=2C<div><br></div><div>Let me rephrase my question to see if anybody is i=
nterested in answering it. &nbsp=3BFor the new version of Avro 1.4.0=2C the=
 class hierarchy of AvroMapper and AvroReducer have been changed to subclas=
s from Configured=2C rather than from MapReduceBase to implement the interf=
aces Mapper and Reducer respectively. &nbsp=3BThe configuration of Avro map=
red jobs are also different from that of the other mapred jobs. &nbsp=3BFur=
thermore=2C text log files have to be imported to become Avro formats for A=
vro mapred jobs to process. &nbsp=3BIf I get a mapred job that requires a r=
educer-side join of a two inputs=2C one from HBase and the other from an im=
ported log file with the Avro format=2C how can I configure the two mappers=
 to process inputs from HBase and the log file respectively? &nbsp=3BAlso h=
ow can I configure an Avro reducer to generate multiple outputs? &nbsp=3BFo=
r multiple inputs and outputs=2C I got some examples programs from Tom Whit=
e's Hadoop book. &nbsp=3BBut I simply don't know what kind of changes I sho=
uld make for the Avro case. &nbsp=3B&nbsp=3B</div><div><br></div><div>Ey-Ch=
ih &nbsp=3B<br><br><hr id=3D"stopSpelling">From: eychih@hotmail.com<br>To: =
user@avro.apache.org<br>Subject: how to specify MultipleOutputs=2C Multiple=
Inputs in using Avro mapred API<br>Date: Mon=2C 16 Aug 2010 18:22:24 -0700<=
br><br>

<meta http-equiv=3D"Content-Type" content=3D"text/html=3B charset=3Dunicode=
">
<meta name=3D"Generator" content=3D"Microsoft SafeHTML">
<style>
.ExternalClass .ecxhmmessage P
{padding:0px=3B}
.ExternalClass body.ecxhmmessage
{font-size:10pt=3Bfont-family:Tahoma=3B}

</style>


Hi=2C<div><br></div><div>I got a Map/Reduce job that require multiple input=
s and outputs. &nbsp=3BOne of the inputs will be processed by a mapper and =
a reducer that are subclasses of AvroMapper/AvroReducer respectively. &nbsp=
=3BAnd the reducer has multiple outputs. &nbsp=3BI appreciate if anybody co=
uld let me know how to configure the job to do this.</div><div><br></div><d=
iv>Ey-Chih &nbsp=3B&nbsp=3B</div></div> 		 	   		  </body>
</html>=

--_512c1dc0-9c7b-4c57-9664-692cfea02764_--