avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tazan007 <tazan...@gmail.com>
Subject Re: Avro Map Reduce Question: GenericRecord, renaming reduce output
Date Sat, 09 Jun 2012 03:50:44 GMT
Looks like the output format probably isn't being set right, it looks like
TextOutputFormat.

You need to set the properties on Job not the JobConf you created.  When
you create the Job and pass in the JobConf, a copy of the JobConf is made
which is used in the Job.  So when you set the properties in the JobConf
you created after creating the Job, they are not reflected in the
configuration of the Job since it made a copy.

-Hiral

On Fri, Jun 8, 2012 at 3:46 PM, Shirahatti, Nikhil <snikhil@telenav.com>wrote:

> Hello,
>
> The code is checked in here: https://github.com/snikhil0/avro-mr
>
> The test class is: MuxDemuxRunnableTest
>
>
> Nikhil
>
> On 6/8/12 2:22 PM, "Doug Cutting" <cutting@apache.org> wrote:
>
> >On Fri, Jun 8, 2012 at 2:04 PM, Shirahatti, Nikhil <snikhil@telenav.com>
> >wrote:
> >> Whereas the reduce output file: has the 0<tab> before the
> >
> >It sounds like something is writing to the file before AvroOutputFormat.
> >
> >Can you provide a complete example that illustrates this?  E.g., like
> >those in the unit tests?
> >
> >
> http://svn.apache.org/repos/asf/avro/trunk/lang/java/mapred/src/test/java/
> >org/apache/avro/mapred/
> >
> >Thanks,
> >
> >Doug
>
>

Mime
View raw message