avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Martin Kleppmann <mar...@rapportive.com>
Subject Re: Joining Avro input files in using Java mapreduce
Date Wed, 24 Apr 2013 10:35:24 GMT
Hey Sripad,

Take a look at AvroMultipleInputs.
http://avro.apache.org/docs/1.7.4/api/java/org/apache/avro/mapred/AvroMultipleOutputs.html(mapred
version)
http://avro.apache.org/docs/1.7.4/api/java/org/apache/avro/mapreduce/AvroMultipleOutputs.html(mapreduce
version)

Martin


On 23 April 2013 17:01, Sripad Sriram <sripad@path.com> wrote:

> Hey folks,
>
> Aware that I can use Pig, Hive, etc to join avro files together, but I
> have several use cases where I need to perform a reduce-side join on two
> avro files. MultipleInputs doesn't seem to like AvroInputFormat - any
> thoughts?
>
> thanks!
> Sripad
>

Mime
View raw message