hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nishanth S <chinchu2...@gmail.com>
Subject [No Subject]
Date Fri, 01 May 2015 17:30:40 GMT
Hello All,

I am  looking to write a map only program in java .The output of which are
two avro files.There  can  be two types of records in the input file(let us
say lion and tiger) and based on an identifier they are processed and
 written to  two different avro files using  'AvroMultipleOutputs'.

The map function would look like

public static class CustomMapper extends
      Mapper<AvroKey< ?>, NullWritable, Text, IntWritable>

I would need to write a map function that can process lion and tiger
records?What would be the best approach to do this?.

Can  I  sub class schemas?
Expicitly add an 'Animal' interface to the  generated Avro  class?

I request some help on this.


View raw message