hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From java8964 <java8...@hotmail.com>
Subject RE: avro mapreduce output
Date Fri, 03 Oct 2014 13:11:31 GMT
Avro data should be a binary format in its own version. Why you got something like JSON?
What output format class you use?

Date: Fri, 3 Oct 2014 17:34:35 +0800
Subject: avro mapreduce output
From: delim123456@gmail.com
To: user@hadoop.apache.org

In mapreduce with reduce output format of <NullWritable, AvroValue<myavroclass>>
Is it possible for me to get the reduce output without the string   "key:none" and "value"
 , i.e. only the content of myavroclass itself??Thanks!

what i get now:{u'value': {u'MYCOLUMN1': 'Hello', u'MYCOLUMN2': 'World'}, u'key': None}what
i actually wanted:{u'MYCOLUMN1': 'Hello', u'MYCOLUMN2': 'World'} 		 	   		  
View raw message