hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Praveen Sripati <praveensrip...@gmail.com>
Subject How to change the Hadoop default serialization?
Date Wed, 16 Nov 2011 03:24:02 GMT
Hi,

io.serializations is defaulted to
'org.apache.hadoop.io.serializer.WritableSerialization' and the description
says 'A list of serialization classes that can be used for obtaining
serializers and deserializers.'.

io.serializations can be changed to
'org.apache.hadoop.io.serializer.avro.AvroSerialization,org.apache.hadoop.io.serializer.WritableSerialization'
to include AvroSerialization.

a) How to change the default serialization in Hadoop from Writables to
Avro? Key and Values for the MapReduce programs need not be Writables.

b) Does this apply to RPC communication between Hadoop nodes also?

Thanks,
Praveen

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message