hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yaron Gonen <yaron.go...@gmail.com>
Subject Custom comparator when using Kryo serializer for MapReduce serialization
Date Wed, 19 Aug 2015 10:21:10 GMT
Hi all,
(I'm using Hadoop 1.2.1)
I'm using Kryo <https://github.com/EsotericSoftware/kryo> (with chill
<https://github.com/twitter/chill>) as my serializer (instead of the
Writable interface).
However, I'm having trouble with the comparator: on one hand, since none of
my objects are Writable, I cannot use WritableComparator. On the other
hand, I can work with the RawComparator, but it means to deserialize the
bytes array each time - seems not very efficient...
Is there a way to give just an implementation of Java's Comparator? or to
make the serialized object Comparable?

Regards,
Yaron

Mime
View raw message