hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Koch <ogd...@googlemail.com>
Subject Problem implementing custom WritableComparator
Date Mon, 23 Jul 2012 17:09:27 GMT
Hello,

I implemented a very simple custom WritableComparable which works fine as
is but I wanted to improve performance by implementing the
appropriate WritableComparator as well. The comparator does not seem to
work as keys which really should be the same are different according to the
reduce method.

I uploaded the code here: http://pastebin.com/usykcA1r

Any ideas where I am going wrong in my code? Again, if I comment the
WritableComparator
everything works as expected.

Thanks a lot,

/David

I followed the guidelines here:
http://developer.yahoo.com/hadoop/tutorial/module5.html#writable-comparatorand
also Chapter 4, page 106 o'Reilly Hadoop Book 3rd edition

Mime
View raw message