hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrzej Bialecki ...@getopt.org>
Subject Re: Proposal for adding user defined ordering to pig
Date Tue, 06 Nov 2007 11:53:20 GMT
Benjamin Reed wrote:
> Using the compareTo method is just the default. We can define our own 
> WritetableComparator subclass to hook into the Hadoop sorting.

You can either register it in WritableComparator (though this is less 
flexible - the comparator will be used in every case, no matter what job 
runs in the JVM), or set it specifically on a per-job basis using 
JobConf.setOutputKeyComparatorClass().


-- 
Best regards,
Andrzej Bialecki     <><
  ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


Mime
View raw message