crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-280) Specify Comparator for total order sort
Date Thu, 17 Oct 2013 13:59:42 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797915#comment-13797915
] 

Josh Wills commented on CRUNCH-280:
-----------------------------------

It might be possible, although I'm worried about the performance hit involved. We could serialize
the PTableType that was used for the shuffle and use it to deserialize the data to use with
the normal comparator. I think this is something we do already in the Sort library for handling
multi-reducer sorts, so there might be some patterns we could reuse there.

> Specify Comparator for total order sort
> ---------------------------------------
>
>                 Key: CRUNCH-280
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-280
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Chao Shi
>            Assignee: Chao Shi
>
> It seems that Sort#sort can only uses the default comparator. It would be nice to make
it to be specified by clients. 



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message