crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-455) Sort.sort doesn't work with ReverseAvroComparator in MemPipeline
Date Mon, 11 Aug 2014 18:48:13 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093147#comment-14093147
] 

Josh Wills commented on CRUNCH-455:
-----------------------------------

It's one of (many) things I kick myself for doing in the initial impl; I think we've slowly-but-surely
eliminated object reuse throughout the project over time, but I hear you, it gives me pause
as well. Will noodle on this a bit more and see if I can come up with something a little less
invasive.

> Sort.sort doesn't work with ReverseAvroComparator in MemPipeline
> ----------------------------------------------------------------
>
>                 Key: CRUNCH-455
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-455
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core
>            Reporter: David Whiting
>            Assignee: Josh Wills
>            Priority: Minor
>         Attachments: CRUNCH-455.patch
>
>
> The mem Shuffler class discards the config that arrives with the GroupingOptions and
only uses the unmodified Conifguration from the pipeline object, which means that "crunch.schema"
is not set and causes a NullPointerException when you try and execute it.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message