crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Micah Whitacre (JIRA)" <>
Subject [jira] [Commented] (CRUNCH-544) PTable.materializeToMap returns non-Serializable object
Date Fri, 17 Jul 2015 12:55:04 GMT


Micah Whitacre commented on CRUNCH-544:

Can you provide a test case or sample code for how you are using trying to use the PTable?
 I think I know what you are trying to do but seeing code can help to clarify or understand
your use case.

> PTable.materializeToMap returns non-Serializable object
> -------------------------------------------------------
>                 Key: CRUNCH-544
>                 URL:
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.12.0
>            Reporter: Mārtiņš Kalvāns
>            Priority: Minor
> In org/apache/crunch/impl/dist/collect/ materializeToMap returns org.apache.crunch.materialize.MaterializableMap
object that is not serializable ergo can not be used directly in Crunch api after.
> Also it uses poor performant AbstractMap base class that could be issue is someone assumes
that this map will be very efficient lookup table (probably most common use case).

This message was sent by Atlassian JIRA

View raw message