pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nandor Kollar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-5155) Fix FRJoin related issues after trunk merge
Date Tue, 28 Feb 2017 09:23:45 GMT

    [ https://issues.apache.org/jira/browse/PIG-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887646#comment-15887646

Nandor Kollar commented on PIG-5155:

POFRJoin, which is the superclass of POFRJoinSpark changed: the type of 'replicated' variable
changed from TupleToMapKey array to List<Map<? extends Object, ? extends List<Tuple>>>,
and in the Map the keys are not wrapped into a tuple (as before), but it is just the output
of the inner local rearrange.
In fact the setUpHashMap was copied from POFRJoin to POFRJoinSpark, and was adjusted to work
with broadcasted variables instead of files.

> Fix FRJoin related issues after trunk merge
> -------------------------------------------
>                 Key: PIG-5155
>                 URL: https://issues.apache.org/jira/browse/PIG-5155
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: Nandor Kollar
>            Assignee: Nandor Kollar
>             Fix For: spark-branch
>         Attachments: PIG-5155.patch

This message was sent by Atlassian JIRA

View raw message