pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xianda Ke (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (PIG-5170) SkewedJoin_14 is failing with spark exec type
Date Wed, 19 Apr 2017 06:53:41 GMT

     [ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Xianda Ke reopened PIG-5170:
      Assignee: Xianda Ke

after apply the outer join patch. other SkewdJoin e2e cases passed, but SkewedJoin_14 still
failed.  after investigation, this bug is similar with PIG-4587.

For the streaming table, since more than one reducer can be associated with a key, the streamed
table records (that match the key) needs to be copied over to each of these reducers(see PIG-4858
for details).  if it is outer join, no need to join the null left record to all the copied
records, only join the first one.

i reopen this jira, and will update the fix patch soon.

> SkewedJoin_14 is failing with spark exec type
> ---------------------------------------------
>                 Key: PIG-5170
>                 URL: https://issues.apache.org/jira/browse/PIG-5170
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: Nandor Kollar
>            Assignee: Xianda Ke
>             Fix For: spark-branch
> results are different

This message was sent by Atlassian JIRA

View raw message