hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Richard Ding (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-1030) explain and dump not working with two UDFs inside inner plan of foreach
Date Wed, 28 Oct 2009 18:19:59 GMT

     [ https://issues.apache.org/jira/browse/PIG-1030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Richard Ding updated PIG-1030:

    Attachment: PIG-1030.patch

The problem is that the code assums to combine only in the case where there is only  one PODistinct
which is the only input to an aggregate function. This patch disables the combiner if an aggregate
function in foreach statements have multiple inputs and one of them is PODistinct.

> explain and dump not working with two UDFs inside inner plan of foreach
> -----------------------------------------------------------------------
>                 Key: PIG-1030
>                 URL: https://issues.apache.org/jira/browse/PIG-1030
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Ying He
>            Assignee: Richard Ding
>         Attachments: PIG-1030.patch
> this scprit does not work
> register /homes/yinghe/owl/string.jar;
> a = load '/user/yinghe/a.txt' as (id, color);
> b = group a all;
> c = foreach b {
>     d = distinct a.color;
>     generate group, string.BagCount2(d), string.ColumnLen2(d, 0);
> }
> the udfs are regular, not algebraic.
> then if I call  "dump c;" or "explain c", I would get  this error message.
> ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2019: Expected to find plan with single
leaf. Found 2 leaves.
> The error only occurs for the first time, after getting this error, if I call "dump c"
or "explain c" again, it would succeed.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message