hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ying He (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-1241) Accumulator is turned on when a map is used with a non-accumulative UDF
Date Tue, 16 Feb 2010 23:47:28 GMT
Accumulator is turned on when a map is used with a non-accumulative UDF
-----------------------------------------------------------------------

                 Key: PIG-1241
                 URL: https://issues.apache.org/jira/browse/PIG-1241
             Project: Pig
          Issue Type: Bug
            Reporter: Ying He


Exception is thrown for a script like the following:

register /homes/yinghe/owl/string.jar;
a = load 'a.txt' as (id, url);
b = group  a by (id, url);
c = foreach b generate  COUNT(a), (CHARARRAY) string.URLPARSE(group.url)#'url';
dump c;

In this query, URLPARSE() is not accumulative, and it returns a map. 

The accumulator optimizer failed to check UDF in this case, and tries to run the job in accumulative
mode. ClassCastException is thrown when trying to cast UDF into Accumulator interface.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message