hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pradeep Kamath (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-563) PERFORMANCE: enable combiner to be called 0 or more times whenver the combiner is used for a pig query
Date Sat, 13 Dec 2008 01:42:44 GMT
PERFORMANCE: enable combiner to be called 0 or more times whenver the combiner is used for
a pig query
------------------------------------------------------------------------------------------------------

                 Key: PIG-563
                 URL: https://issues.apache.org/jira/browse/PIG-563
             Project: Pig
          Issue Type: Improvement
    Affects Versions: types_branch
            Reporter: Pradeep Kamath
            Assignee: Pradeep Kamath
             Fix For: types_branch


Currently Pig's use of the combiner assumes the combiner is called exactly once in Hadoop.
With Hadoop 18, the combiner could be called 0, 1 or more times. This issue is to track changes
needed in the CombinerOptimizer visitor and the builtin Algebraic UDFS (SUM, COUNT, MIN, MAX,
AVG) to be able to work in this new model.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message