pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Olga Natkovich (JIRA)" <j...@apache.org>
Subject [jira] Created: (PIG-7) Optimize execution of algebraic functions
Date Fri, 02 Nov 2007 01:00:50 GMT
Optimize execution of algebraic functions

                 Key: PIG-7
                 URL: https://issues.apache.org/jira/browse/PIG-7
             Project: Pig
          Issue Type: Improvement
            Reporter: Olga Natkovich
            Assignee: Alan Gates

Algebraic are functions that can be computed incrementally like count(X), SUM(X), etc. They
can be computed effciently by doing the first level computation using hadoop combiner. This
can give a significant (2-3x) speedup for many aggregation queries. 

Several users asked us for this feature so it is pretty high priority.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message