spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-1412) Disable partial aggregation automatically when reduction factor is low
Date Fri, 04 Apr 2014 01:55:15 GMT
Reynold Xin created SPARK-1412:
----------------------------------

             Summary: Disable partial aggregation automatically when reduction factor is low
                 Key: SPARK-1412
                 URL: https://issues.apache.org/jira/browse/SPARK-1412
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 1.0.0
            Reporter: Reynold Xin
            Assignee: Michael Armbrust
             Fix For: 1.1.0


Once we see enough number of rows in partial aggregation and don't observe any reduction,
the aggregate operator should just turn off partial aggregation. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message