spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yin Huai (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-10429) MutableProjection should evaluate all expressions first and then update the mutable row
Date Thu, 03 Sep 2015 03:07:45 GMT
Yin Huai created SPARK-10429:
--------------------------------

             Summary: MutableProjection should evaluate all expressions first and then update
the mutable row
                 Key: SPARK-10429
                 URL: https://issues.apache.org/jira/browse/SPARK-10429
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Yin Huai
            Priority: Blocker
             Fix For: 1.6.0


Right now, SQL's mutable projection updates every value of the mutable project after it evaluates
the corresponding expression. This makes the behavior of MutableProjection confusing and complicate
the implementation of common aggregate functions like stddev because developers need to be
aware that when evaluating {{i+1}}th expression of a mutable projection, {{i}}th slot of the
mutable row has already been updated.

A better behavior of MutableProjection will be that we evaluate all expressions first and
then update all values of the mutable row.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message