spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Davies Liu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-8579) Support arbitrary object in UnsafeRow
Date Tue, 23 Jun 2015 22:20:42 GMT
Davies Liu created SPARK-8579:
---------------------------------

             Summary: Support arbitrary object in UnsafeRow
                 Key: SPARK-8579
                 URL: https://issues.apache.org/jira/browse/SPARK-8579
             Project: Spark
          Issue Type: New Feature
          Components: SQL
            Reporter: Davies Liu
            Assignee: Davies Liu


It's common to run count(distinct xxx) in SQL, the data type will be UDT of OpenHashSet, it's
good that we could use UnsafeRow to reducing the memory usage during aggregation.

Also for DecimalType, which could be used inside the grouping key.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message