spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Davies Liu (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-10585) only copy data once when generate unsafe projection
Date Mon, 05 Oct 2015 20:01:26 GMT

     [ https://issues.apache.org/jira/browse/SPARK-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Davies Liu resolved SPARK-10585.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 1.6.0

Issue resolved by pull request 8747
[https://github.com/apache/spark/pull/8747]

> only copy data once when generate unsafe projection
> ---------------------------------------------------
>
>                 Key: SPARK-10585
>                 URL: https://issues.apache.org/jira/browse/SPARK-10585
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Wenchen Fan
>             Fix For: 1.6.0
>
>
> When we have nested struct, array or map, we will create a byte buffer for each of them,
and copy data to the buffer first, then copy them to the final row buffer. We can save the
first copy and directly copy data to final row buffer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message