spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-22750) Introduce reusable mutable states
Date Sun, 10 Dec 2017 13:29:06 GMT

     [ https://issues.apache.org/jira/browse/SPARK-22750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-22750:
------------------------------------

    Assignee:     (was: Apache Spark)

> Introduce reusable mutable states
> ---------------------------------
>
>                 Key: SPARK-22750
>                 URL: https://issues.apache.org/jira/browse/SPARK-22750
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 2.3.0
>            Reporter: Marco Gaido
>
> In code generation, adding many mutable states can be dangerous since we can hit the
constant pool limit.
> In the current code, each expression generates its own copy of mutable states and mutable
states cannot be shared across different expression. There are many cases, though, in which
this can be done and it can be useful. For instance, we create a UTC timezone object for each
date function which requires it, even though we might reuse always the same.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message