spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Izek Greenfield (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-24831) Spark Executor class create new serializer each time
Date Tue, 17 Jul 2018 10:29:00 GMT
Izek Greenfield created SPARK-24831:
---------------------------------------

             Summary: Spark Executor class create new serializer each time
                 Key: SPARK-24831
                 URL: https://issues.apache.org/jira/browse/SPARK-24831
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 2.4.0
            Reporter: Izek Greenfield


When I look in the code I find this line:

  (org.apache.spark.executor.Executor: 319)

 val resultSer = env.serializer.newInstance()
 why not hold this in threadLocal and reuse?

[questioin in stackOverflow|https://stackoverflow.com/questions/51298877/spark-executor-class-create-new-serializer-each-time]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message