spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-20871) Only log Janino code in debug mode
Date Mon, 17 Jul 2017 17:10:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-20871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-20871:
------------------------------------

    Assignee: Apache Spark

> Only log Janino code in debug mode
> ----------------------------------
>
>                 Key: SPARK-20871
>                 URL: https://issues.apache.org/jira/browse/SPARK-20871
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.1.1
>            Reporter: Glen Takahashi
>            Assignee: Apache Spark
>         Attachments: 6a57e344-3fcf-11e7-85cc-52a06df2a489.png
>
>
> Currently if Janino code compilation fails, it will log the entirety of the code in the
executors. Because the generated code can often be very large, the logging can cause heap
pressure on the driver and cause it to fall over.
> I propose removing the "$formatted" from here: https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala#L964



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message