spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Myroslav Lisniak (JIRA)" <>
Subject [jira] [Created] (SPARK-23670) Memory leak of SparkPlanGraphWrapper in sparkUI
Date Tue, 13 Mar 2018 14:47:00 GMT
Myroslav Lisniak created SPARK-23670:

             Summary: Memory leak of SparkPlanGraphWrapper in sparkUI
                 Key: SPARK-23670
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.3.0
            Reporter: Myroslav Lisniak

Memory leak on driver for a long time running application. We have application using structured
streaming and running 48 hours. But driver fails with out of memory after 25 hours. After
investigating heap dump we found that most of the memory was occupied with a lot of *SparkPlanGraphWrapper*
objects inside *InMemoryStore*.

 Application was run with option: 
--driver-memory 4G

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message