kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "xuekaiqi (Jira)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-4450) Add the feature that adjusting spark driver memory adaptively
Date Fri, 17 Apr 2020 09:45:00 GMT
xuekaiqi created KYLIN-4450:
-------------------------------

             Summary: Add the feature that adjusting spark driver memory adaptively
                 Key: KYLIN-4450
                 URL: https://issues.apache.org/jira/browse/KYLIN-4450
             Project: Kylin
          Issue Type: Improvement
          Components: Storage - Parquet
            Reporter: xuekaiqi
            Assignee: wangrupeng
             Fix For: v4.0.0


For now the cubing job can adaptively adjust the following spark properties to use of resources
retionally, but the driver memory of the spark job uploaded to cluster haven't been done.

 
{code:java}
spark.executor.memory
spark.executor.cores
spark.executor.memoryOverhead
spark.executor.instances
spark.sql.shuffle.partitions
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message