spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prabhu Joseph <>
Subject Improving Spark Scheduler Delay
Date Thu, 17 Mar 2016 01:27:10 GMT
Hi All,

    On running Concurrent Spark Jobs (huge number of tasks) with same Spark
Context, there is high scheduler delay. We have FAIR schedulingPolicy set
and also we tried with different pool for each jobs but still no
improvement. What are the tuning ways to improve Scheduler Delay.

Prabhu Joseph

View raw message