spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From enrico d'urso <E.DU...@live.com>
Subject Spark scheduling mode
Date Thu, 01 Sep 2016 14:10:57 GMT
I am building a Spark App, in which I submit several jobs (pyspark). I am using threads to
run them in parallel, and also I am setting: conf.set("spark.scheduler.mode", "FAIR") Still,
I see the jobs run serially in FIFO way. Am I missing something?

Cheers,


Enrico

Mime
View raw message