spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [spark] viirya edited a comment on pull request #32136: [SPARK-35022][CORE] Task Scheduling Plugin in Spark
Date Wed, 21 Apr 2021 09:32:12 GMT

viirya edited a comment on pull request #32136:
URL: https://github.com/apache/spark/pull/32136#issuecomment-823921792


   I implemented the task scheduling plugin specially for stateful operators in Structured
Streaming in last few days. In the experiments, it successfully keeps the state store location
fixed across micro-batches and also distributes state store locations as expected. I will
create another PR of the implementation as a reference.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message