spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paolo Platter <paolo.plat...@agilelab.it>
Subject Structured Streaming & Query Planning
Date Thu, 14 Mar 2019 15:50:59 GMT
Hi All,

I would like to understand why in a streaming query ( that should not be able to change its
behaviour along iterations ) there is a queryPlanning-Duration effort ( in my case is 33%
of trigger interval ) at every schedule. I don’t uderstand  why this is needed and if it
is possible to disable or cache it.

Thanks


[cid:image001.jpg@01D41D15.E01B6F00]

Paolo Platter
CTO
E-mail:        paolo.platter@agilelab.it<mailto:paolo.platter@agilelab.it>
Web Site:   www.agilelab.it<http://www.agilelab.it/>




Mime
View raw message