flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maximilian Bode <maximilian.b...@tngtech.com>
Subject Prevent job/operator from spilling to disk
Date Wed, 04 May 2016 11:46:12 GMT
Hi everyone,

is there a way to prevent operators from spilling to disk? If not, would it be conceivable
to make this configurable either per job or operator?

The use case is a batch application with the formal requirement not to persist in-flight data
to disk (even temporarily) so it would be preferable to see the job fail and then be able
to grant sufficient memory and run it again.


Maximilian Bode * Software Consultant * maximilian.bode@tngtech.com
TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterföhring
Geschäftsführer: Henrik Klagges, Christoph Stock, Dr. Robert Dahlke
Sitz: Unterföhring * Amtsgericht München * HRB 135082

View raw message