flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yassine MARZOUGUI <y.marzou...@mindlytix.com>
Subject Behaviour of the BucketingSink when checkpoints fail
Date Fri, 28 Apr 2017 09:22:50 GMT
Hi all,

I'm have a failed job containing a BucketingSink. The last successful
checkpoint was before the source started emitting data. The following
checkpoints all failed due to the long timeout as I mentioned here :
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Checkpoints-very-slow-with-high-backpressure-td12762.html
.

The Taskmanager has then failed. Upon recovery, the pending fies did not
move to finished state.

Is that because the sink was not able to checkpoint to list of pending
files?
Is it possible to build the sink state just from the output folder and the
suffixes of the files?

Thanks,
Yassine

Mime
View raw message