flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Piotr Nowojski <pi...@data-artisans.com>
Subject Re: Checkpoint is not triggering as per configuration
Date Fri, 11 May 2018 11:34:23 GMT
Hi,

It’s not considered as a bug, only a missing not yet implemented feature (check my previous
responses for the Jira ticket). Generally speaking using file input stream for DataStream
programs is not very popular, thus this was so far low on our priority list.

Piotrek

> On 10 May 2018, at 06:26, xiatao123 <tao@udacity.com> wrote:
> 
> I ran into a similar issue.
> 
> Since it is a "Custom File Source", the first source just listing
> folder/file path for all existing files. Next operator "Split Reader" will
> read the content of the file.  
> "Custom File Source" went to "finished" state after first couple secs. 
> That's way we got this error message "Custom File Source (1/1) is not being
> executed at the moment. Aborting checkpoint". Because the "Custom File
> Source" finished already.
> 
> Is this by design?  Although the "Custom File Source" finished in secs, the
> rest of the pipeline can running for hours or days. Whenever anything went
> wrong, the pipeline will restart and start to reading from the beginning
> again, since there is not any checkpoint.
> 
> 
> 
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/


Mime
View raw message