flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eleanore Jin <eleanore....@gmail.com>
Subject Re: How to test flink job recover from checkpoint
Date Thu, 05 Mar 2020 05:30:33 GMT
Hi Zhu Zhu and Abhinav,

I am able to verify the recovery from checkpoint based on your suggestions,
thanks a lot for the help!
Eleanore

On Wed, Mar 4, 2020 at 5:40 PM Bajaj, Abhinav <abhinav.bajaj@here.com>
wrote:

> I implemented a custom function that throws up a runtime exception.
>
>
>
> You can extend from simpler MapFunction or more complicated
> RichParallelSourceFunction depending on your use case.
>
> You can add logic to throw a runtime exception on a certain condition in
> the map or run method.               .
>
> You can use a count or timer to trigger the exception.
>
>
>
> Sharing a quick handwritten example.
>
>
>
> DataStream<String> stream = .....
>
> DataStream<String> mappedStream = stream.map(new MapFunction<String,
> String>>() {
>
>           @Override
>
>           public String map(String value) throws Exception {
>
>             if (SOME_CONDITION) {
>
>               throw new RuntimeException("Lets test checkpointing");
>
>             }
>
>                 return value;
>
>           }
>
> });
>
>
>
> ~ Abhinav Bajaj
>
>
>
>
>
> *From: *Eleanore Jin <eleanore.jin@gmail.com>
> *Date: *Wednesday, March 4, 2020 at 4:40 PM
> *To: *user <user@flink.apache.org>, user-zh <user-zh@flink.apache.org>
> *Subject: *How to test flink job recover from checkpoint
>
>
>
> Hi,
>
>
>
> I have a flink application and checkpoint is enabled, I am running locally
> using miniCluster.
>
>
>
> I just wonder if there is a way to simulate the failure, and verify that
> flink job restarts from checkpoint?
>
>
>
> Thanks a lot!
>
> Eleanore
>

Mime
View raw message