flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hilmi Yildirim (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (FLINK-2624) RabbitMQ source / sink should participate in checkpointing
Date Tue, 08 Sep 2015 08:43:45 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14734404#comment-14734404
] 

Hilmi Yildirim edited comment on FLINK-2624 at 9/8/15 8:43 AM:
---------------------------------------------------------------

There is a problem with the method restoreState. It is only possible to restore the state
of the last snapshot by reconnecting to the RabbitMQ Queue. If a worker node crashes and the
connection to RabbitMQ is lost, then the messages which are not acknowledged by the worker
node will be sent to other consumers.


was (Author: hilmiyildirim):
There is a problem with the method restoreState. It is not possible to restore the state.
If a worker node crashes and the connection to RabbitMQ is lost, then the messages which are
not acknowledged by the worker node will be sent to other consumers. Therefore, it is not
possible to restore arbitrary states. The only way to restore an arbitrary state is to save
all received messages internally. But it is possible to restore the state of the last snapshot
by reconnecting to the RabbitMQ Queue.

> RabbitMQ source / sink should participate in checkpointing
> ----------------------------------------------------------
>
>                 Key: FLINK-2624
>                 URL: https://issues.apache.org/jira/browse/FLINK-2624
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming Connectors
>    Affects Versions: 0.10
>            Reporter: Stephan Ewen
>            Assignee: Hilmi Yildirim
>
> The RabbitMQ connector does not offer any fault tolerance guarantees right now, because
it does not participate in the checkpointing.
> We should integrate it in a similar was as the {{FlinkKafkaConsumer}} is integrated.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message