flink-user-zh mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vino yang <yanghua1...@gmail.com>
Subject Re: Rewind offset to a previous position and ensure certainty.
Date Thu, 26 Dec 2019 02:32:17 GMT
Hi Ruibin,

Are you finding how to generate watermark pre Kafka partition?
Flink provides Kafka-partition-aware watermark generation. [1]



邢瑞斌 <xingrobin@gmail.com> 于2019年12月25日周三 下午8:27写道:

> Hi,
> I'm trying to use Kafka as an event store and I want to create several
> partitions to improve read/write throughput. Occasionally I need to rewind
> offset to a previous position for recomputing. Since order isn't guaranteed
> among partitions in Kafka, does this mean that Flink won't produce the same
> results as before when rewind even if it uses event time? For example,
> consumer for a partition progresses extremely fast and raises watermark, so
> events from other partitions are discarded. Is there any ways to prevent
> this from happening?
> Thanks in advance!
> Ruibin

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message