pulsar-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [pulsar] EugenDueck commented on issue #6209: [broker] add feature BrokerDeduplicationAcrossProducers
Date Fri, 14 Feb 2020 04:03:43 GMT
EugenDueck commented on issue #6209: [broker] add feature BrokerDeduplicationAcrossProducers
URL: https://github.com/apache/pulsar/pull/6209#issuecomment-586087567
   There is a use case where there are two producers that cannot deterministically produce
the same sequence ids, although the messages are the same. So only one should be allowed to
produce, and when it fails, failover to the other will occur. But after the failover, we don't
want to continue deduplicating using the last sequence id of the previous producer.
   Of course during failover we may have a message gap or duplicates, but there's nothing
we can do about it. But as long as a producer is alive, there will be no duplicates, even
in the face of broker / bookie failures. (I'm assuming here that one of the reasons for Pulsar
offering deduplication is that in case of such failures duplicates may occur)

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

With regards,
Apache Git Services

View raw message