kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ismael Juma (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-5376) Transactions: Concurrent transactional consumer reads aborted messages
Date Tue, 06 Jun 2017 02:39:18 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-5376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ismael Juma updated KAFKA-5376:
-------------------------------
       Resolution: Fixed
    Fix Version/s: 0.11.0.0
           Status: Resolved  (was: Patch Available)

Issue resolved by pull request 3239
[https://github.com/apache/kafka/pull/3239]

> Transactions: Concurrent transactional consumer reads aborted messages
> ----------------------------------------------------------------------
>
>                 Key: KAFKA-5376
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5376
>             Project: Kafka
>          Issue Type: Sub-task
>            Reporter: Apurva Mehta
>            Assignee: Jason Gustafson
>            Priority: Blocker
>              Labels: exactly-once
>             Fix For: 0.11.0.0
>
>         Attachments: KAFKA-5376.tar.gz
>
>
> This may be a dup of KAFKA-5355, but the system tests in KAFKA-5366 shows that a concurrent
transactional consumer reads aborted messages. For the test in question the clients are bounced
6 times. With a transaction size of 500, we expect 3000 aborted messages. The concurrent consumer
regularly over counts by 1000 to 1500 messages, suggesting that some aborted transactions
are consumed. 
> {noformat}
> --------------------------------------------------------------------------------
> test_id:    kafkatest.tests.core.transactions_test.TransactionsTest.test_transactions.failure_mode=clean_bounce.bounce_target=clients
> status:     FAIL
> run time:   1 minute 56.102 seconds
>     Detected 1000 dups in concurrently consumed messages
> Traceback (most recent call last):
>   File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
123, in run
>     data = self.run_test()
>   File "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
176, in run_test
>     return self.test_context.function(self.test)
>   File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line 321, in
wrapper
>     return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
>   File "/opt/kafka-dev/tests/kafkatest/tests/core/transactions_test.py", line 235, in
test_transactions
>     assert num_dups_in_concurrent_consumer == 0, "Detected %d dups in concurrently consumed
messages" % num_dups_in_concurrent_consumer
> AssertionError: Detected 1000 dups in concurrently consumed messages
> {noformat}
> This behavior continues even after https://github.com/apache/kafka/pull/3221 was merged.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message