kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ante B. (Jira)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-8858) Kafka Streams - Failed to Rebalance Error and stream consumer stuck for some reason
Date Mon, 02 Sep 2019 13:26:00 GMT
Ante B. created KAFKA-8858:
------------------------------

             Summary: Kafka Streams - Failed to Rebalance Error and stream consumer stuck
for some reason
                 Key: KAFKA-8858
                 URL: https://issues.apache.org/jira/browse/KAFKA-8858
             Project: Kafka
          Issue Type: Bug
         Environment: Apache Kakfa 2.1.1
            Reporter: Ante B.


I have a basic Kafka Streams application that reads from a {{topic}}, performs a rolling
aggregate, and performs a join to publish to an {{agg_topic}}. Our project has the timeout
failure after we upgrade to Kafka 2.1.1, and we don't know the reason yet.

Our stream consumer stuck for some reason. 

After we changed our group id to another one it became normal. So seems offset data for this
consumer is corrupted.

Can you help us please to resolve this problem to be able to revert us to the previous consumer
name because we have many inconveniences due to this.

Ping me pls if you will need some additional info.

Our temporary workaround is to disable the {{exactly_once}} config which skips the initializing
transactional state. Also offset reseted for corrupted partition, with no effect.

Full problem description in log:
{code:java}
[2019-08-30 14:20:02.168] [abc-streamer-StreamThread-21] ERROR org.apache.kafka.streams.processor.internals.StreamThread:273
- stream-thread [fds-streamer-StreamThread-21] Error caught during partition assignment, will
abort the current process and re-throw at the end of rebalance: {} 
 org.apache.kafka.common.errors.TimeoutException: Timeout expired while initializing transactional
state in 60000ms.
[2019-08-30 14:21:35.407] [abc-streamer-StreamThread-14] ERROR org.apache.kafka.streams.processor.internals.StreamThread:273
- stream-thread [fds-streamer-StreamThread-14] Error caught during partition assignment, will
abort the current process and re-throw at the end of rebalance: {} 
 org.apache.kafka.common.errors.TimeoutException: Timeout expired while initializing transactional
state in 60000ms.
[2019-08-30 14:22:58.487] [abc-streamer-StreamThread-13] ERROR org.apache.kafka.streams.processor.internals.StreamThread:273
- stream-thread [fds-streamer-StreamThread-13] Error caught during partition assignment, will
abort the current process and re-throw at the end of rebalance: {} 
 org.apache.kafka.common.errors.TimeoutException: Timeout expired while initializing transactional
state in 60000ms.
{noformat}
 

 

 



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Mime
View raw message