kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sikaijian (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Deleted] (KAFKA-6348) Kafka consumer can't restore from coordinator failure
Date Thu, 01 Mar 2018 03:15:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

sikaijian updated KAFKA-6348:
-----------------------------
    Comment: was deleted

(was: I got the same problem. In my case, I use kafka for logs. So I killed one  broker.
And it worked. But when I start the broker, I got failure agin.

 
{code:java}
2018-02-27 11:09:07 DEBUG kafka-consumer-ElasticsearchStorage - Issuing group metadata request
to broker 11
2018-02-27 11:09:07 DEBUG kafka-consumer-ElasticsearchStorage - Group metadata response ClientResponse(receivedTimeMs=1519700947797,
disconnected=false, request=ClientRequest(expectResponse=true, callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@4afb1ca2,
request=RequestSend(header={api_key=10,api_version=0,correlation_id=196,client_id=consumer-1},
body={group_id=ElasticsearchStorage-group}), createdTimeMs=1519700947796, sendTimeMs=1519700947796),
responseBody={error_code=0,coordinator={node_id=4,host=kafkabroker5.pajkdc.com,port=9092}})
2018-02-27 11:09:07 DEBUG kafka-consumer-ElasticsearchStorage - (Re-)joining group ElasticsearchStorage-group
2018-02-27 11:09:07 DEBUG kafka-consumer-ElasticsearchStorage - Issuing request (JOIN_GROUP:
{group_id=ElasticsearchStorage-group,session_timeout=30000,member_id=,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0
lim=32 cap=32]}]}) to coordinator 2147483643
2018-02-27 11:09:07 INFO kafka-consumer-ElasticsearchStorage - Marking the coordinator 2147483643
dead.
2018-02-27 11:09:07 INFO kafka-consumer-ElasticsearchStorage - Attempt to join group ElasticsearchStorage-group
failed due to obsolete coordinator information, retrying.
{code}
The coordinator for consumer group "ElasticsearchStorage-group" is broker 4. I just want to
change the coordinator. So I killed it.

As I know, only these brokers who own the partition of __consumer_offset can work as a coordinator
for consumer group.  And a consumer group's offset locate on only one partition  of __consumer_offset.
And in my case  Math.abs("ElasticsearchStorage-group".hashCode()) %  100(partitionCount
of __consumer_offset, in my case is 100) = 4. But I consume 3 topics using the same consumer
group "ElasticsearchStorage-group". Only on topic met the problem. 

I still can't figure out the  root cause. I am using 0.9.0.1, and the new consumer.  )

> Kafka consumer can't restore from coordinator failure
> -----------------------------------------------------
>
>                 Key: KAFKA-6348
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6348
>             Project: Kafka
>          Issue Type: Bug
>          Components: consumer, core
>    Affects Versions: 0.10.1.1
>            Reporter: Renjie Liu
>            Priority: Major
>
> Kafka consumer blocks and keep reporting coordinator is dead. I tried to restart the
process and it still can't work. Then we shutdown the broker and restart consumer, but it
still keep reporting coordinator is dead. This situation continues until we change our group
id and it works.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message