flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lopez, Javier" <javier.lo...@zalando.de>
Subject Problem with Kafka 0.9 Client
Date Wed, 17 Feb 2016 10:10:47 GMT
Hi guys,

We are using Flink 1.0-SNAPSHOT with Kafka 0.9 Consumer and we have not
been able to retrieve data from our Kafka Cluster. The DEBUG data reports
the following:

10:53:24,365 DEBUG org.apache.kafka.clients.NetworkClient
     - Sending metadata request ClientRequest(expectResponse=true,
callback=null,
request=RequestSend(header={api_key=3,api_version=0,correlation_id=1673,client_id=flink_test},
body={topics=[stream_test_3]}), isInitiatedByNetworkClient,
createdTimeMs=1455702804364, sendTimeMs=0) to node 35
10:53:24,398 DEBUG org.apache.kafka.clients.Metadata
      - Updated cluster metadata version 838 to Cluster(nodes = [Node(41,
ip-XXXX.eu-west-1.compute.internal, 9092), Node(35,
ip-XXXX.eu-west-1.compute.internal, 9092), Node(87,
ip-XXXX.eu-west-1.compute.internal, 9092)], partitions = [Partition(topic =
stream_test_3, partition = 0, leader = 87, replicas = [87,41,35,], isr =
[87,41,35,], Partition(topic = stream_test_3, partition = 1, leader = 35,
replicas = [35,41,87,], isr = [35,41,87,], Partition(topic = stream_test_3,
partition = 4, leader = 87, replicas = [87,41,35,], isr = [87,41,35,],
Partition(topic = stream_test_3, partition = 3, leader = 35, replicas =
[35,87,41,], isr = [35,87,41,], Partition(topic = stream_test_3, partition
= 2, leader = 41, replicas = [41,87,35,], isr = [41,87,35,]])
10:53:24,398 DEBUG
org.apache.kafka.clients.consumer.internals.AbstractCoordinator  - Issuing
group metadata request to broker 35
10:53:24,432 DEBUG
org.apache.kafka.clients.consumer.internals.AbstractCoordinator  - Group
metadata response ClientResponse(receivedTimeMs=1455702804432,
disconnected=false, request=ClientRequest(expectResponse=true,
callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@63b68d94,
request=RequestSend(header={api_key=10,api_version=0,correlation_id=1674,client_id=flink_test},
body={group_id=test}), createdTimeMs=1455702804398,
sendTimeMs=1455702804398),
responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}})


We receive this message all the time. What we don't know understand is this
"responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}}", as
we see an error_code we suppose there was a problem. Our Kafka cluster
works and we have some clients extracting data from it, so we don't know if
this could be a Kafka issue or a Flink issue.

Does anyone know, or understand, this response we are getting from Kafka?

Thanks.

Mime
View raw message