kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wang Shuxiao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-6522) Retrying leaderEpoch request for partition xxx as the leader reported an error: UNKNOWN_SERVER_ERROR
Date Fri, 02 Feb 2018 01:23:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-6522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wang Shuxiao updated KAFKA-6522:
--------------------------------
    Description: 
we have 3 brokers in a kafka cluster(brokerid:401,402,403). The broker-403 fails to fetch
data from leader:
{code:java}
[2018-02-02 08:58:26,861] INFO [ReplicaFetcher replicaId=403, leaderId=401, fetcherId=0] Retrying
leaderEpoch request for partition sub_payone1hour-0 as the leader reported an error: UNKNOWN_SERVER_ERROR
(kafka.server.ReplicaFetcherThread)
[2018-02-02 08:58:26,865] WARN [ReplicaFetcher replicaId=403, leaderId=401, fetcherId=3] Error
when sending leader epoch request for Map(sub_myshardSinfo-3 -> -1, sub_myshardUinfo-1
-> -1, sub_videoOnlineResourceType8Test-0 -> -1, pub_videoReportEevent-1 -> 9, sub_StreamNofity-3
-> -1, pub_RsVideoInfo-1 -> -1, pub_lidaTopic3-15 -> -1, pub_lidaTopic3-3 -> -1,
sub_zwbtest-1 -> -1, sub_svAdminTagging-5 -> -1, pub_channelinfoupdate-1 -> -1, pub_RsPlayInfo-4
-> -1, sub_tinyVideoWatch-4 -> 14, __consumer_offsets-36 -> -1, pub_ybusAuditorChannel3-2
-> -1, pub_vipPush-4 -> -1, sub_LivingNotifyOnline-3 -> -1, sub_baseonline-4 ->
-1, __consumer_offsets-24 -> -1, sub_lidaTopic-3 -> -1, sub_mobileGuessGameReward-0
-> -1, pub_lidaTopic-6 -> -1, sub_NewUserAlgo-0 -> -1, __consumer_offsets-48 ->
-1, pub_RsUserBehavior-3 -> -1, sub_channelinfoupdate-0 -> -1, pub_tinyVideoComment-1
-> -1, pub_bulletin-2 -> -1, pub_RecordCompleteNotifition-6 -> -1, sub_lidaTopic2-3
-> -1, smsgateway-10 -> -1, __consumer_offsets-0 -> -1, pub_baseonlinetest-1 ->
-1, __consumer_offsets-12 -> -1, pub_myshardUinfo-0 -> -1, pub_baseonline-3 -> -1,
smsGatewayMarketDbInfo-6 -> -1, sub_tinyVideoComment-0 -> 14) (kafka.server.ReplicaFetcherThread)
java.io.IOException: Connection to 401 was disconnected before the response was read
 at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:95)
 at kafka.server.ReplicaFetcherBlockingSend.sendRequest(ReplicaFetcherBlockingSend.scala:96)
 at kafka.server.ReplicaFetcherThread.fetchEpochsFromLeader(ReplicaFetcherThread.scala:312)
 at kafka.server.AbstractFetcherThread.maybeTruncate(AbstractFetcherThread.scala:130)
 at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:102)
 at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64){code}
 

on the leader(broker-401) side, the log shows:
{code:java}
[2018-02-02 08:58:26,859] ERROR Closing socket for 192.168.100.101:9099-192.168.100.103:30476
because of error (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey:
23 and apiVersion: 0
Caused by: java.lang.IllegalArgumentException: Unexpected ApiKeys id `23`, it should be between
`0` and `20` (inclusive)
 at org.apache.kafka.common.protocol.ApiKeys.forId(ApiKeys.java:73)
 at org.apache.kafka.common.requests.AbstractRequest.getRequest(AbstractRequest.java:39)
 at kafka.network.RequestChannel$Request.liftedTree2$1(RequestChannel.scala:96)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:91)
 at kafka.network.Processor$$anonfun$processCompletedReceives$1.apply(SocketServer.scala:492)
 at kafka.network.Processor$$anonfun$processCompletedReceives$1.apply(SocketServer.scala:487)
 at scala.collection.Iterator$class.foreach(Iterator.scala:893)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
 at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:487)
 at kafka.network.Processor.run(SocketServer.scala:417)
 at java.lang.Thread.run(Thread.java:745){code}

  was:
we have 3 brokers in a kafka cluster(brokerid:401,402,403). The broker-403 fails to fetch
data from leader:
{code:java}
[2018-02-02 08:58:26,861] INFO [ReplicaFetcher replicaId=403, leaderId=401, fetcherId=0] Retrying
leaderEpoch request for partition sub_payone1hour-0 as the leader reported an error: UNKNOWN_SERVER_ERROR
(kafka.server.ReplicaFetcherThread)
[2018-02-02 08:58:26,865] WARN [ReplicaFetcher replicaId=403, leaderId=401, fetcherId=3] Error
when sending leader epoch request for Map(sub_myshardSinfo-3 -> -1, sub_myshardUinfo-1
-> -1, sub_videoOnlineResourceType8Test-0 -> -1, pub_videoReportEevent-1 -> 9, sub_StreamNofity-3
-> -1, pub_RsVideoInfo-1 -> -1, pub_lidaTopic3-15 -> -1, pub_lidaTopic3-3 -> -1,
sub_zwbtest-1 -> -1, sub_svAdminTagging-5 -> -1, pub_channelinfoupdate-1 -> -1, pub_RsPlayInfo-4
-> -1, sub_tinyVideoWatch-4 -> 14, __consumer_offsets-36 -> -1, pub_ybusAuditorChannel3-2
-> -1, pub_vipPush-4 -> -1, sub_LivingNotifyOnline-3 -> -1, sub_baseonline-4 ->
-1, __consumer_offsets-24 -> -1, sub_lidaTopic-3 -> -1, sub_mobileGuessGameReward-0
-> -1, pub_lidaTopic-6 -> -1, sub_NewUserAlgo-0 -> -1, __consumer_offsets-48 ->
-1, pub_RsUserBehavior-3 -> -1, sub_channelinfoupdate-0 -> -1, pub_tinyVideoComment-1
-> -1, pub_bulletin-2 -> -1, pub_RecordCompleteNotifition-6 -> -1, sub_lidaTopic2-3
-> -1, smsgateway-10 -> -1, __consumer_offsets-0 -> -1, pub_baseonlinetest-1 ->
-1, __consumer_offsets-12 -> -1, pub_myshardUinfo-0 -> -1, pub_baseonline-3 -> -1,
smsGatewayMarketDbInfo-6 -> -1, sub_tinyVideoComment-0 -> 14) (kafka.server.ReplicaFetcherThread)
java.io.IOException: Connection to 401 was disconnected before the response was read
 at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:95)
 at kafka.server.ReplicaFetcherBlockingSend.sendRequest(ReplicaFetcherBlockingSend.scala:96)
 at kafka.server.ReplicaFetcherThread.fetchEpochsFromLeader(ReplicaFetcherThread.scala:312)
 at kafka.server.AbstractFetcherThread.maybeTruncate(AbstractFetcherThread.scala:130)
 at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:102)
 at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64){code}
 

on the leader(broker-401) side, the log shows:
{code:java}
[2018-02-02 08:58:26,859] ERROR Closing socket for 116.31.112.9:9099-116.31.121.159:30476
because of error (kafka.network.Processor)
org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey:
23 and apiVersion: 0
Caused by: java.lang.IllegalArgumentException: Unexpected ApiKeys id `23`, it should be between
`0` and `20` (inclusive)
 at org.apache.kafka.common.protocol.ApiKeys.forId(ApiKeys.java:73)
 at org.apache.kafka.common.requests.AbstractRequest.getRequest(AbstractRequest.java:39)
 at kafka.network.RequestChannel$Request.liftedTree2$1(RequestChannel.scala:96)
 at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:91)
 at kafka.network.Processor$$anonfun$processCompletedReceives$1.apply(SocketServer.scala:492)
 at kafka.network.Processor$$anonfun$processCompletedReceives$1.apply(SocketServer.scala:487)
 at scala.collection.Iterator$class.foreach(Iterator.scala:893)
 at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
 at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
 at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
 at kafka.network.Processor.processCompletedReceives(SocketServer.scala:487)
 at kafka.network.Processor.run(SocketServer.scala:417)
 at java.lang.Thread.run(Thread.java:745){code}


> Retrying leaderEpoch request for partition xxx as the leader reported an error: UNKNOWN_SERVER_ERROR
> ----------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-6522
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6522
>             Project: Kafka
>          Issue Type: New Feature
>          Components: core
>    Affects Versions: 1.0.0
>         Environment: Ubuntu 16.04 LTS 64bit-server
>            Reporter: Wang Shuxiao
>            Priority: Major
>
> we have 3 brokers in a kafka cluster(brokerid:401,402,403). The broker-403 fails to fetch
data from leader:
> {code:java}
> [2018-02-02 08:58:26,861] INFO [ReplicaFetcher replicaId=403, leaderId=401, fetcherId=0]
Retrying leaderEpoch request for partition sub_payone1hour-0 as the leader reported an error:
UNKNOWN_SERVER_ERROR (kafka.server.ReplicaFetcherThread)
> [2018-02-02 08:58:26,865] WARN [ReplicaFetcher replicaId=403, leaderId=401, fetcherId=3]
Error when sending leader epoch request for Map(sub_myshardSinfo-3 -> -1, sub_myshardUinfo-1
-> -1, sub_videoOnlineResourceType8Test-0 -> -1, pub_videoReportEevent-1 -> 9, sub_StreamNofity-3
-> -1, pub_RsVideoInfo-1 -> -1, pub_lidaTopic3-15 -> -1, pub_lidaTopic3-3 -> -1,
sub_zwbtest-1 -> -1, sub_svAdminTagging-5 -> -1, pub_channelinfoupdate-1 -> -1, pub_RsPlayInfo-4
-> -1, sub_tinyVideoWatch-4 -> 14, __consumer_offsets-36 -> -1, pub_ybusAuditorChannel3-2
-> -1, pub_vipPush-4 -> -1, sub_LivingNotifyOnline-3 -> -1, sub_baseonline-4 ->
-1, __consumer_offsets-24 -> -1, sub_lidaTopic-3 -> -1, sub_mobileGuessGameReward-0
-> -1, pub_lidaTopic-6 -> -1, sub_NewUserAlgo-0 -> -1, __consumer_offsets-48 ->
-1, pub_RsUserBehavior-3 -> -1, sub_channelinfoupdate-0 -> -1, pub_tinyVideoComment-1
-> -1, pub_bulletin-2 -> -1, pub_RecordCompleteNotifition-6 -> -1, sub_lidaTopic2-3
-> -1, smsgateway-10 -> -1, __consumer_offsets-0 -> -1, pub_baseonlinetest-1 ->
-1, __consumer_offsets-12 -> -1, pub_myshardUinfo-0 -> -1, pub_baseonline-3 -> -1,
smsGatewayMarketDbInfo-6 -> -1, sub_tinyVideoComment-0 -> 14) (kafka.server.ReplicaFetcherThread)
> java.io.IOException: Connection to 401 was disconnected before the response was read
>  at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:95)
>  at kafka.server.ReplicaFetcherBlockingSend.sendRequest(ReplicaFetcherBlockingSend.scala:96)
>  at kafka.server.ReplicaFetcherThread.fetchEpochsFromLeader(ReplicaFetcherThread.scala:312)
>  at kafka.server.AbstractFetcherThread.maybeTruncate(AbstractFetcherThread.scala:130)
>  at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:102)
>  at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64){code}
>  
> on the leader(broker-401) side, the log shows:
> {code:java}
> [2018-02-02 08:58:26,859] ERROR Closing socket for 192.168.100.101:9099-192.168.100.103:30476
because of error (kafka.network.Processor)
> org.apache.kafka.common.errors.InvalidRequestException: Error getting request for apiKey:
23 and apiVersion: 0
> Caused by: java.lang.IllegalArgumentException: Unexpected ApiKeys id `23`, it should
be between `0` and `20` (inclusive)
>  at org.apache.kafka.common.protocol.ApiKeys.forId(ApiKeys.java:73)
>  at org.apache.kafka.common.requests.AbstractRequest.getRequest(AbstractRequest.java:39)
>  at kafka.network.RequestChannel$Request.liftedTree2$1(RequestChannel.scala:96)
>  at kafka.network.RequestChannel$Request.<init>(RequestChannel.scala:91)
>  at kafka.network.Processor$$anonfun$processCompletedReceives$1.apply(SocketServer.scala:492)
>  at kafka.network.Processor$$anonfun$processCompletedReceives$1.apply(SocketServer.scala:487)
>  at scala.collection.Iterator$class.foreach(Iterator.scala:893)
>  at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
>  at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
>  at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
>  at kafka.network.Processor.processCompletedReceives(SocketServer.scala:487)
>  at kafka.network.Processor.run(SocketServer.scala:417)
>  at java.lang.Thread.run(Thread.java:745){code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message