From dev-return-96681-archive-asf-public=cust-asf.ponee.io@kafka.apache.org Thu Aug 2 14:07:05 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id B335F180674 for ; Thu, 2 Aug 2018 14:07:04 +0200 (CEST) Received: (qmail 7568 invoked by uid 500); 2 Aug 2018 12:07:03 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 7538 invoked by uid 99); 2 Aug 2018 12:07:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Aug 2018 12:07:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id D60C61A368A for ; Thu, 2 Aug 2018 12:07:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -110.301 X-Spam-Level: X-Spam-Status: No, score=-110.301 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id GHiSBayss2vt for ; Thu, 2 Aug 2018 12:07:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id D695C5F1BD for ; Thu, 2 Aug 2018 12:07:00 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 58542E01C2 for ; Thu, 2 Aug 2018 12:07:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 1809227760 for ; Thu, 2 Aug 2018 12:07:00 +0000 (UTC) Date: Thu, 2 Aug 2018 12:07:00 +0000 (UTC) From: "little brother ma (JIRA)" To: dev@kafka.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (KAFKA-7238) Producer can't update Metadata when two brokers break down and restart the first one MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 little brother ma created KAFKA-7238: ---------------------------------------- Summary: Producer can't update Metadata when two brokers bre= ak down and restart the first one =20 Key: KAFKA-7238 URL: https://issues.apache.org/jira/browse/KAFKA-7238 Project: Kafka Issue Type: Bug Components: clients Affects Versions: 0.11.0.3, 0.11.0.1 Environment: os: 14.04.1-Ubuntu java: 1.8.0_151-b12 Reporter: little brother ma There is a kafka cluster with two brokers( broker ids are=C2=A070 and 67),I= create a topic named topic2 with 2 partitions and 1=C2=A0replica, and part= ition 0=C2=A0 is on the broker 70,and=C2=A0partition 1=C2=A0 is on the brok= er 67. =C2=A0While sending datas=EF=BC=8C I stop broker 70=C2=A0first, and wait 5 = ms=EF=BC=8C=C2=A0stop broker=C2=A067 . And then ,I restart=C2=A0 broker 70,= =C2=A0 the=C2=A0 producer client can't=C2=A0update metadata=C2=A0 and don't= =C2=A0 switch to connet broker 70=EF=BC=8Cotherwise=EF=BC=8C it always try = to connect broker 67. The log before stop the broker: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dsend The message size: 12, key: null, partition:0, offset:29 [2018-08-02 19:59:10,180] DEBUG Sending metadata request (type=3DMetadataRe= quest, topics=3Dtopic2) to node 10.93.132.67:9092 (id: 67 rack: null) (org.= apache.kafka.clients.NetworkClient) [2018-08-02 19:59:10,184] DEBUG Updated cluster metadata version 11 to Clus= ter(id =3D 3fL1MXQtRo6Ujmxa9dS3eA, nodes =3D [10.93.132.70:9092 (id: 70 rac= k: null), 10.93.132.67:9092 (id: 67 rack: null)], partitions =3D [Partition= (topic =3D topic2, partition =3D 1, leader =3D 70, replicas =3D [70], isr = =3D [70]), Partition(topic =3D topic2, partition =3D 0, leader =3D 67, repl= icas =3D [67], isr =3D [67])]) (org.apache.kafka.clients.Metadata) =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dsend The message size: 12, key: null, partition:1, offset:69 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dsend The message size: 12, key: null, partition:0, offset:30 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dsend The message size: 12, key: null, partition:1, offset:70 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dsend The message size: 12, key: null, partition:0, offset:31 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dsend The message size: 12, key: null, partition:1, offset:71 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dsend The message size: 12, key: null, partition:0, offset:32 =C2=A0 =C2=A0 The log after stop the broker 70=C2=A0 : [2018-08-02 20:02:50,049] DEBUG Node 70 disconnected. (org.apache.kafka.cli= ents.NetworkClient) [2018-08-02 20:02:50,049] WARN Connection to node 70 could not be establish= ed. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:02:50,049] DEBUG Give up sending metadata request since no n= ode is available (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:02:50,100] DEBUG Give up sending metadata request since no n= ode is available (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:02:50,151] DEBUG Initialize connection to node 10.93.132.70:= 9092 (id: 70 rack: null) for sending metadata request (org.apache.kafka.cli= ents.NetworkClient) [2018-08-02 20:02:50,151] DEBUG Initiating connection to node 10.93.132.70:= 9092 (id: 70 rack: null) (org.apache.kafka.clients.NetworkClient) =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dsend The message size: 12, key: null, partition:0, offset:95 [2018-08-02 20:02:51,156] DEBUG Connection with /10.93.132.70 disconnected = (org.apache.kafka.common.network.Selector) java.net.ConnectException: Connection refused: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.kafka.common.network.PlaintextTransportLayer.finishConnect(P= laintextTransportLayer.java:50) at org.apache.kafka.common.network.KafkaChannel.finishConnect(KafkaChannel= .java:95) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.jav= a:361) at org.apache.kafka.common.network.Selector.poll(Selector.java:326) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:433) at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run= (KafkaAdminClient.java:954) at java.lang.Thread.run(Thread.java:745) [2018-08-02 20:02:51,157] DEBUG Node 70 disconnected. (org.apache.kafka.cli= ents.NetworkClient) [2018-08-02 20:02:51,157] WARN Connection to node 70 could not be establish= ed. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:02:51,157] DEBUG Give up sending metadata request since no n= ode is available (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:02:51,208] DEBUG Initialize connection to node 10.93.132.70:= 9092 (id: 70 rack: null) for sending metadata request (org.apache.kafka.cli= ents.NetworkClient) [2018-08-02 20:02:51,208] DEBUG Initiating connection to node 10.93.132.70:= 9092 (id: 70 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:02:52,216] DEBUG Connection with /10.93.132.70 disconnected = (org.apache.kafka.common.network.Selector) java.net.ConnectException: Connection refused: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.kafka.common.network.PlaintextTransportLayer.finishConnect(P= laintextTransportLayer.java:50) at org.apache.kafka.common.network.KafkaChannel.finishConnect(KafkaChannel= .java:95) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.jav= a:361) at org.apache.kafka.common.network.Selector.poll(Selector.java:326) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:433) at org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run= (KafkaAdminClient.java:954) at java.lang.Thread.run(Thread.java:745) [2018-08-02 20:02:52,216] DEBUG Node 70 disconnected. (org.apache.kafka.cli= ents.NetworkClient) [2018-08-02 20:02:52,216] WARN Connection to node 70 could not be establish= ed. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:02:52,216] DEBUG Give up sending metadata request since no n= ode is available (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:02:52,267] DEBUG Give up sending metadata request since no n= ode is available (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:02:52,318] DEBUG Initialize connection to node 10.93.132.70:= 9092 (id: 70 rack: null) for sending metadata request (org.apache.kafka.cli= ents.NetworkClient) [2018-08-02 20:02:52,318] DEBUG Initiating connection to node 10.93.132.70:= 9092 (id: 70 rack: null) (org.apache.kafka.clients.NetworkClient) =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3Dsend The message size: 12, key: null, partition:0, offset:96 =C2=A0 The broker 67 is working! =C2=A0 The log=C2=A0after=C2=A0stop the broker 70 ,broker 67 ,and restart broker 7= 0 : [2018-08-02 20:05:15,136] DEBUG Node 67 disconnected. (org.apache.kafka.cli= ents.NetworkClient) [2018-08-02 20:05:15,136] WARN Connection to node 67 could not be establish= ed. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:05:15,137] DEBUG Give up sending metadata request since no n= ode is available (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:05:15,177] DEBUG Initiating connection to node 10.93.132.67:= 9092 (id: 67 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:05:16,183] DEBUG Connection with /10.93.132.67 disconnected = (org.apache.kafka.common.network.Selector) java.net.ConnectException: Connection refused: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.kafka.common.network.PlaintextTransportLayer.finishConnect(P= laintextTransportLayer.java:50) at org.apache.kafka.common.network.KafkaChannel.finishConnect(KafkaChannel= .java:95) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.jav= a:361) at org.apache.kafka.common.network.Selector.poll(Selector.java:326) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:433) at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:224) at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:162) at java.lang.Thread.run(Thread.java:745) [2018-08-02 20:05:16,183] DEBUG Node 67 disconnected. (org.apache.kafka.cli= ents.NetworkClient) [2018-08-02 20:05:16,183] WARN Connection to node 67 could not be establish= ed. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:05:16,183] DEBUG Give up sending metadata request since no n= ode is available (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:05:16,233] DEBUG Give up sending metadata request since no n= ode is available (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:05:16,242] DEBUG Initiating connection to node 10.93.132.67:= 9092 (id: 67 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-08-02 20:05:17,247] DEBUG Connection with /10.93.132.67 disconnected = (org.apache.kafka.common.network.Selector) java.net.ConnectException: Connection refused: no further information at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.kafka.common.network.PlaintextTransportLayer.finishConnect(P= laintextTransportLayer.java:50) at org.apache.kafka.common.network.KafkaChannel.finishConnect(KafkaChannel= .java:95) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.jav= a:361) at org.apache.kafka.common.network.Selector.poll(Selector.java:326) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:433) at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:224) at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:162) at java.lang.Thread.run(Thread.java:745) =C2=A0 =C2=A0 =C2=A0 =C2=A0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)