Mailing-List: contact users-help@kafka.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@kafka.apache.org
Received-SPF: pass (athena.apache.org: domain of libo.yu@citi.com designates
 67.231.145.106 as permitted sender)
From: "Yu, Libo " <libo.yu@citi.com>
To: "'users@kafka.apache.org'" <users@kafka.apache.org>
Subject: RE: broker never comes back to ISR
Thread-Topic: broker never comes back to ISR
Thread-Index: Ac6efPj+L4iBpjskQGSQh2N2EN2IAwAAcz0Q
Date: Wed, 21 Aug 2013 14:59:05 +0000
Message-ID: <FF142F6B499AE34CAED4D263F6CA32901D34E2A3@EXTXMB19.nam.nsroot.net>
References: <FF142F6B499AE34CAED4D263F6CA32901D34E284@EXTXMB19.nam.nsroot.net>
In-Reply-To: 
 <FF142F6B499AE34CAED4D263F6CA32901D34E284@EXTXMB19.nam.nsroot.net>
Accept-Language: en-US
Content-Language: en-US
Content-Type: multipart/alternative;
	boundary="_000_FF142F6B499AE34CAED4D263F6CA32901D34E2A3EXTXMB19namnsro_"
MIME-Version: 1.0

--_000_FF142F6B499AE34CAED4D263F6CA32901D34E2A3EXTXMB19namnsro_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

I checked the log of normal restart. The replication manager should start t=
o handle
leader and isr request after the server is up. What may stop it from doing =
that?
Is it because of missing mx4j-tools.jar?

Regards,

Libo

From: Yu, Libo [ICG-IT]
Sent: Wednesday, August 21, 2013 10:51 AM
To: 'users@kafka.apache.org'
Subject: broker never comes back to ISR

Hi team,

We have three kafka brokers in a production cluster. We use replication fac=
tor 3 for all topics.
We notice quite frequently one broker is not in isr. Sometimes after it is =
restarted, it
will go back to isr. Sometimes even after it is restarted, it will not go b=
ack to isr.

In today's case, after a broker is restarted, this is what we found from th=
e log:

[2013-08-21 08:22:55,524] INFO [Kafka Server 2], started (kafka.server.Kafk=
aServer)
[2013-08-21 08:25:06,621] INFO Closing socket connection to /xxx.xx.xx.xx. =
(kafka.network.Processor)
[2013-08-21 08:25:06,716] INFO Closing socket connection to / xxx.xx.xx.xx.=
 (kafka.network.Processor)
[2013-08-21 08:27:19,824] INFO Closing socket connection to / xxx.xx.xx.xx.=
 (kafka.network.Processor)
[2013-08-21 08:28:16,711] INFO Closing socket connection to / xxx.xx.xx.xx.=
 (kafka.network.Processor)
[2013-08-21 08:28:17,978] INFO Closing socket connection to / xxx.xx.xx.xx.=
 (kafka.network.Processor)
...
Numerous "Closing socket connection" and nothing else.

Any guidance will be appreciated.

Regards,

Libo


--_000_FF142F6B499AE34CAED4D263F6CA32901D34E2A3EXTXMB19namnsro_--