Mailing-List: contact users-help@kafka.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@kafka.apache.org
Received-SPF: pass (nike.apache.org: domain of libo.yu@citi.com designates
 67.231.145.106 as permitted sender)
From: "Yu, Libo " <libo.yu@citi.com>
To: "'users@kafka.apache.org'" <users@kafka.apache.org>
Subject: RE: issue with kafka-preferred-replica-election.sh
Thread-Topic: issue with kafka-preferred-replica-election.sh
Thread-Index: AQHOnd9b6Nn3QKNrTkqheUkOTDRMVZmehPUw
Date: Tue, 20 Aug 2013 20:10:21 +0000
Message-ID: <FF142F6B499AE34CAED4D263F6CA32901D34DF98@EXTXMB19.nam.nsroot.net>
References: <FF142F6B499AE34CAED4D263F6CA32901D34BEF3@EXTXMB19.nam.nsroot.net>
	<CAHwHRrWmcAU4DtQKmPDbXtuFh2_TuOtE6dpXJnagOsDV9LpQ-A@mail.gmail.com>
	<FF142F6B499AE34CAED4D263F6CA32901D34DDE4@EXTXMB19.nam.nsroot.net>
	<CAHwHRrXKyZ-obyi5OHme7q9x5h7-1yeEYae3to-EzmijSmOutw@mail.gmail.com>
	<FF142F6B499AE34CAED4D263F6CA32901D34DF50@EXTXMB19.nam.nsroot.net>
 <CAHwHRrXdEKy3XqQL2nWi9Q2jvB+bT988zQ6SS0orjAQFGN_RGQ@mail.gmail.com>
In-Reply-To: 
 <CAHwHRrXdEKy3XqQL2nWi9Q2jvB+bT988zQ6SS0orjAQFGN_RGQ@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Hi Guozhang,

Thanks for the detailed reply. All the brokers are running.
The path not created is /brokers/topics/uattoqaaa.default/partitions
not /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state
Actually, I found quite a few topics don't have the issue. The controller=20
must have failed to create them. I will keep monitoring this issue.

Currently, when /brokers/topics/my_path/partitions is not there,
kafka-preferred-replica-election.sh stops right away with nonode
keeper exception. Could you file a JIRA to make it keep working in
that scenario?=20


Regards,

Libo


-----Original Message-----
From: Guozhang Wang [mailto:wangguoz@gmail.com]=20
Sent: Tuesday, August 20, 2013 3:56 PM
To: users@kafka.apache.org
Subject: Re: issue with kafka-preferred-replica-election.sh

The create command tool will only create the path /brokers/topics/uattoqaaa=
.default, and then controller, once noticing the change in ZK about the add=
ed topic, will elect leaders from the assigned replicas written in /brokers=
/topics/uattoqaaa.default and then create /brokers/topics/uattoqaaa.default=
/partitions/[partition-id]/state.

If you have created the topic for a long time but /brokers/topics/uattoqaaa=
.default/partitions/[partition-id]/state is not created by controller, it c=
ould because the replicas specified in /brokers/topics/uattoqaaa.default do=
es not exist yet. Could you verify the brokers specified in this path are u=
p and running?

Guozhang


On Tue, Aug 20, 2013 at 12:14 PM, Yu, Libo <libo.yu@citi.com> wrote:

> One more question:
> "The create topic command will not immediately create the path; it=20
> will be created by the controller later during the creation of=20
> partitions and assign replicas to partitions."
>
> So when will the controller create the path and partitions? When the=20
> first message is published to the topic and partition?
> All the partitions are created at once?
>
> Regards,
>
> Libo
>
>
> -----Original Message-----
> From: Guozhang Wang [mailto:wangguoz@gmail.com]
> Sent: Tuesday, August 20, 2013 1:48 PM
> To: users@kafka.apache.org
> Subject: Re: issue with kafka-preferred-replica-election.sh
>
> Could you check that before you run=20
> kafka-preferred-replica-election.sh
> the /brokers/topics/uattoqaaa.default/partitions Node has been created=20
> or not?
> The create topic command will not immediately create the path; it will=20
> be created by the controller later during the creation of partitions=20
> and assign replicas to partitions. If you start the election command=20
> right after the create topic tool, it might not be created yet.
>
> Guozhang
>
>
> On Tue, Aug 20, 2013 at 10:24 AM, Yu, Libo <libo.yu@citi.com> wrote:
>
> > It is created with 3 partitions.
> >
> > Regards,
> >
> > Libo
> >
> >
> > -----Original Message-----
> > From: Guozhang Wang [mailto:wangguoz@gmail.com]
> > Sent: Tuesday, August 20, 2013 12:21 PM
> > To: users@kafka.apache.org
> > Subject: Re: issue with kafka-preferred-replica-election.sh
> >
> > Hello Libo,
> >
> > Before you call the kafka-preferred-replica-election.sh have you=20
> > already created the topic uattoqaaa.default with the number of
> partitions?
> >
> > Guozhang
> >
> >
> > On Tue, Aug 20, 2013 at 8:35 AM, Yu, Libo <libo.yu@citi.com> wrote:
> >
> > > Hi,
> > >
> > > I tried to run kafka-preferred-replica-election.sh on our kafka
> cluster.
> > > But I got this expection:
> > > Failed to start preferred replica election
> > > org.I0Itec.zkclient.exception.ZkNoNodeException:
> > > org.apache.zookeeper.KeeperException$NoNodeException:
> > > KeeperErrorCode =3D NoNode for
> > > /brokers/topics/uattoqaaa.default/partitions
> > >
> > > I checked zookeeper and there is no=20
> > > /brokers/topics/uattoqaaa.default/partitions. All I found is=20
> > > /brokers/topics/uattoqaaa.default.
> > >
> > > I believe this is a bug and I am not sure if there is a JIRA for it.
> > > Could you confirm? Thanks.
> > >
> > > Regards,
> > >
> > > Libo
> > >
> > >
> >
> >
> > --
> > -- Guozhang
> >
>
>
>
> --
> -- Guozhang
>


--
-- Guozhang