Return-Path: X-Original-To: apmail-kafka-users-archive@www.apache.org Delivered-To: apmail-kafka-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E0A4C10EA4 for ; Wed, 21 Aug 2013 04:23:53 +0000 (UTC) Received: (qmail 83300 invoked by uid 500); 21 Aug 2013 04:23:53 -0000 Delivered-To: apmail-kafka-users-archive@kafka.apache.org Received: (qmail 82858 invoked by uid 500); 21 Aug 2013 04:23:50 -0000 Mailing-List: contact users-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@kafka.apache.org Delivered-To: mailing list users@kafka.apache.org Received: (qmail 82834 invoked by uid 99); 21 Aug 2013 04:23:48 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Aug 2013 04:23:48 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of wangguoz@gmail.com designates 209.85.192.172 as permitted sender) Received: from [209.85.192.172] (HELO mail-pd0-f172.google.com) (209.85.192.172) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Aug 2013 04:23:42 +0000 Received: by mail-pd0-f172.google.com with SMTP id z10so1318414pdj.17 for ; Tue, 20 Aug 2013 21:23:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=4CtFkUkBJPo8qPFARI2GWg1kCLh5CGkMPBVQYPXJocI=; b=tc/vofjckWngxkday9MaCMnf5J1q2jS1Hu38wbiqSr/UZDOb2Pdc1QGztP3Q30DRFq foHfexbKY82ZcAynummXrvJozNIht+W92MJXTRiZSCWY9KRLvX/k774g+39hyCnrWBml pLlSEfPuKsDh0G2tk28Q+LLttyQiN6OmFVHp+S++9U/MMsRIogj+BMlajrqi0htG0JVa kXdYV83B1rkZ0q26lsbeI5PJ6ovDKOOKIuLRLSylyCYPa3U3snofCriVonTNXJafsKHu 9LtvFHVckOoYP7yL305cCyiBxbccVHNnTwPJTsx904at0Mq7pynfAR2usO/hSmBH2iep MYLw== MIME-Version: 1.0 X-Received: by 10.66.216.129 with SMTP id oq1mr7574129pac.75.1377059001082; Tue, 20 Aug 2013 21:23:21 -0700 (PDT) Received: by 10.66.82.133 with HTTP; Tue, 20 Aug 2013 21:23:20 -0700 (PDT) In-Reply-To: References: Date: Tue, 20 Aug 2013 21:23:20 -0700 Message-ID: Subject: Re: issue with kafka-preferred-replica-election.sh From: Guozhang Wang To: users@kafka.apache.org Content-Type: multipart/alternative; boundary=047d7b5d95499828e304e46d882e X-Virus-Checked: Checked by ClamAV on apache.org --047d7b5d95499828e304e46d882e Content-Type: text/plain; charset=ISO-8859-1 Libo, Sorry for the late reply. I will file a JIRA for this one. Could you please provide the full process and environment to reproduce this issue? Guozhang On Tue, Aug 20, 2013 at 1:10 PM, Yu, Libo wrote: > Hi Guozhang, > > Thanks for the detailed reply. All the brokers are running. > The path not created is /brokers/topics/uattoqaaa.default/partitions > not /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state > Actually, I found quite a few topics don't have the issue. The controller > must have failed to create them. I will keep monitoring this issue. > > Currently, when /brokers/topics/my_path/partitions is not there, > kafka-preferred-replica-election.sh stops right away with nonode > keeper exception. Could you file a JIRA to make it keep working in > that scenario? > > > > Regards, > > Libo > > > -----Original Message----- > From: Guozhang Wang [mailto:wangguoz@gmail.com] > Sent: Tuesday, August 20, 2013 3:56 PM > To: users@kafka.apache.org > Subject: Re: issue with kafka-preferred-replica-election.sh > > The create command tool will only create the path > /brokers/topics/uattoqaaa.default, and then controller, once noticing the > change in ZK about the added topic, will elect leaders from the assigned > replicas written in /brokers/topics/uattoqaaa.default and then create > /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state. > > If you have created the topic for a long time but > /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state is not > created by controller, it could because the replicas specified in > /brokers/topics/uattoqaaa.default does not exist yet. Could you verify the > brokers specified in this path are up and running? > > Guozhang > > > On Tue, Aug 20, 2013 at 12:14 PM, Yu, Libo wrote: > > > One more question: > > "The create topic command will not immediately create the path; it > > will be created by the controller later during the creation of > > partitions and assign replicas to partitions." > > > > So when will the controller create the path and partitions? When the > > first message is published to the topic and partition? > > All the partitions are created at once? > > > > Regards, > > > > Libo > > > > > > -----Original Message----- > > From: Guozhang Wang [mailto:wangguoz@gmail.com] > > Sent: Tuesday, August 20, 2013 1:48 PM > > To: users@kafka.apache.org > > Subject: Re: issue with kafka-preferred-replica-election.sh > > > > Could you check that before you run > > kafka-preferred-replica-election.sh > > the /brokers/topics/uattoqaaa.default/partitions Node has been created > > or not? > > The create topic command will not immediately create the path; it will > > be created by the controller later during the creation of partitions > > and assign replicas to partitions. If you start the election command > > right after the create topic tool, it might not be created yet. > > > > Guozhang > > > > > > On Tue, Aug 20, 2013 at 10:24 AM, Yu, Libo wrote: > > > > > It is created with 3 partitions. > > > > > > Regards, > > > > > > Libo > > > > > > > > > -----Original Message----- > > > From: Guozhang Wang [mailto:wangguoz@gmail.com] > > > Sent: Tuesday, August 20, 2013 12:21 PM > > > To: users@kafka.apache.org > > > Subject: Re: issue with kafka-preferred-replica-election.sh > > > > > > Hello Libo, > > > > > > Before you call the kafka-preferred-replica-election.sh have you > > > already created the topic uattoqaaa.default with the number of > > partitions? > > > > > > Guozhang > > > > > > > > > On Tue, Aug 20, 2013 at 8:35 AM, Yu, Libo wrote: > > > > > > > Hi, > > > > > > > > I tried to run kafka-preferred-replica-election.sh on our kafka > > cluster. > > > > But I got this expection: > > > > Failed to start preferred replica election > > > > org.I0Itec.zkclient.exception.ZkNoNodeException: > > > > org.apache.zookeeper.KeeperException$NoNodeException: > > > > KeeperErrorCode = NoNode for > > > > /brokers/topics/uattoqaaa.default/partitions > > > > > > > > I checked zookeeper and there is no > > > > /brokers/topics/uattoqaaa.default/partitions. All I found is > > > > /brokers/topics/uattoqaaa.default. > > > > > > > > I believe this is a bug and I am not sure if there is a JIRA for it. > > > > Could you confirm? Thanks. > > > > > > > > Regards, > > > > > > > > Libo > > > > > > > > > > > > > > > > > -- > > > -- Guozhang > > > > > > > > > > > -- > > -- Guozhang > > > > > > -- > -- Guozhang > -- -- Guozhang --047d7b5d95499828e304e46d882e--