Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 319D8200D42 for ; Fri, 17 Nov 2017 20:47:05 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2FF72160C0A; Fri, 17 Nov 2017 19:47:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 75DFA160BE6 for ; Fri, 17 Nov 2017 20:47:04 +0100 (CET) Received: (qmail 43183 invoked by uid 500); 17 Nov 2017 19:47:03 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 43167 invoked by uid 99); 17 Nov 2017 19:47:03 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Nov 2017 19:47:03 +0000 Received: from auth2-smtp.messagingengine.com (auth2-smtp.messagingengine.com [66.111.4.228]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id D129D1A0140 for ; Fri, 17 Nov 2017 19:47:02 +0000 (UTC) Received: from compute6.internal (compute6.nyi.internal [10.202.2.46]) by mailauth.nyi.internal (Postfix) with ESMTP id D3A0320C1B for ; Fri, 17 Nov 2017 14:47:01 -0500 (EST) Received: from web1 ([10.202.2.211]) by compute6.internal (MEProxy); Fri, 17 Nov 2017 14:47:01 -0500 X-ME-Sender: Received: by mailuser.nyi.internal (Postfix, from userid 99) id C1A2A957AB; Fri, 17 Nov 2017 14:47:01 -0500 (EST) Message-Id: <1510948021.3540216.1176251448.19AD8952@webmail.messagingengine.com> From: Abraham Fine To: user@zookeeper.apache.org MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="utf-8" X-Mailer: MessagingEngine.com Webmail Interface - ajax-4ef04c51 References: Subject: Re: kafka.admin.TopicCommand Failing In-Reply-To: Date: Fri, 17 Nov 2017 11:47:01 -0800 archived-at: Fri, 17 Nov 2017 19:47:05 -0000 I'm not sure if you have done this already, but you may want to consider reaching out to the Kafka mailing lists for help there as well. Thanks, Abe On Thu, Nov 16, 2017, at 21:51, Abhimanyu Nagrath wrote: > One more thing was checking my Kafka-server.log its fill with the warning > > Attempting to send response via channel for which there is no open > connection, connection id 2 (Kafka.network.Processor) > > IS this the reason for the above issue? How to resolve this. Need help > production is breaking. > > > Regards, > Abhimanyu > > On Thu, Nov 16, 2017 at 5:08 PM, Abhimanyu Nagrath < > abhimanyunagrath@gmail.com> wrote: > > > Hi, I am using a single node Kafka V 0.10.2 (16 GB RAM, 8 cores) and a > > single node zookeeper V 3.4.9 (4 GB RAM, 1 core ). I am having 64 consumer > > groups and 500 topics each having 250 partitions. I am able to execute the > > commands which require only Kafka broker and its running fine > > ex. > > > > > ./kafka-consumer-groups.sh --bootstrap-server localhost:9092 > > > --describe --group > > > > But when I execute the admin command like create topic, alter topic For > > example > > > > > ./kafka-topics.sh --create --zookeeper :2181 > > > --replication-factor 1 --partitions 1 --topic > > > > Following exception is being displayed: > > > > > > > > > Error while executing topic command : replication factor: 1 larger > > > than available brokers: 0 [2017-11-16 11:22:13,592] ERROR > > > org.apache.kafka.common.errors.InvalidReplicationFactorException: > > > replication factor: 1 larger than available brokers: 0 > > > (kafka.admin.TopicCommand$) > > > > I checked my broker is up. In server.log following warnings are there > > > > [2017-11-16 11:14:26,959] WARN Client session timed out, have not > > heard from server in 15843ms for sessionid 0x15aa7f586e1c061 > > (org.apache.zookeeper.ClientCnxn) > > [2017-11-16 11:14:28,795] WARN Unable to reconnect to ZooKeeper > > service, session 0x15aa7f586e1c061 has expired (org.apache.zookeeper. > > ClientCnxn) > > [2017-11-16 11:21:46,055] WARN Unable to reconnect to ZooKeeper > > service, session 0x15aa7f586e1c067 has expired (org.apache.zookeeper. > > ClientCnxn) > > > > Below mentioned is my Kafka server configuration : > > > > broker.id=1 > > delete.topic.enable=true > > num.network.threads=3 > > num.io.threads=8 > > socket.send.buffer.bytes=102400 > > socket.receive.buffer.bytes=102400 > > socket.request.max.bytes=104857600 > > log.dirs=/kafka/data/logs > > num.partitions=1 > > log.segment.bytes=1073741824 > > log.retention.check.interval.ms=300000 > > zookeeper.connect=:2181 > > zookeeper.connection.timeout.ms=6000 > > > > Zookeeper Configuration is : > > > > # The number of milliseconds of each tick > > tickTime=2000 > > # The number of ticks that the initial > > # synchronization phase can take > > initLimit=10 > > # The number of ticks that can pass between > > # sending a request and getting an acknowledgement > > syncLimit=5 > > # the directory where the snapshot is stored. > > # do not use /tmp for storage, /tmp here is just > > # example sakes. > > dataDir=/zookeeper/data > > # the port at which the clients will connect > > clientPort=2181 > > # the maximum number of client connections. > > # increase this if you need to handle more clients > > #maxClientCnxns=60 > > autopurge.snapRetainCount=20 > > # Purge task interval in hours > > # Set to "0" to disable auto purge feature > > autopurge.purgeInterval=48 > > > > I am not able to figure out which configuration to tune. What I am missing > > .Any help will be appreciated. > > > > > > > > > > Regards, > > Abhimanyu > >