kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rob Withers (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-876) Produce request: Leader not local for partition [test,0] on broker 0
Date Sat, 11 May 2013 00:47:16 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13655080#comment-13655080
] 

Rob Withers commented on KAFKA-876:
-----------------------------------

Jun, I changed the properties for the brokers to use backward slashes, as you suggested. 
As in \tmp\kafka0-logs.  This worked and I was able to produce data for awhile.  It seems
the bug this issue is about is fixed and could be closed.  

However, zookeeper accepts forward slashes (/tmp/zookeeper) and is successful with this. 
Kafka should be agnostic as well, I think - to make it all it will be.

After producing for awhile, it logs this FATAL error, in one of the brokers, and both brokers
are shutdown:

{2013-05-10 18:23:57,689} FATAL [highwatermark-checkpoint-thread1] (Logging.scala:109) - Attempt
to swap the new high watermark file with the old one failed

I will log a new issue.
                
> Produce request: Leader not local for partition [test,0] on broker 0 
> ---------------------------------------------------------------------
>
>                 Key: KAFKA-876
>                 URL: https://issues.apache.org/jira/browse/KAFKA-876
>             Project: Kafka
>          Issue Type: Bug
>          Components: clients, replication
>    Affects Versions: 0.8
>         Environment: Windows
>            Reporter: Yin Yin
>            Assignee: Neha Narkhede
>            Priority: Blocker
>
> Follow the quick start to open zookeeper, one broker, one producer and one consumer.
In the producer console, there is an LeaderNotAvailableException for the first message, and
the broker complains "Produce request: Leader not local for partition [test,0] on broker 0"
for all following messages. 
> Kafka-List-Topic shows "[2013-04-25 10:21:24,689] INFO zookeeper state changed (SyncConnected)
(org.I0Itec.zkclient.ZkClient) topic: test     partition: 0    leader: 0       replicas: 0
    isr: 0". With --unavailable-partitions option, it doesn't list any topic.
> =========================Broker Log=============================
> Set JMX_PORT to default value : 9999
> C:\Projects\Kafka\kafka\bin\..
> log4j:ERROR Failed to rename [server.log] to [server.log.2013-04-25-09].
> [2013-04-25 10:08:49,531] INFO Verifying properties (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] INFO Property socket.send.buffer.bytes is overridden to 1048576
(kafka.utils.VerifiablePropert
> ies)
> [2013-04-25 10:08:49,578] INFO Property socket.request.max.bytes is overridden to 104857600
(kafka.utils.VerifiablePrope
> rties)
> [2013-04-25 10:08:49,578] INFO Property log.dir is overridden to /tmp/kafka-logs (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] INFO Property log.cleanup.interval.mins is overridden to 1
(kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] INFO Property log.retention.hours is overridden to 168 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] INFO Property num.io.threads is overridden to 2 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] INFO Property broker.id is overridden to 0 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] WARN Property kafka.csv.metrics.reporter.enabled is not valid
(kafka.utils.VerifiablePropertie
> s)
> [2013-04-25 10:08:49,578] INFO Property port is overridden to 9092 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] INFO Property log.flush.interval.messages is overridden to
10000 (kafka.utils.VerifiableProper
> ties)
> [2013-04-25 10:08:49,578] INFO Property zk.connection.timeout.ms is overridden to 1000000
(kafka.utils.VerifiablePropert
> ies)
> [2013-04-25 10:08:49,578] WARN Property kafka.metrics.reporters is not valid (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] WARN Property kafka.csv.metrics.dir is not valid (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] INFO Property log.flush.interval.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] WARN Property kafka.metrics.polling.interval.secs is not valid
(kafka.utils.VerifiableProperti
> es)
> [2013-04-25 10:08:49,578] INFO Property num.network.threads is overridden to 2 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] INFO Property socket.receive.buffer.bytes is overridden to
1048576 (kafka.utils.VerifiableProp
> erties)
> [2013-04-25 10:08:49,578] INFO Property log.segment.bytes is overridden to 536870912
(kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,578] INFO Property zk.connect is overridden to localhost:2181 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,594] INFO Property num.partitions is overridden to 1 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:49,609] INFO [Kafka Server 0], starting (kafka.server.KafkaServer)
> [2013-04-25 10:08:49,625] INFO [Log Manager on Broker 0] Log directory 'C:\tmp\kafka-logs'
not found, creating it. (kafk
> a.log.LogManager)
> [2013-04-25 10:08:49,625] INFO [Log Manager on Broker 0] Starting log cleaner every 60000
ms (kafka.log.LogManager)
> [2013-04-25 10:08:49,640] INFO [Log Manager on Broker 0] Starting log flusher every 3000
ms with the following overrides
>  Map() (kafka.log.LogManager)
> [2013-04-25 10:08:49,656] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor)
> [2013-04-25 10:08:49,656] INFO [Socket Server on Broker 0], started (kafka.network.SocketServer)
> [2013-04-25 10:08:49,672] INFO connecting to ZK: localhost:2181 (kafka.server.KafkaZooKeeper)
> [2013-04-25 10:08:49,672] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
> [2013-04-25 10:08:49,672] INFO Client environment:zookeeper.version=3.3.3-1203054, built
on 11/17/2011 05:47 GMT (org.ap
> ache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,672] INFO Client environment:host.name=YIYIN-MAIN.redmond.corp.microsoft.com
(org.apache.zookeeper.
> ZooKeeper)
> [2013-04-25 10:08:49,672] INFO Client environment:java.version=1.7.0_21 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,672] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,672] INFO Client environment:java.home=C:\Program Files (x86)\Java\jdk1.7.0_21\jre
(org.apache.zook
> eeper.ZooKeeper)
> [2013-04-25 10:08:49,687] INFO Client environment:java.io.tmpdir=C:\Users\yiyin\AppData\Local\Temp\
(org.apache.zookeepe
> r.ZooKeeper)
> [2013-04-25 10:08:49,687] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,687] INFO Client environment:os.name=Windows 8 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,687] INFO Client environment:os.arch=x86 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,687] INFO Client environment:os.version=6.2 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,687] INFO Client environment:user.name=yiyin (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,687] INFO Client environment:user.home=C:\Users\yiyin (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,687] INFO Client environment:user.dir=C:\Projects\Kafka\kafka\bin
(org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,687] INFO Initiating client connection, connectString=localhost:2181
sessionTimeout=6000 watcher=or
> g.I0Itec.zkclient.ZkClient@16e73e3 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:49,703] INFO Opening socket connection to server localhost/127.0.0.1:2181
(org.apache.zookeeper.Client
> Cnxn)
> [2013-04-25 10:08:49,703] INFO Socket connection established to localhost/127.0.0.1:2181,
initiating session (org.apache
> .zookeeper.ClientCnxn)
> [2013-04-25 10:08:49,781] INFO Session establishment complete on server localhost/127.0.0.1:2181,
sessionid = 0x13e422b2
> f620000, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
> [2013-04-25 10:08:49,781] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
> [2013-04-25 10:08:49,812] INFO Registered broker 0 at path /brokers/ids/0 with address
YIYIN-MAIN.redmond.corp.microsoft
> .com:9092. (kafka.utils.ZkUtils$)
> [2013-04-25 10:08:49,812] INFO [Kafka Server 0], Connecting to ZK: localhost:2181 (kafka.server.KafkaServer)
> [2013-04-25 10:08:49,859] INFO Will not load MX4J, mx4j-tools.jar is not in the classpath
(kafka.utils.Mx4jLoader$)
> [2013-04-25 10:08:49,875] INFO 0 successfully elected as leader (kafka.server.ZookeeperLeaderElector)
> [2013-04-25 10:08:49,984] INFO No state transitions triggered since no partitions are
assigned to brokers 0 (kafka.utils
> .ZkUtils$)
> [2013-04-25 10:08:49,984] INFO New leader is 0 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
> [2013-04-25 10:08:50,000] INFO [Kafka Server 0], started (kafka.server.KafkaServer)
> [2013-04-25 10:08:55,969] INFO Closing socket connection to /10.123.11.25. (kafka.network.Processor)
> [2013-04-25 10:09:03,234] INFO [KafkaApi-0] Auto creation of topic test with 1 partitions
and replication factor 1 is su
> ccessful! (kafka.server.KafkaApis)
> [2013-04-25 10:09:03,281] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor)
> [2013-04-25 10:09:03,281] INFO [Replica Manager on Broker 0]: Handling LeaderAndIsr request
Name:LeaderAndIsrRequest;Ver
> sion:0;Controller:0;ControllerEpoch:1;CorrelationId:5;ClientId:id_0-host_null-port_9092;AckTimeoutMs:1000
ms;PartitionSt
> ate:(test,0) -> (LeaderAndIsrInfo:(Leader:0,ISR:0,LeaderEpoch:0,ControllerEpoch:1),ReplicationFactor:1);Leaders:id:0,hos
> t:YIYIN-MAIN.redmond.corp.microsoft.com,port:9092 (kafka.server.ReplicaManager)
> [2013-04-25 10:09:03,281] INFO [ReplicaFetcherManager on broker 0] Removing fetcher for
partition [test,0] (kafka.server
> .ReplicaFetcherManager)
> [2013-04-25 10:09:03,297] INFO [Kafka Log on Broker 0], Completed load of log test-0
with log end offset 0 (kafka.log.Lo
> g)
> [2013-04-25 10:09:03,297] INFO [Log Manager on Broker 0] Created log for topic test partition
0 in C:\tmp\kafka-logs. (k
> afka.log.LogManager)
> [2013-04-25 10:09:03,297] INFO [Replica Manager on Broker 0]: Handled leader and isr
request Name:LeaderAndIsrRequest;Ve
> rsion:0;Controller:0;ControllerEpoch:1;CorrelationId:5;ClientId:id_0-host_null-port_9092;AckTimeoutMs:1000
ms;PartitionS
> tate:(test,0) -> (LeaderAndIsrInfo:(Leader:0,ISR:0,LeaderEpoch:0,ControllerEpoch:1),ReplicationFactor:1);Leaders:id:0,ho
> st:YIYIN-MAIN.redmond.corp.microsoft.com,port:9092 (kafka.server.ReplicaManager)
> [2013-04-25 10:09:03,438] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor)
> [2013-04-25 10:09:03,453] WARN [KafkaApi-0] Produce request: Leader not local for partition
[test,0] on broker 0 (kafka.
> server.KafkaApis)
> [2013-04-25 10:09:05,453] WARN [KafkaApi-0] Produce request: Leader not local for partition
[test,0] on broker 0 (kafka.
> server.KafkaApis)
> [2013-04-25 10:09:07,250] WARN [KafkaApi-0] Produce request: Leader not local for partition
[test,0] on broker 0 (kafka.
> server.KafkaApis)
> [2013-04-25 10:09:08,891] WARN [KafkaApi-0] Produce request: Leader not local for partition
[test,0] on broker 0 (kafka.
> server.KafkaApis)
> =============================Producer Log==============================
> C:\Projects\Kafka\kafka\bin\..
> [2013-04-25 10:08:52,531] INFO Verifying properties (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property queue.buffering.max.messages is overridden to
10000 (kafka.utils.VerifiablePrope
> rties)
> [2013-04-25 10:08:52,547] INFO Property key.serializer.class is overridden to kafka.serializer.StringEncoder
(kafka.util
> s.VerifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property compression.codec is overridden to 0 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property serializer.class is overridden to kafka.serializer.StringEncoder
(kafka.utils.Ve
> rifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property request.timeout.ms is overridden to 1500 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property broker.list is overridden to localhost:9092 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property send.buffer.bytes is overridden to 102400 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property request.required.acks is overridden to 0 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property queue.buffering.max.ms is overridden to 1000
(kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:52,547] INFO Property queue.enqueue.timeout.ms is overridden to 0 (kafka.utils.VerifiableProperties)
> hello
> [2013-04-25 10:09:03,203] INFO Fetching metadata with correlation id 0 for 1 topic(s)
Set(test) (kafka.client.ClientUtil
> s$)
> [2013-04-25 10:09:03,203] INFO Connected to localhost:9092 for producing (kafka.producer.SyncProducer)
> [2013-04-25 10:09:03,281] INFO Disconnecting from localhost:9092 (kafka.producer.SyncProducer)
> [2013-04-25 10:09:03,281] WARN Error while fetching metadata    partition 0     leader:
none    replicas:       isr:
> isUnderReplicated: false for topic partition [test,0]: [class kafka.common.LeaderNotAvailableException]
(kafka.producer.
> BrokerPartitionInfo)
> [2013-04-25 10:09:03,297] WARN Failed to collate messages by topic,partition due to (kafka.producer.async.DefaultEventHa
> ndler)
> kafka.common.LeaderNotAvailableException: No leader for any partition
>         at kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$getPartition(DefaultEventH
> andler.scala:212)
>         at kafka.producer.async.DefaultEventHandler$$anonfun$partitionAndCollate$1.apply(DefaultEventHandler.scala:150)
>         at kafka.producer.async.DefaultEventHandler$$anonfun$partitionAndCollate$1.apply(DefaultEventHandler.scala:148)
>         at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:57)
>         at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43)
>         at kafka.producer.async.DefaultEventHandler.partitionAndCollate(DefaultEventHandler.scala:148)
>         at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:94)
>         at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72)
>         at kafka.producer.Producer.send(Producer.scala:74)
>         at kafka.producer.ConsoleProducer$.main(ConsoleProducer.scala:159)
>         at kafka.producer.ConsoleProducer.main(ConsoleProducer.scala)
> [2013-04-25 10:09:03,406] INFO Fetching metadata with correlation id 2 for 1 topic(s)
Set(test) (kafka.client.ClientUtil
> s$)
> [2013-04-25 10:09:03,406] INFO Connected to localhost:9092 for producing (kafka.producer.SyncProducer)
> [2013-04-25 10:09:03,438] INFO Disconnecting from localhost:9092 (kafka.producer.SyncProducer)
> [2013-04-25 10:09:03,453] INFO Connected to YIYIN-MAIN.redmond.corp.microsoft.com:9092
for producing (kafka.producer.Syn
> cProducer)
> hello
> hello
> hello
> =================================ZooKeeper Log====================================
> C:\Projects\Kafka\kafka\bin\..
> [2013-04-25 10:08:46,500] INFO Reading configuration from: ..\config\zookeeper.properties
(org.apache.zookeeper.server.q
> uorum.QuorumPeerConfig)
> [2013-04-25 10:08:46,500] WARN Either no config or no quorum defined in config, running
 in standalone mode (org.apache.
> zookeeper.server.quorum.QuorumPeerMain)
> [2013-04-25 10:08:46,515] INFO Reading configuration from: ..\config\zookeeper.properties
(org.apache.zookeeper.server.q
> uorum.QuorumPeerConfig)
> [2013-04-25 10:08:46,515] INFO Starting server (org.apache.zookeeper.server.ZooKeeperServerMain)
> [2013-04-25 10:08:46,531] INFO Server environment:zookeeper.version=3.3.3-1203054, built
on 11/17/2011 05:47 GMT (org.ap
> ache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:host.name=YIYIN-MAIN.redmond.corp.microsoft.com
(org.apache.zookeeper.
> server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:java.version=1.7.0_21 (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:java.vendor=Oracle Corporation (org.apache.zookeeper.server.ZooKeeperS
> erver)
> [2013-04-25 10:08:46,531] INFO Server environment:java.home=C:\Program Files (x86)\Java\jdk1.7.0_21\jre
(org.apache.zook
> eeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:java.io.tmpdir=C:\Users\yiyin\AppData\Local\Temp\
(org.apache.zookeepe
> r.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:java.compiler=<NA> (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:os.name=Windows 8 (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:os.arch=x86 (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:os.version=6.2 (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:user.name=yiyin (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:user.home=C:\Users\yiyin (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO Server environment:user.dir=C:\Projects\Kafka\kafka\bin
(org.apache.zookeeper.server.ZooK
> eeperServer)
> [2013-04-25 10:08:46,531] INFO tickTime set to 3000 (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO minSessionTimeout set to -1 (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,531] INFO maxSessionTimeout set to -1 (org.apache.zookeeper.server.ZooKeeperServer)
> [2013-04-25 10:08:46,547] INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.apache.zookeeper.server.NIOServerCnxn)
> [2013-04-25 10:08:46,562] INFO Snapshotting: 0 (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
> [2013-04-25 10:08:49,703] INFO Accepted socket connection from /127.0.0.1:8001 (org.apache.zookeeper.server.NIOServerCnx
> n)
> [2013-04-25 10:08:49,703] INFO Client attempting to establish new session at /127.0.0.1:8001
(org.apache.zookeeper.serve
> r.NIOServerCnxn)
> [2013-04-25 10:08:49,703] INFO Creating new log file: log.1 (org.apache.zookeeper.server.persistence.FileTxnLog)
> [2013-04-25 10:08:49,781] INFO Established session 0x13e422b2f620000 with negotiated
timeout 6000 for client /127.0.0.1:
> 8001 (org.apache.zookeeper.server.NIOServerCnxn)
> [2013-04-25 10:08:49,812] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620000
type:create cx
> id:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode
= NoNode for /b
> rokers/ids (org.apache.zookeeper.server.PrepRequestProcessor)
> [2013-04-25 10:08:49,812] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620000
type:create cx
> id:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/brokers Error:KeeperErrorCode
= NoNode for /broke
> rs (org.apache.zookeeper.server.PrepRequestProcessor)
> [2013-04-25 10:08:49,875] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620000
type:setData c
> xid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/controller_epoch
Error:KeeperErrorCode = NoNode
> for /controller_epoch (org.apache.zookeeper.server.PrepRequestProcessor)
> [2013-04-25 10:08:49,984] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620000
type:delete cx
> id:0x19 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/admin Error:KeeperErrorCode
= NoNode for /admin
> (org.apache.zookeeper.server.PrepRequestProcessor)
> [2013-04-25 10:08:55,594] INFO Accepted socket connection from /127.0.0.1:8007 (org.apache.zookeeper.server.NIOServerCnx
> n)
> [2013-04-25 10:08:55,609] INFO Client attempting to establish new session at /127.0.0.1:8007
(org.apache.zookeeper.serve
> r.NIOServerCnxn)
> [2013-04-25 10:08:55,672] INFO Established session 0x13e422b2f620001 with negotiated
timeout 6000 for client /127.0.0.1:
> 8007 (org.apache.zookeeper.server.NIOServerCnxn)
> [2013-04-25 10:08:55,687] INFO Accepted socket connection from /127.0.0.1:8010 (org.apache.zookeeper.server.NIOServerCnx
> n)
> [2013-04-25 10:08:55,687] INFO Client attempting to establish new session at /127.0.0.1:8010
(org.apache.zookeeper.serve
> r.NIOServerCnxn)
> [2013-04-25 10:08:55,687] INFO Established session 0x13e422b2f620002 with negotiated
timeout 30000 for client /127.0.0.1
> :8010 (org.apache.zookeeper.server.NIOServerCnxn)
> [2013-04-25 10:08:55,703] INFO Processed session termination for sessionid: 0x13e422b2f620002
(org.apache.zookeeper.serv
> er.PrepRequestProcessor)
> [2013-04-25 10:08:55,703] INFO Closed socket connection for client /127.0.0.1:8010 which
had sessionid 0x13e422b2f620002
>  (org.apache.zookeeper.server.NIOServerCnxn)
> [2013-04-25 10:08:55,750] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620001
type:create cx
> id:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/consumers/console-consumer-70983/ids
Error:Keeper
> ErrorCode = NoNode for /consumers/console-consumer-70983/ids (org.apache.zookeeper.server.PrepRequestProcessor)
> [2013-04-25 10:08:55,750] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620001
type:create cx
> id:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/consumers/console-consumer-70983
Error:KeeperErro
> rCode = NoNode for /consumers/console-consumer-70983 (org.apache.zookeeper.server.PrepRequestProcessor)
> [2013-04-25 10:08:55,750] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620001
type:create cx
> id:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/consumers Error:KeeperErrorCode
= NoNode for /con
> sumers (org.apache.zookeeper.server.PrepRequestProcessor)
> [2013-04-25 10:09:03,219] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620000
type:create cx
> id:0x21 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/brokers/topics
Error:KeeperErrorCode = NoNode fo
> r /brokers/topics (org.apache.zookeeper.server.PrepRequestProcessor)
> [2013-04-25 10:09:03,266] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620000
type:create cx
> id:0x2f zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/brokers/topics/test/partitions/0
Error:KeeperErr
> orCode = NoNode for /brokers/topics/test/partitions/0 (org.apache.zookeeper.server.PrepRequestProcessor)
> [2013-04-25 10:09:03,266] INFO Got user-level KeeperException when processing sessionid:0x13e422b2f620000
type:create cx
> id:0x30 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/brokers/topics/test/partitions
Error:KeeperError
> Code = NoNode for /brokers/topics/test/partitions (org.apache.zookeeper.server.PrepRequestProcessor)
> ==============================Consumer Log=======================================
> C:\Projects\Kafka\kafka\bin\..
> [2013-04-25 10:08:55,516] INFO Verifying properties (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:55,547] INFO Property zk.connect is overridden to localhost:2181 (kafka.utils.VerifiablePro
> [2013-04-25 10:08:55,547] INFO Property group.id is overridden to console-consumer-70983
(kafka.utils.Verifia
> es)
> [2013-04-25 10:08:55,547] INFO Property fetch.message.max.bytes is overridden to 1048576
(kafka.utils.Verifia
> es)
> [2013-04-25 10:08:55,547] INFO Property consumer.timeout.ms is overridden to -1 (kafka.utils.VerifiableProper
> [2013-04-25 10:08:55,547] INFO Property socket.timeout.ms is overridden to 30000 (kafka.utils.VerifiablePrope
> [2013-04-25 10:08:55,547] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiablePr
> [2013-04-25 10:08:55,547] INFO Property socket.receive.buffer.bytes is overridden to
2097152 (kafka.utils.Ver
> erties)
> [2013-04-25 10:08:55,547] INFO Property fetch.wait.max.ms is overridden to 100 (kafka.utils.VerifiablePropert
> [2013-04-25 10:08:55,547] INFO Property auto.commit.enable is overridden to true (kafka.utils.VerifiablePrope
> [2013-04-25 10:08:55,547] INFO Property auto.commit.interval.ms is overridden to 10000
(kafka.utils.Verifiabl
> )
> [2013-04-25 10:08:55,547] INFO Property fetch.min.bytes is overridden to 1 (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:55,562] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
Connecting to zook
> nce at localhost:2181 (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,562] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
> [2013-04-25 10:08:55,578] INFO Client environment:zookeeper.version=3.3.3-1203054, built
on 11/17/2011 05:47
> ache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:host.name=YIYIN-MAIN.redmond.corp.microsoft.com
(org.apache
> ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:java.version=1.7.0_21 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKee
> [2013-04-25 10:08:55,578] INFO Client environment:java.home=C:\Program Files (x86)\Java\jdk1.7.0_21\jre
(org.
> eeper.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:java.io.tmpdir=C:\Users\yiyin\AppData\Local\Temp\
(org.apac
> r.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:os.name=Windows 8 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:os.arch=x86 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:os.version=6.2 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:user.name=yiyin (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:user.home=C:\Users\yiyin (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,578] INFO Client environment:user.dir=C:\Projects\Kafka\kafka\bin
(org.apache.zookeeper.
> [2013-04-25 10:08:55,578] INFO Initiating client connection, connectString=localhost:2181
sessionTimeout=6000
> g.I0Itec.zkclient.ZkClient@1124f52 (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,594] INFO Opening socket connection to server localhost/127.0.0.1:2181
(org.apache.zooke
> Cnxn)
> [2013-04-25 10:08:55,594] INFO Socket connection established to localhost/127.0.0.1:2181,
initiating session
> .zookeeper.ClientCnxn)
> [2013-04-25 10:08:55,672] INFO Session establishment complete on server localhost/127.0.0.1:2181,
sessionid =
> f620001, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
> [2013-04-25 10:08:55,672] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
> [2013-04-25 10:08:55,672] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
starting auto comm
>  10000 ms (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,687] INFO Initiating client connection, connectString=localhost:2181
sessionTimeout=3000
> rg.I0Itec.zkclient.ZkClient@13033a (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,687] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
> [2013-04-25 10:08:55,687] INFO Opening socket connection to server localhost/127.0.0.1:2181
(org.apache.zooke
> Cnxn)
> [2013-04-25 10:08:55,687] INFO Socket connection established to localhost/127.0.0.1:2181,
initiating session
> .zookeeper.ClientCnxn)
> [2013-04-25 10:08:55,687] INFO Session establishment complete on server localhost/127.0.0.1:2181,
sessionid =
> f620002, negotiated timeout = 30000 (org.apache.zookeeper.ClientCnxn)
> [2013-04-25 10:08:55,687] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
> [2013-04-25 10:08:55,703] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
> [2013-04-25 10:08:55,703] INFO Session: 0x13e422b2f620002 closed (org.apache.zookeeper.ZooKeeper)
> [2013-04-25 10:08:55,703] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
> [2013-04-25 10:08:55,734] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
begin registering
> nsole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c in ZK (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,750] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
end registering co
> ole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c in ZK (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,750] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
starting watcher e
> ead for consumer console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c (kafka.consumer.ZookeeperConsumerCo
> [2013-04-25 10:08:55,766] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
begin rebalancing
> nsole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c try #0 (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,891] INFO Verifying properties (kafka.utils.VerifiableProperties)
> [2013-04-25 10:08:55,906] INFO Property broker.list is overridden to YIYIN-MAIN.redmond.corp.microsoft.com:90
> tils.VerifiableProperties)
> [2013-04-25 10:08:55,906] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProp
> [2013-04-25 10:08:55,906] INFO Property client.id is overridden to console-consumer-70983
(kafka.utils.Verifi
> ies)
> [2013-04-25 10:08:55,922] INFO Fetching metadata with correlation id 0 for 0 topic(s)
Set() (kafka.client.Cli
> [2013-04-25 10:08:55,922] INFO Connected to YIYIN-MAIN.redmond.corp.microsoft.com:9092
for producing (kafka.p
> cProducer)
> [2013-04-25 10:08:55,969] INFO Disconnecting from YIYIN-MAIN.redmond.corp.microsoft.com:9092
(kafka.producer.
> r)
> [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] Stopping leader
finder thread (kafka.co
> umerFetcherManager)
> [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] Stopping all fetchers
(kafka.consumer.C
> herManager)
> [2013-04-25 10:08:55,969] INFO [ConsumerFetcherManager-1366909735672] All connections
stopped (kafka.consumer
> tcherManager)
> [2013-04-25 10:08:55,969] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
Cleared all releva
> or this fetcher (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,969] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
Cleared the data c
> l the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,969] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
Committing all off
> clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,969] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
Releasing partitio
>  (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
Updating the cache
> sumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
Consumer console-c
> 83_YIYIN-MAIN-1366909735562-a3d9410c selected partitions :  (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c-leader-finder-thread
>   (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
> [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
end rebalancing co
> ole-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c try #0 (kafka.consumer.ZookeeperConsumerConnector)
> [2013-04-25 10:08:55,984] INFO [console-consumer-70983_YIYIN-MAIN-1366909735562-a3d9410c],
Not creating event
> r trivial whitelist test (kafka.consumer.ZookeeperConsumerConnector)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message