kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Neha Narkhede (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-1290) TestLogCleaning tool hangs on the new producer
Date Tue, 04 Mar 2014 18:57:24 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Neha Narkhede updated KAFKA-1290:
---------------------------------

    Assignee:     (was: Jun Rao)

> TestLogCleaning tool hangs on the new producer
> ----------------------------------------------
>
>                 Key: KAFKA-1290
>                 URL: https://issues.apache.org/jira/browse/KAFKA-1290
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: producer 
>    Affects Versions: 0.9.0
>            Reporter: Neha Narkhede
>            Priority: Blocker
>
> KAFKA-1281 (yet to be checked in) converted existing tools to use the new producer. I
found that TestLogCleaning hangs while sending messages using the new producer. Following
is a thread dump and steps to reproduce the issue.
> nnarkhed-mn1:kafka-git-idea nnarkhed$ ./bin/kafka-run-class.sh kafka.TestLogCleaning
--broker localhost:9092 --topics 1 --zk localhost:2181 --messages 100000
> Producing 100000 messages...
> Logging produce requests to /var/folders/61/bspy8z8n1t5dn5sdqzsnhbdr000383/T/kafka-log-cleaner-produced-3744326506335955516.txt
> 2014-03-04 10:51:35
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.65-b04-462 mixed mode):
> "kafka-network-thread" daemon prio=5 tid=7fc27e94c000 nid=0x10a643000 runnable [10a642000]
>    java.lang.Thread.State: RUNNABLE
> 	at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
> 	at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136)
> 	at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69)
> 	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
> 	- locked <7ec0b0170> (a sun.nio.ch.Util$2)
> 	- locked <7ec0b0180> (a java.util.Collections$UnmodifiableSet)
> 	- locked <7ec0b0128> (a sun.nio.ch.KQueueSelectorImpl)
> 	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
> 	at org.apache.kafka.common.network.Selector.select(Selector.java:296)
> 	at org.apache.kafka.common.network.Selector.poll(Selector.java:198)
> 	at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:153)
> 	at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:98)
> 	at java.lang.Thread.run(Thread.java:695)
> "RMI TCP Accept-0" daemon prio=5 tid=7fc27e99c800 nid=0x10a43d000 runnable [10a43c000]
>    java.lang.Thread.State: RUNNABLE
> 	at java.net.PlainSocketImpl.socketAccept(Native Method)
> 	at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:439)
> 	- locked <7ec0b6088> (a java.net.SocksSocketImpl)
> 	at java.net.ServerSocket.implAccept(ServerSocket.java:468)
> 	at java.net.ServerSocket.accept(ServerSocket.java:436)
> 	at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)
> 	at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
> 	at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
> 	at java.lang.Thread.run(Thread.java:695)
> "AWT-AppKit" daemon prio=5 tid=7fc27f830000 nid=0x7fff7b984180 runnable [00000000]
>    java.lang.Thread.State: RUNNABLE
> "Low Memory Detector" daemon prio=5 tid=7fc27e8db000 nid=0x109b30000 runnable [00000000]
>    java.lang.Thread.State: RUNNABLE
> "C2 CompilerThread1" daemon prio=9 tid=7fc27e8da800 nid=0x109a2d000 waiting on condition
[00000000]
>    java.lang.Thread.State: RUNNABLE
> "C2 CompilerThread0" daemon prio=9 tid=7fc27e8d9800 nid=0x10992a000 waiting on condition
[00000000]
>    java.lang.Thread.State: RUNNABLE
> "Signal Dispatcher" daemon prio=9 tid=7fc27e8d9000 nid=0x109827000 waiting on condition
[00000000]
>    java.lang.Thread.State: RUNNABLE
> "Surrogate Locker Thread (Concurrent GC)" daemon prio=5 tid=7fc27e002000 nid=0x109724000
waiting on condition [00000000]
>    java.lang.Thread.State: RUNNABLE
> "Finalizer" daemon prio=8 tid=7fc27e8d8000 nid=0x109519000 in Object.wait() [109518000]
>    java.lang.Thread.State: WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <7ec0b23b0> (a java.lang.ref.ReferenceQueue$Lock)
> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
> 	- locked <7ec0b23b0> (a java.lang.ref.ReferenceQueue$Lock)
> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:171)
> "Reference Handler" daemon prio=10 tid=7fc27e8d7800 nid=0x109416000 in Object.wait()
[109415000]
>    java.lang.Thread.State: WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <7ec0b4000> (a java.lang.ref.Reference$Lock)
> 	at java.lang.Object.wait(Object.java:485)
> 	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
> 	- locked <7ec0b4000> (a java.lang.ref.Reference$Lock)
> "main" prio=5 tid=7fc27e000800 nid=0x102159000 in Object.wait() [102158000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <7ec0b23e0> (a org.apache.kafka.clients.producer.internals.Metadata)
> 	at org.apache.kafka.clients.producer.internals.Metadata.fetch(Metadata.java:89)
> 	- locked <7ec0b23e0> (a org.apache.kafka.clients.producer.internals.Metadata)
> 	at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:210)
> 	at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:144)
> 	at kafka.TestLogCleaning$$anonfun$produceMessages$1.apply$mcVL$sp(TestLogCleaning.scala:260)
> 	at kafka.TestLogCleaning$$anonfun$produceMessages$1.apply(TestLogCleaning.scala:251)
> 	at kafka.TestLogCleaning$$anonfun$produceMessages$1.apply(TestLogCleaning.scala:251)
> 	at scala.collection.immutable.NumericRange.foreach(NumericRange.scala:86)
> 	at kafka.TestLogCleaning$.produceMessages(TestLogCleaning.scala:251)
> 	at kafka.TestLogCleaning$.main(TestLogCleaning.scala:113)
> 	at kafka.TestLogCleaning.main(TestLogCleaning.scala)
> "VM Thread" prio=9 tid=7fc27e8d3000 nid=0x109313000 runnable 
> "Gang worker#0 (Parallel GC Threads)" prio=9 tid=7fc27e800000 nid=0x10555b000 runnable

> "Gang worker#1 (Parallel GC Threads)" prio=9 tid=7fc27e801000 nid=0x10565e000 runnable

> "Gang worker#2 (Parallel GC Threads)" prio=9 tid=7fc27e801800 nid=0x105761000 runnable

> "Gang worker#3 (Parallel GC Threads)" prio=9 tid=7fc27e802000 nid=0x105864000 runnable

> "Concurrent Mark-Sweep GC Thread" prio=9 tid=7fc27e87d000 nid=0x108f8a000 runnable 
> "VM Periodic Task Thread" prio=10 tid=7fc27e9b8000 nid=0x10a540000 waiting on condition

> "Exception Catcher Thread" prio=10 tid=7fc27e001800 nid=0x102384000 runnable 
> JNI global references: 1387
> Heap
>  par new generation   total 19136K, used 1795K [7eae00000, 7ec2c0000, 7ece00000)
>   eden space 17024K,   5% used [7eae00000, 7eaed6a28, 7ebea0000)
>   from space 2112K,  44% used [7ec0b0000, 7ec19a5c8, 7ec2c0000)
>   to   space 2112K,   0% used [7ebea0000, 7ebea0000, 7ec0b0000)
>  concurrent mark-sweep generation total 63872K, used 2050K [7ece00000, 7f0c60000, 7fae00000)
>  concurrent-mark-sweep perm gen total 21248K, used 13649K [7fae00000, 7fc2c0000, 800000000)



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message