kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Fung (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-734) Migration tool needs a revamp, it was poorly written and has many performance bugs
Date Fri, 15 Feb 2013 19:27:13 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13579438#comment-13579438
] 

John Fung commented on KAFKA-734:
---------------------------------

** Tried the latest patch v4 and got the following FATAL error:

[2013-02-15 17:36:01,324] INFO Property queue.enqueue.timeout.ms is overridden to -1 (kafka.utils.VerifiableProperties)
[2013-02-15 17:36:01,358] ERROR Kafka migration tool failed:  (kafka.tools.KafkaMigrationTool)
java.lang.IllegalArgumentException: Topic cannot be null.
        at kafka.producer.KeyedMessage.<init>(KeyedMessage.scala:25)
        at kafka.tools.KafkaMigrationTool$ProducerThread.<init>(KafkaMigrationTool.java:349)
        at kafka.tools.KafkaMigrationTool.main(KafkaMigrationTool.java:236)
[2013-02-15 17:36:01,359] FATAL Migration thread failure due to  (kafka.tools.KafkaMigrationTool$MigrationThread)
java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at kafka.tools.KafkaMigrationTool$MigrationThread.run(KafkaMigrationTool.java:310)
Caused by: java.lang.InterruptedException
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1961)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1996)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
        at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:60)
        at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:32)
        at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:59)
        at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:51)
        ... 5 more

                
> Migration tool needs a revamp, it was poorly written and has many performance bugs
> ----------------------------------------------------------------------------------
>
>                 Key: KAFKA-734
>                 URL: https://issues.apache.org/jira/browse/KAFKA-734
>             Project: Kafka
>          Issue Type: Bug
>          Components: tools
>    Affects Versions: 0.8
>            Reporter: Neha Narkhede
>            Assignee: Neha Narkhede
>            Priority: Blocker
>              Labels: p1
>         Attachments: kafka-734-v1.patch, kafka-734-v2.patch, kafka-734-v3.patch, kafka-734-v4.patch
>
>
> Migration tool has a number of problems ranging from poor logging to poor design. This
needs to be thought through again

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message