Return-Path: X-Original-To: apmail-kafka-dev-archive@www.apache.org Delivered-To: apmail-kafka-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DDE76E0E6 for ; Fri, 15 Feb 2013 19:27:15 +0000 (UTC) Received: (qmail 4047 invoked by uid 500); 15 Feb 2013 19:27:14 -0000 Delivered-To: apmail-kafka-dev-archive@kafka.apache.org Received: (qmail 3998 invoked by uid 500); 15 Feb 2013 19:27:14 -0000 Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kafka.apache.org Delivered-To: mailing list dev@kafka.apache.org Received: (qmail 3859 invoked by uid 99); 15 Feb 2013 19:27:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Feb 2013 19:27:13 +0000 Date: Fri, 15 Feb 2013 19:27:13 +0000 (UTC) From: "John Fung (JIRA)" To: dev@kafka.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (KAFKA-734) Migration tool needs a revamp, it was poorly written and has many performance bugs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/KAFKA-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13579438#comment-13579438 ] John Fung commented on KAFKA-734: --------------------------------- ** Tried the latest patch v4 and got the following FATAL error: [2013-02-15 17:36:01,324] INFO Property queue.enqueue.timeout.ms is overridden to -1 (kafka.utils.VerifiableProperties) [2013-02-15 17:36:01,358] ERROR Kafka migration tool failed: (kafka.tools.KafkaMigrationTool) java.lang.IllegalArgumentException: Topic cannot be null. at kafka.producer.KeyedMessage.(KeyedMessage.scala:25) at kafka.tools.KafkaMigrationTool$ProducerThread.(KafkaMigrationTool.java:349) at kafka.tools.KafkaMigrationTool.main(KafkaMigrationTool.java:236) [2013-02-15 17:36:01,359] FATAL Migration thread failure due to (kafka.tools.KafkaMigrationTool$MigrationThread) java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at kafka.tools.KafkaMigrationTool$MigrationThread.run(KafkaMigrationTool.java:310) Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1961) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1996) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:60) at kafka.consumer.ConsumerIterator.makeNext(ConsumerIterator.scala:32) at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:59) at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:51) ... 5 more > Migration tool needs a revamp, it was poorly written and has many performance bugs > ---------------------------------------------------------------------------------- > > Key: KAFKA-734 > URL: https://issues.apache.org/jira/browse/KAFKA-734 > Project: Kafka > Issue Type: Bug > Components: tools > Affects Versions: 0.8 > Reporter: Neha Narkhede > Assignee: Neha Narkhede > Priority: Blocker > Labels: p1 > Attachments: kafka-734-v1.patch, kafka-734-v2.patch, kafka-734-v3.patch, kafka-734-v4.patch > > > Migration tool has a number of problems ranging from poor logging to poor design. This needs to be thought through again -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira