beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghu Angadi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-257) fix ConcurrentModificationException in KafkaIO
Date Thu, 05 May 2016 01:43:12 GMT
Raghu Angadi created BEAM-257:
---------------------------------

             Summary: fix ConcurrentModificationException in KafkaIO
                 Key: BEAM-257
                 URL: https://issues.apache.org/jira/browse/BEAM-257
             Project: Beam
          Issue Type: Bug
          Components: sdk-java-extensions
            Reporter: Raghu Angadi
            Assignee: James Malone


[~tgroh] reported the following exception with KafkaIO while using with DirectRunner. Fixing
it in https://github.com/apache/incubator-beam/pull/290

{code}
 java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access
	at org.apache.kafka.clients.consumer.KafkaConsumer.acquire(KafkaConsumer.java:1324)
	at org.apache.kafka.clients.consumer.KafkaConsumer.close(KafkaConsumer.java:1255)
	at com.google.common.io.Closeables.close(Closeables.java:79)
	at org.apache.beam.sdk.io.kafka.KafkaIO$UnboundedKafkaReader.close(KafkaIO.java:1050)
	at org.apache.beam.runners.direct.UnboundedReadEvaluatorFactory$UnboundedReadEvaluator.finishBundle(UnboundedReadEvaluatorFactory.java:167)
	at org.apache.beam.runners.direct.TransformExecutor.finishBundle(TransformExecutor.java:161)
	at org.apache.beam.runners.direct.TransformExecutor.call(TransformExecutor.java:116)
	at org.apache.beam.runners.direct.TransformExecutor.call(TransformExecutor.java:41)
	at java.util.concurrent.FutureTask.run(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message