kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Seweryn Habdank-Wojewodzki (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (KAFKA-5882) NullPointerException in StreamTask
Date Tue, 30 Jan 2018 15:37:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345235#comment-16345235
] 

Seweryn Habdank-Wojewodzki edited comment on KAFKA-5882 at 1/30/18 3:36 PM:
----------------------------------------------------------------------------

One more comment when it happens quite deterministic. When process _*A*_, which consumes messages
from topic _input_ is already running many days and it is stopped while process _*B*_, which
is consuming the same topic also is working many days, and then by starting again _*A*_ this
error comes over and over again.
Current workaround is to stop both processes and start them again, that makes reballancing
to be passed and no "null" exception is comming. It seems like some long term state is already
deleted from topics, but it is hold in processes/borker and the new process, which is starting
becomes some state with deleted items.


was (Author: habdank):
One more comment when it happens quite deterministic. When process _*A*_, which consumes messages
from topic _input _is already running many days and it is stopped while process _*B*_, which
is consuming the same topic also is working many days, and then by starting again _*A*_ this
error comes over and over again.
Current workaround is to stop both processes and start them again, that makes reballancing
to be passed and no "null" exception is comming. It seems like some long term state is already
deleted from topics, but it is hold in processes/borker and the new process, which is starting
becomes some state with deleted items.

> NullPointerException in StreamTask
> ----------------------------------
>
>                 Key: KAFKA-5882
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5882
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 0.11.0.0, 0.11.0.1, 0.11.0.2
>            Reporter: Seweryn Habdank-Wojewodzki
>            Priority: Major
>
> It seems bugfix [KAFKA-5073|https://issues.apache.org/jira/browse/KAFKA-5073] is made,
but introduce some other issue.
> In some cases (I am not sure which ones) I got NPE (below).
> I would expect that even in case of FATAL error anythink except NPE is thrown.
> {code}
> 2017-09-12 23:34:54 ERROR ConsumerCoordinator:269 - User provided listener org.apache.kafka.streams.processor.internals.StreamThread$RebalanceListener
for group streamer failed on partition assignment
> java.lang.NullPointerException: null
>         at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:123)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:1234)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:294)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:254)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:1313)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.access$1100(StreamThread.java:73)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread$RebalanceListener.onPartitionsAssigned(StreamThread.java:183)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:265)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:363)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:310)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:297)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1078)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1043)
[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:582)
[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:553)
[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:527)
[myapp-streamer.jar:?]
> 2017-09-12 23:34:54 INFO  StreamThread:1040 - stream-thread [streamer-3a44578b-faa8-4b5b-bbeb-7a7f04639563-StreamThread-1]
Shutting down
> 2017-09-12 23:34:54 INFO  KafkaProducer:972 - Closing the Kafka producer with timeoutMillis
= 9223372036854775807 ms.
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message