kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Seweryn Habdank-Wojewodzki (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5882) NullPointerException in StreamTask
Date Thu, 14 Sep 2017 14:36:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166376#comment-16166376
] 

Seweryn Habdank-Wojewodzki commented on KAFKA-5882:
---------------------------------------------------

I do not have any more logs as I reported. 
The problem was coming when during the data processing. 
We made Kafka rolling update - node by node with waiting when the node is updated and then
this and similar stuff comes.

So we saw that KStream based apps cannot handle rolling update at all.

Old fashioned consumer/producer apps are working brilliant, they do not have problems to survive
rolling update, but KStream based, they are going nuts :-).

> NullPointerException in StreamTask
> ----------------------------------
>
>                 Key: KAFKA-5882
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5882
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 0.11.0.0
>            Reporter: Seweryn Habdank-Wojewodzki
>
> It seems bugfix [KAFKA-5073|https://issues.apache.org/jira/browse/KAFKA-5073] is made,
but introduce some other issue.
> In some cases (I am not sure which ones) I got NPE (below).
> I would expect that even in case of FATAL error anythink except NPE is thrown.
> {code}
> 2017-09-12 23:34:54 ERROR ConsumerCoordinator:269 - User provided listener org.apache.kafka.streams.processor.internals.StreamThread$RebalanceListener
for group streamer failed on partition assignment
> java.lang.NullPointerException: null
>         at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:123)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:1234)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:294)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:254)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:1313)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.access$1100(StreamThread.java:73)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread$RebalanceListener.onPartitionsAssigned(StreamThread.java:183)
~[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:265)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:363)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:310)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:297)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1078)
[myapp-streamer.jar:?]
>         at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1043)
[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:582)
[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:553)
[myapp-streamer.jar:?]
>         at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:527)
[myapp-streamer.jar:?]
> 2017-09-12 23:34:54 INFO  StreamThread:1040 - stream-thread [streamer-3a44578b-faa8-4b5b-bbeb-7a7f04639563-StreamThread-1]
Shutting down
> 2017-09-12 23:34:54 INFO  KafkaProducer:972 - Closing the Kafka producer with timeoutMillis
= 9223372036854775807 ms.
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message