kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebastian Bernauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5766) Very high CPU-load of consumer when broker is down
Date Thu, 31 Aug 2017 15:48:01 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149153#comment-16149153
] 

Sebastian Bernauer commented on KAFKA-5766:
-------------------------------------------

So i've tried the code above with the

{noformat}
        <dependency>
            <groupId>org.springframework.kafka</groupId>
            <artifactId>spring-kafka</artifactId>
            <version>1.2.2.RELEASE</version>
        </dependency>
{noformat}
=> It caused the high cpu-load

If i change the dependency to
{noformat}
        <dependency>
            <groupId>org.springframework.kafka</groupId>
            <artifactId>spring-kafka</artifactId>
            <version>2.0.0.M3</version>
        </dependency>
{noformat}
the cpu load is low, all works fine, it seems to be fixed.

To be totally sure i will upgrade the version of spring-kafka in our real application and
test if it solves our problem.
Unfortunately this causes some problems, so it takes some time. I will give an update tomorrow.

But the original asked question is solved by upgrading spring-kafka to 2.0.0.M3

> Very high CPU-load of consumer when broker is down
> --------------------------------------------------
>
>                 Key: KAFKA-5766
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5766
>             Project: Kafka
>          Issue Type: Bug
>          Components: consumer
>            Reporter: Sebastian Bernauer
>
> Hi,
> i have a single broker instance at localhost.
> I set up a Consumer with the following code:
> {code:java}
>         Map<String, Object> configs = new HashMap<>();
>         configs.put(ConsumerConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092");
>         configs.put(ConsumerConfig.GROUP_ID_CONFIG, "gh399");
>         configs.put(ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
>         configs.put(ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
>         KafkaConsumer<String, String> consumer = new KafkaConsumer<>(configs);
>         consumer.assign(Collections.singletonList(new TopicPartition("foo", 0)));
>         while (true) {
>             ConsumerRecords<String, String> records = consumer.poll(1000);
>             System.out.println(records.count());
>         }
> {code}
> This works all fine, until i shut down the broker.
> If i do so, it causes a 100% CPU-load of my application.
> After starting the broker again the usage decreases back to a normal level. 
> It would be very nice if you could help me!
> Thanks,
> Sebastian
> Spring-Kafka: 2.0.0.M3
> Kafka: 0.10.2.0
> JDK: 1.8.0_121



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message