kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Kumar (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-5504) Kafka controller is not getting elected
Date Fri, 23 Jun 2017 04:53:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ashish Kumar updated KAFKA-5504:
--------------------------------
    Description: 
I am having a kafka cluster of 20 nodes and I was facing the issue of under-replicated topics
issue for last few days so decided to restart the broker which was working as a controller
but after restart getting below logs in all the brokers (It seems controller is not finalized
and leader election is happening continuously):

[2017-06-23 02:59:50,388] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:50,396] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:50,410] INFO Rolled new log segment for 'dpe_feedback_rating_history-4'
in 0 ms. (kafka.log.Log)
[2017-06-23 02:59:51,585] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:51,590] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:51,609] INFO New leader is 11 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:52,792] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:52,799] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:52,808] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:54,122] INFO New leader is 3 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:55,504] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:55,512] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:55,520] INFO New leader is 11 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:56,695] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:56,701] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:56,709] INFO New leader is 11 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:57,949] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:57,955] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:57,965] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:59,378] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:59,384] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:59,395] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
.
.
.

Tried deleting controller znode (/controller) but no luck. Please let me know if any fix is
possible here.

  was:
I am having a kafka cluster of 20 nodes and I was facing issue of under-replicated topic for
last few days so decided to restart the broker which was working as a controller but after
restart getting below logs in all the brokers (It seems controller is not finalized and leader
election is happening continuously):

[2017-06-23 02:59:50,388] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:50,396] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:50,410] INFO Rolled new log segment for 'dpe_feedback_rating_history-4'
in 0 ms. (kafka.log.Log)
[2017-06-23 02:59:51,585] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:51,590] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:51,609] INFO New leader is 11 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:52,792] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:52,799] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:52,808] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:54,122] INFO New leader is 3 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:55,504] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:55,512] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:55,520] INFO New leader is 11 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:56,695] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:56,701] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:56,709] INFO New leader is 11 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:57,949] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:57,955] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:57,965] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-06-23 02:59:59,378] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:59,384] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
[2017-06-23 02:59:59,395] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
.
Please help.


> Kafka controller is not getting elected
> ---------------------------------------
>
>                 Key: KAFKA-5504
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5504
>             Project: Kafka
>          Issue Type: Bug
>          Components: controller
>    Affects Versions: 0.9.0.1
>            Reporter: Ashish Kumar
>
> I am having a kafka cluster of 20 nodes and I was facing the issue of under-replicated
topics issue for last few days so decided to restart the broker which was working as a controller
but after restart getting below logs in all the brokers (It seems controller is not finalized
and leader election is happening continuously):
> [2017-06-23 02:59:50,388] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:50,396] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
> [2017-06-23 02:59:50,410] INFO Rolled new log segment for 'dpe_feedback_rating_history-4'
in 0 ms. (kafka.log.Log)
> [2017-06-23 02:59:51,585] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:51,590] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:51,609] INFO New leader is 11 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
> [2017-06-23 02:59:52,792] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:52,799] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:52,808] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
> [2017-06-23 02:59:54,122] INFO New leader is 3 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
> [2017-06-23 02:59:55,504] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:55,512] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:55,520] INFO New leader is 11 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
> [2017-06-23 02:59:56,695] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:56,701] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:56,709] INFO New leader is 11 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
> [2017-06-23 02:59:57,949] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:57,955] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:57,965] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
> [2017-06-23 02:59:59,378] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:59,384] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral)
> [2017-06-23 02:59:59,395] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
> .
> .
> .
> Tried deleting controller znode (/controller) but no luck. Please let me know if any
fix is possible here.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message