kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yogesh BG (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (KAFKA-5593) Kafka streams not re-balancing when 3 consumer streams are there
Date Tue, 18 Jul 2017 05:33:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-5593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yogesh BG resolved KAFKA-5593.
------------------------------
    Resolution: Invalid

> Kafka streams not re-balancing when 3 consumer streams are there
> ----------------------------------------------------------------
>
>                 Key: KAFKA-5593
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5593
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>            Reporter: Yogesh BG
>            Priority: Critical
>         Attachments: log1.txt, log2.txt, log3.txt
>
>
> I have 3 broker nodes, 3 kafka streams
> I observe that all 3 consumer streams are part of the group named rtp-kafkastreams. but
when i see the data is processed only by one node. 
> <data processed log - only in attached log1 file>
> DEBUG n.a.a.k.a.AccessLogMetricEnrichmentProcessor - AccessLogMetricEnrichmentProcessor.process
> when i do check the partition information shared by each of them i see first node has
all partitions like all 8. but in other streams the folder is empty.
> <Node 1>
> [root@ip-172-31-11-139 ~]# ls /data/kstreams/rtp-kafkastreams
> 0_0  0_1  0_2  0_3  0_4  0_5  0_6  0_7
> <Node 2> and <Node 3> this folder is empty
> I tried restarting the other two consumer streams still they won't become the part of
the group and re-balance.
> I have attached the logs.
> Configurations are inside the log file.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message