kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Randall Hauch (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6433) Connect distributed workers should fail if their config is "incompatible" with leader's
Date Mon, 08 Jan 2018 23:21:00 GMT
Randall Hauch created KAFKA-6433:
------------------------------------

             Summary: Connect distributed workers should fail if their config is "incompatible"
with leader's
                 Key: KAFKA-6433
                 URL: https://issues.apache.org/jira/browse/KAFKA-6433
             Project: Kafka
          Issue Type: Improvement
          Components: KafkaConnect
    Affects Versions: 1.0.0
            Reporter: Randall Hauch


Currently, each distributed worker config must have the same `worker.id` and must use the
same internal topics for configs, offsets, and status. Additionally, each worker must be configured
to have the same connectors, SMTs, and converters; confusing error messages will result when
some workers are able to deploy connector tasks with SMTs while others fail when they are
missing plugins the other workers do have.

Ideally, a Connect workers would only be allowed to join the cluster if it were "compatible"
with the the existing cluster, where "compatible" perhaps includes using the same internal
topics and having the same set of plugins.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message