beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amit Sela (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-727) KafkaIO should support dynamic addition of Kafka partitions to assigned topics.
Date Fri, 07 Oct 2016 10:06:20 GMT
Amit Sela created BEAM-727:
------------------------------

             Summary: KafkaIO should support dynamic addition of Kafka partitions to assigned
topics. 
                 Key: BEAM-727
                 URL: https://issues.apache.org/jira/browse/BEAM-727
             Project: Beam
          Issue Type: Improvement
          Components: sdk-java-extensions
            Reporter: Amit Sela
            Assignee: James Malone
            Priority: Minor


Kafka topics may add partitions dynamically (doesn't require Kafka to restart, or halt a topic),
and the KafkaIO should probably support this.

*Note:* 
Consistently assigning partitions should be taken into account, specifically for the case
of reading from multiple topics, where one (or more) of the topics added partitions while
the pipeline is running.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message