beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amit Sela (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (BEAM-727) KafkaIO should support dynamic addition of Kafka partitions to assigned topics.
Date Fri, 07 Oct 2016 10:06:20 GMT

     [ https://issues.apache.org/jira/browse/BEAM-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amit Sela updated BEAM-727:
---------------------------
    Assignee:     (was: James Malone)

> KafkaIO should support dynamic addition of Kafka partitions to assigned topics. 
> --------------------------------------------------------------------------------
>
>                 Key: BEAM-727
>                 URL: https://issues.apache.org/jira/browse/BEAM-727
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-extensions
>            Reporter: Amit Sela
>            Priority: Minor
>
> Kafka topics may add partitions dynamically (doesn't require Kafka to restart, or halt
a topic), and the KafkaIO should probably support this.
> *Note:* 
> Consistently assigning partitions should be taken into account, specifically for the
case of reading from multiple topics, where one (or more) of the topics added partitions while
the pipeline is running.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message