flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tzu-Li (Gordon) Tai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-7913) Add support for Kafka default partitioner
Date Mon, 11 Dec 2017 23:56:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286799#comment-16286799
] 

Tzu-Li (Gordon) Tai commented on FLINK-7913:
--------------------------------------------

We should probably take that into account, and respect that the returned key from `KeyedSerializationSchema`
can actually be null. That way we'll be able to cover both hash partitioning and round-robin
partitioning (which is the Kafka default).
We only ever write to a specific partition iff a custom partitioner is provided by the user.

> Add support for Kafka default partitioner
> -----------------------------------------
>
>                 Key: FLINK-7913
>                 URL: https://issues.apache.org/jira/browse/FLINK-7913
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kafka Connector
>    Affects Versions: 1.4.0
>            Reporter: Konstantin Lalafaryan
>            Assignee: Konstantin Lalafaryan
>            Priority: Blocker
>             Fix For: 1.5.0
>
>
> Currently in the Apache Flink it is available only *FlinkKafkaPartitioner* and just one
implementation *FlinkFixedPartitioner*. 
> In order to be able to use Kafka's default partitioner you have to create new implementation
for *FlinkKafkaPartitioner* and fork the code from the Kafka. It will be really good to be
able to define the partitioner without implementing the new class.
> Thanks.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message