flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-6996) FlinkKafkaProducer010 doesn't guarantee at-least-once semantic
Date Wed, 28 Jun 2017 07:28:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066050#comment-16066050
] 

ASF GitHub Bot commented on FLINK-6996:
---------------------------------------

Github user tzulitai commented on a diff in the pull request:

    https://github.com/apache/flink/pull/4206#discussion_r124467315
  
    --- Diff: flink-connectors/flink-connector-kafka-0.8/src/test/java/org/apache/flink/streaming/connectors/kafka/Kafka08ProducerITCase.java
---
    @@ -18,17 +18,19 @@
     
     package org.apache.flink.streaming.connectors.kafka;
     
    -import org.junit.Test;
    -
     /**
      * IT cases for the {@link FlinkKafkaProducer08}.
      */
     @SuppressWarnings("serial")
     public class Kafka08ProducerITCase extends KafkaProducerTestBase {
     
    -	@Test
    -	public void testCustomPartitioning() {
    -		runCustomPartitioningTest();
    +	@Override
    +	public void testOneToOneAtLeastOnceRegularSink() throws Exception {
    +		// TODO: enable this for Kafka 0.8 - now it hangs indefinitely
    --- End diff --
    
    If this a pending fix?


> FlinkKafkaProducer010 doesn't guarantee at-least-once semantic
> --------------------------------------------------------------
>
>                 Key: FLINK-6996
>                 URL: https://issues.apache.org/jira/browse/FLINK-6996
>             Project: Flink
>          Issue Type: Bug
>          Components: Kafka Connector
>    Affects Versions: 1.2.0, 1.3.0, 1.2.1, 1.3.1
>            Reporter: Piotr Nowojski
>            Assignee: Piotr Nowojski
>
> FlinkKafkaProducer010 doesn't implement CheckpointedFunction interface. This means, when
it's used like a "regular sink function" (option a from [the java doc|https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer010.html])
it will not flush the data on "snapshotState"  as it is supposed to.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message