flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1753) Add more tests for Kafka Connectors
Date Mon, 13 Apr 2015 09:46:12 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14492137#comment-14492137
] 

ASF GitHub Bot commented on FLINK-1753:
---------------------------------------

GitHub user gaborhermann opened a pull request:

    https://github.com/apache/flink/pull/589

    [FLINK-1753] Added Kafka connectors test and configuration options

    * Added broker failure test to KafkaITCase, PersistentKafkaSource and KafkaSink can now
recover on broker failure.
    * Added Properties parameter to KafkaSink constructor, thus custom Kafka Producer configuration
can be used
    * Updated documentation

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gaborhermann/flink flink-1753

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/589.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #589
    
----
commit 269e3fed810cb51dc22002570fae342f95503a9b
Author: Gábor Hermann <reckoner42@gmail.com>
Date:   2015-03-23T13:18:55Z

    [FLINK-1753] [streaming] Added Kafka broker failure test

commit a7732acf144d42f3c53c0917a45bf0096e463723
Author: Gábor Hermann <reckoner42@gmail.com>
Date:   2015-04-13T09:19:08Z

    [streaming] Added user-definable producer config to KafkaSink

commit dd1c3191d6337ff59fb04afab9e4337b9268377b
Author: Gábor Hermann <reckoner42@gmail.com>
Date:   2015-04-13T09:37:47Z

    [streaming] Updated Kafka connectors documentation

----


> Add more tests for Kafka Connectors
> -----------------------------------
>
>                 Key: FLINK-1753
>                 URL: https://issues.apache.org/jira/browse/FLINK-1753
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming
>    Affects Versions: 0.9
>            Reporter: Robert Metzger
>            Assignee: Gábor Hermann
>
> The current {{KafkaITCase}} is only doing a single test.
> We need to refactor that test so that it brings up a Kafka/Zookeeper server and than
performs various tests:
> Tests to include:
> - A topology with non-string types MERGED IN 359b39c3
> - A topology with a custom Kafka Partitioning class MERGED IN 359b39c3
> - A topology testing the regular {{KafkaSource}}. MERGED IN 359b39c3
> - Kafka broker failure.
> - Flink TaskManager failure



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message