flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3311) Add a connector for streaming data into Cassandra
Date Mon, 07 Mar 2016 16:54:40 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15183255#comment-15183255

ASF GitHub Bot commented on FLINK-3311:

GitHub user zentol opened a pull request:


    [FLINK-3311/FLINK-3332] Add Cassandra connector

    This PR is a combination of #1640 and #1660, essentially providing a mid-merge view of
both PR's. As they reside in the same module and expose similar functionalities, several things
were changed in both commits to make the code more similar.
    Such changes include formatting, field ordering, code in-lining, package declarations,
file names, test unification, and the addition of a central method to create sinks (CassandraSink.addSink(DataStream<T>
input)) to reduce complexity for the user resulting from different sink implementations.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/zentol/flink cass_final

Alternatively you can review and apply these changes as the patch at:


To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1771
commit 1f296cba0f85696e2ff4ae48bbbdd8a7eaf6c8e7
Author: Andrea Sella <andrea.sella@radicalbit.io>
Date:   2016-03-02T15:28:11Z

    [FLINK-3311] Add At-Least-Once Cassandra connector

commit 7597dcaf976818b23a91872650f355e0505cdd59
Author: zentol <s.motsu@web.de>
Date:   2016-03-03T10:58:59Z

    [FLINK-3332] Add Exactly-Once Cassandra connector


> Add a connector for streaming data into Cassandra
> -------------------------------------------------
>                 Key: FLINK-3311
>                 URL: https://issues.apache.org/jira/browse/FLINK-3311
>             Project: Flink
>          Issue Type: New Feature
>          Components: Streaming Connectors
>            Reporter: Robert Metzger
>            Assignee: Andrea Sella
> We had users in the past asking for a Flink+Cassandra integration.
> It seems that there is a well-developed java client for connecting into Cassandra: https://github.com/datastax/java-driver
(ASL 2.0)
> There are also tutorials out there on how to start a local cassandra instance (for the
tests): http://prettyprint.me/prettyprint.me/2010/02/14/running-cassandra-as-an-embedded-service/index.html
> For the data types, I think we should support TupleX types, and map standard java types
to the respective cassandra types.
> In addition, it seems that there is a object mapper from datastax to store POJOs in Cassandra
(there are annotations for defining the primary key and types)

This message was sent by Atlassian JIRA

View raw message