flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3311) Add a connector for streaming data into Cassandra
Date Thu, 18 Feb 2016 08:28:18 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151932#comment-15151932
] 

ASF GitHub Bot commented on FLINK-3311:
---------------------------------------

Github user zentol commented on the pull request:

    https://github.com/apache/flink/pull/1660#issuecomment-185596124
  
    Relevant test failure
    ```
    Running org.apache.flink.connectors.cassandra.CassandraConnectorTest
    
    org.apache.flink.api.common.NonSerializableUserCodeException: User-defined object org.apache.flink.connectors.cassandra.CassandraConnectorTest$7@77443ec7
(org.apache.flink.connectors.cassandra.CassandraConnectorTest$7) contains non-serializable
field this$0 = org.apache.flink.connectors.cassandra.CassandraConnectorTest@735ee26
    
    	at org.apache.flink.api.common.operators.util.UserCodeObjectWrapper.<init>(UserCodeObjectWrapper.java:88)
    
    	at org.apache.flink.api.common.operators.GenericDataSinkBase.<init>(GenericDataSinkBase.java:70)
    
    	at org.apache.flink.api.java.operators.DataSink.translateToDataFlow(DataSink.java:219)
    
    	at org.apache.flink.api.java.operators.OperatorTranslation.translate(OperatorTranslation.java:66)
    
    	at org.apache.flink.api.java.operators.OperatorTranslation.translateToPlan(OperatorTranslation.java:51)
    
    	at org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:994)
    
    	at org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:961)
    
    	at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:84)
    
    	at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:855)
    
    	at org.apache.flink.api.java.DataSet.count(DataSet.java:395)
    
    	at org.apache.flink.connectors.cassandra.CassandraConnectorTest.batch(CassandraConnectorTest.java:290)
    ```


> Add a connector for streaming data into Cassandra
> -------------------------------------------------
>
>                 Key: FLINK-3311
>                 URL: https://issues.apache.org/jira/browse/FLINK-3311
>             Project: Flink
>          Issue Type: New Feature
>          Components: Streaming Connectors
>            Reporter: Robert Metzger
>            Assignee: Andrea Sella
>
> We had users in the past asking for a Flink+Cassandra integration.
> It seems that there is a well-developed java client for connecting into Cassandra: https://github.com/datastax/java-driver
(ASL 2.0)
> There are also tutorials out there on how to start a local cassandra instance (for the
tests): http://prettyprint.me/prettyprint.me/2010/02/14/running-cassandra-as-an-embedded-service/index.html
> For the data types, I think we should support TupleX types, and map standard java types
to the respective cassandra types.
> In addition, it seems that there is a object mapper from datastax to store POJOs in Cassandra
(there are annotations for defining the primary key and types)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message