spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Frederick Reiss (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-15406) Structured streaming support for consuming from Kafka
Date Wed, 31 Aug 2016 18:57:21 GMT

    [ https://issues.apache.org/jira/browse/SPARK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15453059#comment-15453059
] 

Frederick Reiss commented on SPARK-15406:
-----------------------------------------

I've taken the liberty of splitting this issue into several steps to facilitate collaboration.

[~cody@koeninger.org], would you mind typing up any thoughts you have about how these steps
should move forward, as well as if there are smaller subtasks that others can help out with?

> Structured streaming support for consuming from Kafka
> -----------------------------------------------------
>
>                 Key: SPARK-15406
>                 URL: https://issues.apache.org/jira/browse/SPARK-15406
>             Project: Spark
>          Issue Type: New Feature
>            Reporter: Cody Koeninger
>
> Structured streaming doesn't have support for kafka yet.  I personally feel like time
based indexing would make for a much better interface, but it's been pushed back to kafka
0.10.1
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-33+-+Add+a+time+based+log+index



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message