spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Conrad (JIRA)" <>
Subject [jira] [Commented] (SPARK-15406) Structured streaming support for consuming from Kafka
Date Wed, 31 Aug 2016 20:56:20 GMT


Robert Conrad commented on SPARK-15406:

Not sure about others but my use-case is to consume a logical replication log from a database
(e.g. produced by pg-bottledwater and written to kafka with avro) and thus maintain an always
up-to-date spark-sql view of specific tables in the db without polling it.

> Structured streaming support for consuming from Kafka
> -----------------------------------------------------
>                 Key: SPARK-15406
>                 URL:
>             Project: Spark
>          Issue Type: New Feature
>            Reporter: Cody Koeninger
> Structured streaming doesn't have support for kafka yet.  I personally feel like time
based indexing would make for a much better interface, but it's been pushed back to kafka

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message