spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sam elamin (JIRA)" <j...@apache.org>
Subject [jira] (SPARK-19414) Inferring schema in a structured streaming source
Date Tue, 31 Jan 2017 20:31:51 GMT
sam elamin created SPARK-19414:
----------------------------------

             Summary: Inferring schema in a structured streaming source
                 Key: SPARK-19414
                 URL: https://issues.apache.org/jira/browse/SPARK-19414
             Project: Spark
          Issue Type: Bug
          Components: Structured Streaming
            Reporter: sam elamin


Hi All

I am writing a connector to BigQuery that uses structured streaming, my question is about
schemas

I would like to be able to infer the schema from BQ rather than pass it in, is there any way
to overwrite the source schema in anything that extends 

org.apache.spark.sql.execution.streaming.Source



Overriding the schema method doesnt seem to work 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message