spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-21765) Ensure all leaf nodes that are derived from streaming sources have isStreaming=true
Date Mon, 11 Sep 2017 14:55:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-21765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161394#comment-16161394
] 

Apache Spark commented on SPARK-21765:
--------------------------------------

User 'joseph-torres' has created a pull request for this issue:
https://github.com/apache/spark/pull/18973

> Ensure all leaf nodes that are derived from streaming sources have isStreaming=true
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-21765
>                 URL: https://issues.apache.org/jira/browse/SPARK-21765
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL, Structured Streaming
>    Affects Versions: 2.2.0
>            Reporter: Jose Torres
>            Assignee: Jose Torres
>             Fix For: 3.0.0
>
>
> LogicalPlan has an isStreaming bit, but it's incompletely implemented. Some streaming
sources don't set the bit, and the bit can sometimes be lost in rewriting. Setting the bit
for all plans that are logically streaming will help us simplify the logic around checking
query plan validity.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message