spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From joseph-torres <...@git.apache.org>
Subject [GitHub] spark pull request #19452: [SPARK-22136][SS] Evaluate one-sided conditions e...
Date Fri, 06 Oct 2017 20:47:02 GMT
GitHub user joseph-torres opened a pull request:

    https://github.com/apache/spark/pull/19452

    [SPARK-22136][SS] Evaluate one-sided conditions early in stream-stream joins.

    ## What changes were proposed in this pull request?
    
    Evaluate one-sided conditions early in stream-stream joins.
    
    This is in addition to normal filter pushdown, because integrating it with the join logic
allows it to take place in outer join scenarios. This means that rows which can never satisfy
the join condition won't clog up the state. 
    
    ## How was this patch tested?
    new unit tests


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/joseph-torres/spark SPARK-22136

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/19452.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #19452
    
----
commit c90fb3cb1e112edeacb4be2604a7b628f55697f4
Author: Jose Torres <jose@databricks.com>
Date:   2017-10-06T20:44:20Z

    Evaluate one-sided conditions early in stream-stream joins.

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message