spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Davies Liu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-13354) Push filter throughout outer join when the condition can filter out empty row
Date Wed, 17 Feb 2016 01:02:18 GMT
Davies Liu created SPARK-13354:
----------------------------------

             Summary: Push filter throughout outer join when the condition can filter out
empty row 
                 Key: SPARK-13354
                 URL: https://issues.apache.org/jira/browse/SPARK-13354
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Davies Liu
            Assignee: Davies Liu



For a query

{code}

select * from a left outer join b on a.a = b.a where b.b > 10

{code}

The condition `b.b > 10` will filter out all the row that the b part of it is empty.

In this case, we should use Inner join, and push down the filter into b.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message