spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "caoxuewen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-21932) Add test CartesianProduct join case and BroadcastNestedLoop join case in JoinBenchmark
Date Wed, 06 Sep 2017 09:56:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-21932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

caoxuewen updated SPARK-21932:
------------------------------
    Description: 
this issue to fix two problems:
  1. add new two test case. test CartesianProduct join and BroadcastNestedLoop join. We understand
the effect of CodeGen on them. and through these two test cases, we can know Per Row (NS),
is much more delayed than our previous hash join.
  2.similar 'logical.Join', is not right, to be consistent in SparkStrategies.scala. fix to
remove package name.

  was:
this issue to fix two problems:
  1. similar 'logical.Join', is not right, to be consistent in SparkStrategies.scala. fix
to remove package name.
  2. add two test case. test CartesianProduct join and BroadcastNestedLoop join. We understand
the effect of CodeGen on them.


> Add test CartesianProduct join case and BroadcastNestedLoop join case in JoinBenchmark
> --------------------------------------------------------------------------------------
>
>                 Key: SPARK-21932
>                 URL: https://issues.apache.org/jira/browse/SPARK-21932
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL, Tests
>    Affects Versions: 2.3.0
>            Reporter: caoxuewen
>
> this issue to fix two problems:
>   1. add new two test case. test CartesianProduct join and BroadcastNestedLoop join.
We understand the effect of CodeGen on them. and through these two test cases, we can know
Per Row (NS), is much more delayed than our previous hash join.
>   2.similar 'logical.Join', is not right, to be consistent in SparkStrategies.scala.
fix to remove package name.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message