hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szehon Ho (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]
Date Mon, 12 Jan 2015 23:35:35 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274401#comment-14274401
] 

Szehon Ho commented on HIVE-7613:
---------------------------------

Very belated HNY!  I uploaded this pdf as a wiki page, which is more maintainable:

[https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark:+Join+Design+Master|https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark:+Join+Design+Master].

Its linked and a child of : [DesignDocs|https://cwiki.apache.org/confluence/display/Hive/DesignDocs]
page.

> Research optimization of auto convert join to map join [Spark branch]
> ---------------------------------------------------------------------
>
>                 Key: HIVE-7613
>                 URL: https://issues.apache.org/jira/browse/HIVE-7613
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Chengxiang Li
>            Assignee: Suhas Satish
>            Priority: Minor
>              Labels: TODOC-SPARK
>             Fix For: spark-branch
>
>         Attachments: HIve on Spark Map join background.docx, Hive on Spark Join Master
Design.pdf, small_table_broadcasting.pdf
>
>
> ConvertJoinMapJoin is an optimization the replaces a common join(aka shuffle join) with
a map join(aka broadcast or fragment replicate join) when possible. we need to research how
to make it workable with Hive on Spark.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message