hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-8436) Modify SparkWork to split works with multiple child works [Spark Branch]
Date Tue, 21 Oct 2014 02:45:34 GMT

     [ https://issues.apache.org/jira/browse/HIVE-8436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xuefu Zhang updated HIVE-8436:
------------------------------
       Resolution: Fixed
    Fix Version/s: spark-branch
           Status: Resolved  (was: Patch Available)

Patch committed to Spark branch. Thanks to Chao for the contribution.

> Modify SparkWork to split works with multiple child works [Spark Branch]
> ------------------------------------------------------------------------
>
>                 Key: HIVE-8436
>                 URL: https://issues.apache.org/jira/browse/HIVE-8436
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Xuefu Zhang
>            Assignee: Chao
>             Fix For: spark-branch
>
>         Attachments: HIVE-8436.1-spark.patch, HIVE-8436.10-spark.patch, HIVE-8436.11-spark.patch,
HIVE-8436.2-spark.patch, HIVE-8436.3-spark.patch, HIVE-8436.4-spark.patch, HIVE-8436.5-spark.patch,
HIVE-8436.6-spark.patch, HIVE-8436.7-spark.patch, HIVE-8436.8-spark.patch, HIVE-8436.9-spark.patch
>
>
> Based on the design doc, we need to split the operator tree of a work in SparkWork if
the work is connected to multiple child works. The way splitting the operator tree is performed
by cloning the original work and removing unwanted branches in the operator tree. Please refer
to the design doc for details.
> This process should be done right before we generate SparkPlan. We should have a utility
method that takes the orignal SparkWork and return a modified SparkWork.
> This process should also keep the information about the original work and its clones.
Such information will be needed during SparkPlan generation (HIVE-8437).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message