hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9136) Profile query compiler [Spark Branch]
Date Thu, 18 Dec 2014 15:33:13 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251798#comment-14251798
] 

Xuefu Zhang commented on HIVE-9136:
-----------------------------------

Patch looks good to me. However, in SparkCompiler, we are only measuring time to generate
task tree. We should also gauge the time spent on logical optimization as well as physical
optimization. This can be addressed in a followup JIRA though.

> Profile query compiler [Spark Branch]
> -------------------------------------
>
>                 Key: HIVE-9136
>                 URL: https://issues.apache.org/jira/browse/HIVE-9136
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>    Affects Versions: spark-branch
>            Reporter: Brock Noland
>            Assignee: Chao
>         Attachments: HIVE-9136.1-spark.patch, HIVE-9136.1.patch, HIVE-9136.2-spark.patch
>
>
> We should put some performance counters around the compiler and evaluate how long it
takes to compile a query in Spark versus the other execution frameworks. Query 28 is a good
one to use for testing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message