hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Xu (JIRA)" <>
Subject [jira] [Updated] (HIVE-5771) Constant propagation optimizer for Hive
Date Sat, 17 May 2014 02:37:15 GMT


Ted Xu updated HIVE-5771:

    Attachment: HIVE-5771.patch.javaonly

[~hsubramaniyan] Thanks for your comment, the typo is corrected.

[~ashutoshc] Thank you for your patch! I already merge your changes to the latest patch. The
wrap up work turned out a bit longer than I expected. I think I fixed most of the failures
in unit tests, but there is still failures including:

# HashMap print order is uncertain, e.g., char_udf1.q, explain_dependency.q
# The iteration order of MapWork.getPathToAliases(), which is already a LinkedHashMap, is
still uncertain.

(They also failed on hive trunk clean build on my laptop. I'm using osx 10.9.2 and jdk 1.8.0_05)

I'm uploading the java only patch as an early preview. [~ashutoshc], I'm sorry but could you
please help me verify it on your working directory? Thanks!

> Constant propagation optimizer for Hive
> ---------------------------------------
>                 Key: HIVE-5771
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Ted Xu
>            Assignee: Ted Xu
>         Attachments: HIVE-5771.1.patch, HIVE-5771.10.patch, HIVE-5771.2.patch, HIVE-5771.3.patch,
HIVE-5771.4.patch, HIVE-5771.5.patch, HIVE-5771.6.patch, HIVE-5771.7.patch, HIVE-5771.8.patch,
HIVE-5771.9.patch, HIVE-5771.patch, HIVE-5771.patch.javaonly
> Currently there is no constant folding/propagation optimizer, all expressions are evaluated
at runtime. 
> HIVE-2470 did a great job on evaluating constants on UDF initializing phase, however,
it is still a runtime evaluation and it doesn't propagate constants from a subquery to outside.
> It may reduce I/O and accelerate process if we introduce such an optimizer.

This message was sent by Atlassian JIRA

View raw message