Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Sat, 17 May 2014 02:37:15 +0000 (UTC)
From: "Ted Xu (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <JIRA.12677954.1383814315208.373969.1400294235112@arcas>
In-Reply-To: <JIRA.12677954.1383814315208@arcas>
References: <JIRA.12677954.1383814315208@arcas>
Subject: [jira] [Updated] (HIVE-5771) Constant propagation optimizer for
 Hive
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HIVE-5771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ted Xu updated HIVE-5771:
-------------------------

    Attachment: HIVE-5771.patch.javaonly

[~hsubramaniyan] Thanks for your comment, the typo is corrected.

[~ashutoshc] Thank you for your patch! I already merge your changes to the latest patch. The wrap up work turned out a bit longer than I expected. I think I fixed most of the failures in unit tests, but there is still failures including:

# HashMap print order is uncertain, e.g., char_udf1.q, explain_dependency.q
# The iteration order of MapWork.getPathToAliases(), which is already a LinkedHashMap, is still uncertain.

(They also failed on hive trunk clean build on my laptop. I'm using osx 10.9.2 and jdk 1.8.0_05)

I'm uploading the java only patch as an early preview. [~ashutoshc], I'm sorry but could you please help me verify it on your working directory? Thanks!

> Constant propagation optimizer for Hive
> ---------------------------------------
>
>                 Key: HIVE-5771
>                 URL: https://issues.apache.org/jira/browse/HIVE-5771
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Ted Xu
>            Assignee: Ted Xu
>         Attachments: HIVE-5771.1.patch, HIVE-5771.10.patch, HIVE-5771.2.patch, HIVE-5771.3.patch, HIVE-5771.4.patch, HIVE-5771.5.patch, HIVE-5771.6.patch, HIVE-5771.7.patch, HIVE-5771.8.patch, HIVE-5771.9.patch, HIVE-5771.patch, HIVE-5771.patch.javaonly
>
>
> Currently there is no constant folding/propagation optimizer, all expressions are evaluated at runtime. 
> HIVE-2470 did a great job on evaluating constants on UDF initializing phase, however, it is still a runtime evaluation and it doesn't propagate constants from a subquery to outside.
> It may reduce I/O and accelerate process if we introduce such an optimizer.


--
This message was sent by Atlassian JIRA
(v6.2#6252)