Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4AF229CE0 for ; Wed, 8 Feb 2012 06:33:49 +0000 (UTC) Received: (qmail 37826 invoked by uid 500); 8 Feb 2012 06:33:48 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 37145 invoked by uid 500); 8 Feb 2012 06:33:27 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 37110 invoked by uid 500); 8 Feb 2012 06:33:22 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 37088 invoked by uid 99); 8 Feb 2012 06:33:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 06:33:20 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Feb 2012 06:33:19 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 7BABE1A9BE9 for ; Wed, 8 Feb 2012 06:32:59 +0000 (UTC) Date: Wed, 8 Feb 2012 06:32:59 +0000 (UTC) From: "Hudson (Commented) (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: <1331915097.13458.1328682779508.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1057048577.5156.1328572259249.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HIVE-2779) Improve hooks run in Driver MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203311#comment-13203311 ] Hudson commented on HIVE-2779: ------------------------------ Integrated in Hive-trunk-h0.21 #1247 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1247/]) HIVE-2779 Improve Hooks run in Driver (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241729 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHook.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContextImpl.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyHooksRunInOrder.java * /hive/trunk/ql/src/test/queries/clientpositive/hook_order.q * /hive/trunk/ql/src/test/results/clientnegative/bad_exec_hooks.q.out * /hive/trunk/ql/src/test/results/clientpositive/hook_order.q.out > Improve hooks run in Driver > --------------------------- > > Key: HIVE-2779 > URL: https://issues.apache.org/jira/browse/HIVE-2779 > Project: Hive > Issue Type: Improvement > Reporter: Kevin Wilfong > Assignee: Kevin Wilfong > Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch, HIVE-2779.D1599.3.patch > > > There are some small improvements that can be made to the hooks which are run in the Driver: > 1) The code to get hooks has been clearly just been copy+pasted for each of Pre/Post/OnFailure/SemanticAnalyzer hooks. This code should be consolidated into a single method. > 2) There is a lot more information available to SemanticAnalyzer hooks which ran after semantic analysis than to those that run before, such as inputs and outputs. We should make some of this information available to those hooks, preferably through HiveSemanticAnalyzerHookContext, so that existing hooks aren't broken. > 3) Currently, possibly unintentionally, hooks are initialized and run in the order they appear in the comma separated list that is the value of the configuration variable. This is a useful property, we should add comments indicating this is desired and add a unit test to enforce it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira