Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B964D1016D for ; Thu, 22 Aug 2013 05:58:57 +0000 (UTC) Received: (qmail 77970 invoked by uid 500); 22 Aug 2013 05:58:54 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 77809 invoked by uid 500); 22 Aug 2013 05:58:54 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 77767 invoked by uid 500); 22 Aug 2013 05:58:52 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 77761 invoked by uid 99); 22 Aug 2013 05:58:52 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Aug 2013 05:58:52 +0000 Date: Thu, 22 Aug 2013 05:58:52 +0000 (UTC) From: "Phabricator (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-4293) Predicates following UDTF operator are removed by PPD MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-4293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4293: ------------------------------ Attachment: HIVE-4293.D9933.5.patch navis updated the revision "HIVE-4293 [jira] Predicates following UDTF operator are removed by PPD". Rebased to trunk Reviewers: JIRA REVISION DETAIL https://reviews.facebook.net/D9933 CHANGE SINCE LAST DIFF https://reviews.facebook.net/D9933?vs=35949&id=38595#toc AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/exec/LateralViewJoinOperator.java ql/src/java/org/apache/hadoop/hive/ql/exec/ReduceSinkOperator.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/ColumnPrunerProcFactory.java ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/plan/LateralViewJoinDesc.java ql/src/java/org/apache/hadoop/hive/ql/ppd/ExprWalkerInfo.java ql/src/java/org/apache/hadoop/hive/ql/ppd/OpProcFactory.java ql/src/java/org/apache/hadoop/hive/ql/ppd/PredicatePushDown.java ql/src/test/queries/clientpositive/lateral_view_ppd.q ql/src/test/queries/clientpositive/ppd_udtf.q ql/src/test/results/clientpositive/cluster.q.out ql/src/test/results/clientpositive/ctas_colname.q.out ql/src/test/results/clientpositive/lateral_view_ppd.q.out ql/src/test/results/clientpositive/ppd2.q.out ql/src/test/results/clientpositive/ppd_gby.q.out ql/src/test/results/clientpositive/ppd_gby2.q.out ql/src/test/results/clientpositive/ppd_udtf.q.out ql/src/test/results/clientpositive/udtf_json_tuple.q.out ql/src/test/results/clientpositive/udtf_parse_url_tuple.q.out ql/src/test/results/compiler/plan/join1.q.xml ql/src/test/results/compiler/plan/join2.q.xml ql/src/test/results/compiler/plan/join3.q.xml ql/src/test/results/compiler/plan/join4.q.xml ql/src/test/results/compiler/plan/join5.q.xml ql/src/test/results/compiler/plan/join6.q.xml ql/src/test/results/compiler/plan/join7.q.xml ql/src/test/results/compiler/plan/join8.q.xml To: JIRA, navis > Predicates following UDTF operator are removed by PPD > ----------------------------------------------------- > > Key: HIVE-4293 > URL: https://issues.apache.org/jira/browse/HIVE-4293 > Project: Hive > Issue Type: Bug > Components: Query Processor > Reporter: Navis > Assignee: Navis > Attachments: HIVE-4293.D9933.1.patch, HIVE-4293.D9933.2.patch, HIVE-4293.D9933.3.patch, HIVE-4293.D9933.4.patch, HIVE-4293.D9933.5.patch > > > For example, > {noformat} > explain SELECT value from ( > select explode(array(key, value)) as (value) from ( > select * FROM src WHERE key > 200 > ) A > ) B WHERE value > 300 > ; > {noformat} > Makes plan like this, removing last predicates > {noformat} > TableScan > alias: src > Filter Operator > predicate: > expr: (key > 200.0) > type: boolean > Select Operator > expressions: > expr: array(key,value) > type: array > outputColumnNames: _col0 > UDTF Operator > function name: explode > Select Operator > expressions: > expr: col > type: string > outputColumnNames: _col0 > File Output Operator > compressed: false > GlobalTableId: 0 > table: > input format: org.apache.hadoop.mapred.TextInputFormat > output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira