Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 30CCE10930 for ; Fri, 14 Nov 2014 02:33:57 +0000 (UTC) Received: (qmail 38243 invoked by uid 500); 14 Nov 2014 02:33:56 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 38217 invoked by uid 500); 14 Nov 2014 02:33:56 -0000 Mailing-List: contact issues-help@drill.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.incubator.apache.org Delivered-To: mailing list issues@drill.incubator.apache.org Received: (qmail 38208 invoked by uid 99); 14 Nov 2014 02:33:56 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Nov 2014 02:33:56 +0000 X-ASF-Spam-Status: No, hits=-2000.6 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 14 Nov 2014 02:33:55 +0000 Received: (qmail 37704 invoked by uid 99); 14 Nov 2014 02:33:35 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Nov 2014 02:33:35 +0000 Date: Fri, 14 Nov 2014 02:33:35 +0000 (UTC) From: "Rahul Challapalli (JIRA)" To: issues@drill.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (DRILL-1610) Partition pruning not scanning all the required partitions when we have hierarchical partitions MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/DRILL-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14211732#comment-14211732 ] Rahul Challapalli commented on DRILL-1610: ------------------------------------------ Tested this with the latest build (git.commit.id.abbrev=fd54e71). However drill now seems to be scanning all the partitions, effectively ignoring the filters while scanning. > Partition pruning not scanning all the required partitions when we have hierarchical partitions > ----------------------------------------------------------------------------------------------- > > Key: DRILL-1610 > URL: https://issues.apache.org/jira/browse/DRILL-1610 > Project: Apache Drill > Issue Type: Bug > Components: Query Planning & Optimization > Affects Versions: 0.7.0 > Reporter: Rahul Challapalli > Attachments: DRILL-1610.patch, explain_plan_dfs.txt, explain_plan_hive.txt, hive.ddl, lineitem_hierarchical.zip > > > git.commit.id.abbrev=6dca24a > My data is organized in such a way that we have multiple year partitions and each year partition has 12 month partitions. > Now the below query should look for all the records > 1. all months under 1993 > 2. under the month 'dec' for all the years > However drill seems to be ignoring the second case. This is happening with hive and dfs. > Below are the queries : > DFS : > {code} > explain plan for select > l_orderkey, > l_partkey, > l_quantity, > l_shipdate, > l_shipinstruct > from hive.lineitem_hierarchical where (`year` IN (1993) and l_orderkey>29600) or `month` IN ('dec'); > {code} > Hive : > {code} > explain plan for select columns[0], > columns[1], > columns[4], > columns[10], > columns[13] > from `/lineitem_hierarchical` where (dir0=1993 and columns[0]>29600) or dir1='dec'; > {code} > Attached the sample data, hive ddl, and the explain plan outputs -- This message was sent by Atlassian JIRA (v6.3.4#6332)