Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E606618623 for ; Sun, 28 Jun 2015 18:14:04 +0000 (UTC) Received: (qmail 52700 invoked by uid 500); 28 Jun 2015 18:14:04 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 52672 invoked by uid 500); 28 Jun 2015 18:14:04 -0000 Mailing-List: contact issues-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list issues@drill.apache.org Received: (qmail 52662 invoked by uid 99); 28 Jun 2015 18:14:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 28 Jun 2015 18:14:04 +0000 Date: Sun, 28 Jun 2015 18:14:04 +0000 (UTC) From: "Steven Phillips (JIRA)" To: issues@drill.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (DRILL-3410) Partition Pruning : We are doing a prune when we shouldn't MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/DRILL-3410?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1460= 4818#comment-14604818 ]=20 Steven Phillips commented on DRILL-3410: ---------------------------------------- [~amansinha100], [~jnadeau], [~jni], could one of you review the new patch? > Partition Pruning : We are doing a prune when we shouldn't > ---------------------------------------------------------- > > Key: DRILL-3410 > URL: https://issues.apache.org/jira/browse/DRILL-3410 > Project: Apache Drill > Issue Type: Bug > Components: Query Planning & Optimization > Reporter: Rahul Challapalli > Assignee: Aman Sinha > Priority: Critical > Fix For: 1.1.0 > > Attachments: DRILL-3410.patch, DRILL-3410_part2.patch > > > git.commit.id.abbrev=3D60bc945 > The below plan does not look right. It should scan all the files based on= the filters in the query. Also hive returned more rows than drill > {code} > explain plan for select * from `existing_partition_pruning/lineitempart` = where (dir0=3D1993 and columns[0] >29600) or (dir0=3D1994 or columns[0]>297= 00); > | 00-00 Screen > 00-01 Project(*=3D[$0]) > 00-02 Project(T70=C2=A6=C2=A6*=3D[$0]) > 00-03 SelectionVectorRemover > 00-04 Filter(condition=3D[OR(AND(=3D($1, 1993), >(ITEM($2, 0),= 29600)), =3D($1, 1994), >(ITEM($2, 0), 29700))]) > 00-05 Project(T70=C2=A6=C2=A6*=3D[$0], dir0=3D[$1], columns= =3D[$2]) > 00-06 Scan(groupscan=3D[ParquetGroupScan [entries=3D[ReadE= ntryWithPath [path=3D/drill/testdata/ctas_auto_partition/existing_partition= _pruning/lineitempart/0_0_3.parquet], ReadEntryWithPath [path=3D/drill/test= data/ctas_auto_partition/existing_partition_pruning/lineitempart/0_0_4.parq= uet]], selectionRoot=3D/drill/testdata/ctas_auto_partition/existing_partiti= on_pruning/lineitempart, numFiles=3D2, columns=3D[`*`]]]) > | > {code} > I attached the data set used. Let me know if you need anything more -- This message was sent by Atlassian JIRA (v6.3.4#6332)