Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7983E1880B for ; Tue, 18 Aug 2015 22:15:47 +0000 (UTC) Received: (qmail 50269 invoked by uid 500); 18 Aug 2015 22:15:47 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 49943 invoked by uid 500); 18 Aug 2015 22:15:47 -0000 Mailing-List: contact issues-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list issues@drill.apache.org Received: (qmail 49824 invoked by uid 99); 18 Aug 2015 22:15:47 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Aug 2015 22:15:47 +0000 Date: Tue, 18 Aug 2015 22:15:47 +0000 (UTC) From: "Rahul Challapalli (JIRA)" To: issues@drill.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (DRILL-3667) Random Assertion Error while planning MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/DRILL-3667?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Challapalli updated DRILL-3667: ------------------------------------- Attachment: hive.ddl error.log lineitem_hierarchical_intint.tar > Random Assertion Error while planning > ------------------------------------- > > Key: DRILL-3667 > URL: https://issues.apache.org/jira/browse/DRILL-3667 > Project: Apache Drill > Issue Type: Bug > Components: Query Planning & Optimization > Affects Versions: 1.2.0 > Reporter: Rahul Challapalli > Assignee: Jinfeng Ni > Priority: Critical > Fix For: 1.2.0 > > Attachments: error.log, hive.ddl, lineitem_hierarchical_intint.ta= r > > > git.commit.id.abbrev=3Db55e232 > When assertions are enabled, the below query produces an Assertion Error = randomly. > {code} > explain plan for select l_orderkey, l_partkey, l_quantity, l_shipdate, l_= shipinstruct, `year`, `month` from hive.lineitem_text_partitioned_hive_hier= _intint where (`year` IN (negative(-1993)) and `month`=3Dsqrt(100)) or (`ye= ar` IN (cast(abs(-1994.0) as int)) and `month`=3Dcast('5' as int)); > {code} > When Assertions are disabled, we randomly get a wrong plan where we prune= away things which we should not have pruned resulting in wrong results. Ag= ain this is random. =20 > Wrong Plan > {code} > 00-00 Screen > 00-01 Project(l_orderkey=3D[$0], l_partkey=3D[$1], l_quantity=3D[$2]= , l_shipdate=3D[$3], l_shipinstruct=3D[$4], year=3D[$5], month=3D[$6]) > 00-02 Project(l_orderkey=3D[$0], l_partkey=3D[$1], l_quantity=3D[$= 2], l_shipdate=3D[$3], l_shipinstruct=3D[$4], year=3D[$5], month=3D[$6]) > 00-03 SelectionVectorRemover > 00-04 Filter(condition=3D[OR(AND(=3D($5, NEGATIVE(-1993)), =3D= (CAST($6):DOUBLE, 1E1)), AND(=3D($5, 1994), =3D($6, CAST('5'):INTEGER NOT N= ULL)))]) > 00-05 Project(l_orderkey=3D[$0], l_partkey=3D[$2], l_quantit= y=3D[$6], l_shipdate=3D[$4], l_shipinstruct=3D[$1], year=3D[$3], month=3D[$= 5]) > 00-06 Scan(groupscan=3D[HiveScan [table=3DTable(dbName:def= ault, tableName:lineitem_text_partitioned_hive_hier_intint), inputSplits=3D= [maprfs:///drill/testdata/partition_pruning/hive/text/lineitem_hierarchical= _intint/1991/10/lineitemaj.tbl:0+106646, maprfs:///drill/testdata/partition= _pruning/hive/text/lineitem_hierarchical_intint/1992/10/lineitemaj.tbl:0+10= 7653, maprfs:///drill/testdata/partition_pruning/hive/text/lineitem_hierarc= hical_intint/1993/10/lineitemaj.tbl:0+107386, maprfs:///drill/testdata/part= ition_pruning/hive/text/lineitem_hierarchical_intint/1994/10/lineitemaj.tbl= :0+107846, maprfs:///drill/testdata/partition_pruning/hive/text/lineitem_hi= erarchical_intint/1995/10/lineitemaj.tbl:0+107581, maprfs:///drill/testdata= /partition_pruning/hive/text/lineitem_hierarchical_intint/1996/10/lineitema= j.tbl:0+107072, maprfs:///drill/testdata/partition_pruning/hive/text/lineit= em_hierarchical_intint/1997/10/lineitemaj.tbl:0+1786], columns=3D[`l_orderk= ey`, `l_partkey`, `l_quantity`, `l_shipdate`, `l_shipinstruct`, `year`, `mo= nth`], partitions=3D [Partition(values:[1991, 10]), Partition(values:[1992,= 10]), Partition(values:[1993, 10]), Partition(values:[1994, 10]), Partitio= n(values:[1995, 10]), Partition(values:[1996, 10]), Partition(values:[1997,= 10])]]]) > {code} > Right Plan > {code} > 00-00 Screen > 00-01 Project(l_orderkey=3D[$0], l_partkey=3D[$1], l_quantity=3D[$2]= , l_shipdate=3D[$3], l_shipinstruct=3D[$4], year=3D[$5], month=3D[$6]) > 00-02 Project(l_orderkey=3D[$0], l_partkey=3D[$1], l_quantity=3D[$= 2], l_shipdate=3D[$3], l_shipinstruct=3D[$4], year=3D[$5], month=3D[$6]) > 00-03 Project(l_orderkey=3D[$0], l_partkey=3D[$2], l_quantity=3D= [$6], l_shipdate=3D[$4], l_shipinstruct=3D[$1], year=3D[$3], month=3D[$5]) > 00-04 Scan(groupscan=3D[HiveScan [table=3DTable(dbName:default= , tableName:lineitem_text_partitioned_hive_hier_intint), inputSplits=3D[map= rfs:///drill/testdata/partition_pruning/hive/text/lineitem_hierarchical_int= int/1993/10/lineitemaj.tbl:0+107386, maprfs:///drill/testdata/partition_pru= ning/hive/text/lineitem_hierarchical_intint/1994/5/lineitemae.tbl:0+107451]= , columns=3D[`l_orderkey`, `l_partkey`, `l_quantity`, `l_shipdate`, `l_ship= instruct`, `year`, `month`], partitions=3D [Partition(values:[1993, 10]), P= artition(values:[1994, 5])]]]) > {code} > I attached the data and the stack trace when we got an assertion error. L= et me know if you need something. -- This message was sent by Atlassian JIRA (v6.3.4#6332)