drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "amit hadke (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4165) IllegalStateException in MergeJoin for a query against TPC-DS data
Date Mon, 07 Dec 2015 19:39:11 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045560#comment-15045560
] 

amit hadke commented on DRILL-4165:
-----------------------------------

[~amansinha100] I was able to run this query on master

0: jdbc:drill:zk=local> select version from sys.version;
+-----------------+
|     version     |
+-----------------+
| 1.4.0-SNAPSHOT  |
+-----------------+
1 row selected (0.12 seconds)
0: jdbc:drill:zk=local> alter session set `planner.enable_hashjoin` = false;
+-------+-----------------------------------+
|  ok   |              summary              |
+-------+-----------------------------------+
| true  | planner.enable_hashjoin updated.  |
+-------+-----------------------------------+
1 row selected (0.077 seconds)
0: jdbc:drill:zk=local> select count(*) from cp.`tpch/lineitem.parquet` l1, cp.`tpch/lineitem.parquet`
l2 where l1.l_partkey = l2.l_partkey and l1.l_suppkey < 30 and l2.l_suppkey < 30;
+---------+
| EXPR$0  |
+---------+
| 202452  |
+---------+
1 row selected (2.601 seconds)

------------------------------------------------------------------------
git log
commit d855906b95d4182a93af936c4e16888a770039b5
Author: Steven Phillips <smp@apache.org>
Date:   Thu Dec 3 14:01:44 2015 -0800

    DRILL-4159: Remove trailing space

commit f4e34ccac6add649df469f85e38f064962eae90a
Author: Steven Phillips <smp@apache.org>
Date:   Thu Dec 3 13:39:03 2015 -0800

    DRILL-4159: Use test framework in TestCsvHeader

commit 3ae3bf5e127b4384c7b91d797d36ea4d51a058ae
Author: Amit Hadke <amit.hadke@gmail.com>
Date:   Wed Dec 2 14:16:39 2015 -0800

    DRILL-4109 Increase timeout on merge join tests.


> IllegalStateException in MergeJoin for a query against TPC-DS data
> ------------------------------------------------------------------
>
>                 Key: DRILL-4165
>                 URL: https://issues.apache.org/jira/browse/DRILL-4165
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Relational Operators
>    Affects Versions: 1.4.0
>            Reporter: Aman Sinha
>            Assignee: amit hadke
>
> I am seeing the following on the 1.4.0 branch. 
> {noformat}
> 0: jdbc:drill:zk=local> alter session set `planner.enable_hashjoin` = false;
> ..
> 0: jdbc:drill:zk=local> select count(*) from dfs.`tpcds/store_sales` ss1, dfs.`tpcds/store_sales`
ss2 where ss1.ss_customer_sk = ss2.ss_customer_sk and ss1.ss_store_sk = 1 and ss2.ss_store_sk
= 2;
> Error: SYSTEM ERROR: IllegalStateException: Incoming batch [#55, MergeJoinBatch] has
size 1984616, which is beyond the limit of 65536
> Fragment 0:0
> [Error Id: 18bf00fe-52d7-4d84-97ec-b04a035afb4e on 192.168.1.103:31010]
>   (java.lang.IllegalStateException) Incoming batch [#55, MergeJoinBatch] has size 1984616,
which is beyond the limit of 65536
>     org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():305
>     org.apache.drill.exec.record.AbstractRecordBatch.next():119
>     org.apache.drill.exec.record.AbstractRecordBatch.next():109
>     org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
>     org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():132
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message