drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aman Sinha (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (DRILL-4165) IllegalStateException in MergeJoin for a query against TPC-DS data
Date Mon, 07 Dec 2015 03:42:10 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044322#comment-15044322
] 

Aman Sinha edited comment on DRILL-4165 at 12/7/15 3:42 AM:
------------------------------------------------------------

This query also fails on 1.3.0 with merge join  although the stack is slightly different:
{noformat}
0: jdbc:drill:zk=local> select version from sys.version;
+----------+
| version  |
+----------+
| 1.3.0    |
+----------+
0: jdbc:drill:zk=local> alter session set `planner.enable_hashjoin` = false;
...
0: jdbc:drill:zk=local> select count(*) from dfs.`/Users/asinha/data/tpcds/store_sales`
ss1, dfs.`/Users/asinha/data/tpcds/store_sales` ss2 where ss1.ss_customer_sk = ss2.ss_customer_sk
and ss1.ss_store_sk = 1 and ss2.ss_store_sk = 2;
Error: SYSTEM ERROR: IllegalArgumentException

  (java.lang.IllegalArgumentException) null
    com.google.common.base.Preconditions.checkArgument():76
    org.apache.drill.exec.record.RecordIterator.getCurrentPosition():242
    org.apache.drill.exec.test.generated.JoinWorkerGen15.doJoin():89
    org.apache.drill.exec.physical.impl.join.MergeJoinBatch.innerNext():206
{noformat}



was (Author: amansinha100):
This query also fails on 1.3.0 with merge join  although the stack is slightly different:
{noformat}
0: jdbc:drill:zk=local> select count(*) from dfs.`/Users/asinha/data/tpcds/store_sales`
ss1, dfs.`/Users/asinha/data/tpcds/store_sales` ss2 where ss1.ss_customer_sk = ss2.ss_customer_sk
and ss1.ss_store_sk = 1 and ss2.ss_store_sk = 2;
Error: SYSTEM ERROR: IllegalArgumentException

  (java.lang.IllegalArgumentException) null
    com.google.common.base.Preconditions.checkArgument():76
    org.apache.drill.exec.record.RecordIterator.getCurrentPosition():242
    org.apache.drill.exec.test.generated.JoinWorkerGen15.doJoin():89
    org.apache.drill.exec.physical.impl.join.MergeJoinBatch.innerNext():206
{noformat}


> IllegalStateException in MergeJoin for a query against TPC-DS data
> ------------------------------------------------------------------
>
>                 Key: DRILL-4165
>                 URL: https://issues.apache.org/jira/browse/DRILL-4165
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Relational Operators
>    Affects Versions: 1.4.0
>            Reporter: Aman Sinha
>
> I am seeing the following on the 1.4.0 branch. 
> {noformat}
> 0: jdbc:drill:zk=local> alter session set `planner.enable_hashjoin` = false;
> ..
> 0: jdbc:drill:zk=local> select count(*) from dfs.`tpcds/store_sales` ss1, dfs.`tpcds/store_sales`
ss2 where ss1.ss_customer_sk = ss2.ss_customer_sk and ss1.ss_store_sk = 1 and ss2.ss_store_sk
= 2;
> Error: SYSTEM ERROR: IllegalStateException: Incoming batch [#55, MergeJoinBatch] has
size 1984616, which is beyond the limit of 65536
> Fragment 0:0
> [Error Id: 18bf00fe-52d7-4d84-97ec-b04a035afb4e on 192.168.1.103:31010]
>   (java.lang.IllegalStateException) Incoming batch [#55, MergeJoinBatch] has size 1984616,
which is beyond the limit of 65536
>     org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next():305
>     org.apache.drill.exec.record.AbstractRecordBatch.next():119
>     org.apache.drill.exec.record.AbstractRecordBatch.next():109
>     org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext():51
>     org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext():132
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message