drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jinfeng Ni (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-2107) Hash Join throw IOBE for a query with exists subquery.
Date Thu, 29 Jan 2015 01:06:34 GMT
Jinfeng Ni created DRILL-2107:

             Summary: Hash Join throw IOBE for a query with exists subquery. 
                 Key: DRILL-2107
                 URL: https://issues.apache.org/jira/browse/DRILL-2107
             Project: Apache Drill
          Issue Type: New Feature
          Components: Execution - Operators
            Reporter: Jinfeng Ni
            Assignee: Chris Westin
            Priority: Critical

I hit an IOBE for TestTpchDistributed Q4, when I tried to enable an optimizer rule.  Then,
I simplified Q4 to the following, and still re-produce the same IOBE.

  cp.`tpch/orders.parquet` o
  exists (
      cp.`tpch/lineitem.parquet` l
      l.l_orderkey = o.o_orderkey

Stack trace of the exception:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
     at java.util.ArrayList.rangeCheck(ArrayList.java:635) ~[na:1.7.0_45]
     at java.util.ArrayList.get(ArrayList.java:411) ~[na:1.7.0_45]
     at org.apache.drill.exec.record.VectorContainer.getValueAccessorById(VectorContainer.java:232)
     at org.apache.drill.exec.record.RecordBatchLoader.getValueAccessorById(RecordBatchLoader.java:149)
     at org.apache.drill.exec.physical.impl.unorderedreceiver.UnorderedReceiverBatch.getValueAccessorById(UnorderedReceiverBatch.java:132)
     at org.apache.drill.exec.test.generated.HashTableGen307.doSetup(HashTableTemplate.java:71)
     at org.apache.drill.exec.test.generated.HashTableGen307.updateBatches(HashTableTemplate.java:473)
     at org.apache.drill.exec.test.generated.HashJoinProbeGen313.executeProbePhase(HashJoinProbeTemplate.java:139)
     at org.apache.drill.exec.test.generated.HashJoinProbeGen313.probeAndProject(HashJoinProbeTemplate.java:223)
     at org.apache.drill.exec.physical.impl.join.HashJoinBatch.innerNext(HashJoinBatch.java:227)

The physical plan seems to be correct, after enabling the new rule. Actually, if I disable
HashJoin, and use merge join for the query, it works fine. So, seems the IOBE exposes some
bug in HashJoin.

To re-produce this issue,  two options:
 1 )  - Modify DrillRuleSets.java, remove the comment before SwapJoinRule 
       - alter session set `planner.slice_target` = 10;
       - run the query
 2) use the attached physical plan in json file, and use "submitplan" to submit the physical

For comparison, I also attached the physical plan when disabling hashjoin (use merge join),
and the explain plan at physical operator level. 

This message was sent by Atlassian JIRA

View raw message