drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aman Sinha (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-2795) Group-By query on TPC-DS SF100 produces results but does not terminate due to exception
Date Tue, 14 Apr 2015 23:13:59 GMT
Aman Sinha created DRILL-2795:
---------------------------------

             Summary: Group-By query on TPC-DS SF100 produces results but does not terminate
due to exception
                 Key: DRILL-2795
                 URL: https://issues.apache.org/jira/browse/DRILL-2795
             Project: Apache Drill
          Issue Type: Bug
          Components: Execution - Flow
    Affects Versions: 0.9.0
            Reporter: Aman Sinha
            Assignee: Jacques Nadeau


The following simplified group-by query with limit on TPC-DS SF100 eventually produces results
(the performance seems too slow for this scale factor) but does not terminate.  The log files
show an IllegalStateException.  I found that after that first minute or so, all cpu's on the
cluster show 99% idle time.  

{code}
alter session set `planner.slice_target` = 100;
select cr_call_center_sk , cr_catalog_page_sk ,  cr_item_sk , cr_reason_sk , cr_refunded_addr_sk
, cr_refunded_customer_sk  from catalog_returns_dri100 group by cr_call_center_sk, cr_catalog_page_sk,
cr_item_sk, cr_reason_sk, cr_refunded_addr_sk, cr_refunded_customer_sk limit 10;
{code}

Cardinality of the table is relatively small: 
{code}
0: jdbc:drill:schema=dfs.tpcds> select count(*) from catalog_returns_dri100;
+------------+
|   EXPR$0   |
+------------+
| 14404374   |
+------------+
{code}

{code}
2015-04-14 15:41:55,163 ucs-node17.perf.lab [BitServer-3] ERROR o.a.d.exec.rpc.RpcExceptionHandler
- Exception in pipeline.  Closing channel between local /10.10.120.117:31011 and
 remote /10.10.120.109:34899
io.netty.handler.codec.DecoderException: java.lang.IllegalStateException: Get Runnable can
only be run once.
        at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:99)
[netty-codec-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
[netty-codec-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:161)
[netty-codec-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:787)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:130)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511) [netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
[netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382) [netty-transport-4.0.24.Final.jar:4.0.24.Final]
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354) [netty-transport-4.0.24.Final.jar:4.0.24.Final]
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message