drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacques Nadeau (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (DRILL-1630) CorruptedFrameException when querying larger data set
Date Mon, 17 Nov 2014 01:53:36 GMT

     [ https://issues.apache.org/jira/browse/DRILL-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jacques Nadeau resolved DRILL-1630.
-----------------------------------
    Resolution: Cannot Reproduce

> CorruptedFrameException when querying larger data set
> -----------------------------------------------------
>
>                 Key: DRILL-1630
>                 URL: https://issues.apache.org/jira/browse/DRILL-1630
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - RPC
>    Affects Versions: 0.6.0
>            Reporter: Aman Sinha
>            Assignee: Parth Chandra
>
> When querying a private data set that has about 4B row fact table  of CSV data and doing
left outer joins with 6 dimension tables, one of which has 40M rows,   I have seen the following
2 types of CorruptedFrameException.  The first one occurred on a 4 node cluster, but the second
stack trace is from a single node execution. 
> {code}
> 2014-10-29 21:01:48,279 [BitServer-6] ERROR o.a.d.exec.rpc.RpcExceptionHandler - Exception
in pipeline.  Closing channel between local /10.10.100.173:31012 and remote /10.10.100.174:48664
> io.netty.handler.codec.CorruptedFrameException: Received a message of length 0.
>         at org.apache.drill.exec.rpc.ProtobufLengthDecoder.decode(ProtobufLengthDecoder.java:74)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
>         at org.apache.drill.exec.rpc.data.DataProtobufLengthDecoder.decode(DataProtobufLengthDecoder.java:38)
~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
> {code} 
> and 
> {code}
> 2014-10-29 06:33:03,988 [BitServer-5] ERROR o.a.d.exec.rpc.RpcExceptionHandler - Exception
in pipeline.  Closing channel between local /10.10.100.171:31012 and remote /10.10.100.171:46069
> io.netty.handler.codec.CorruptedFrameException: Expected to read a tag of 10 but actually
received a value of 53.  Happened after reading 271790 message.
>         at org.apache.drill.exec.rpc.RpcDecoder.checkTag(RpcDecoder.java:126) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
>         at org.apache.drill.exec.rpc.RpcDecoder.decode(RpcDecoder.java:61) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
>         at org.apache.drill.exec.rpc.RpcDecoder.decode(RpcDecoder.java:35) ~[drill-java-exec-0.7.0-incubating-SNAPSHOT-rebuffed.jar:0.7.0-incubating-SNAPSHOT]
>         at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
~[netty-codec-4.0.20.Final.jar:4.0.20.Final]
>         at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:332)
[netty-transport-4.0.20.Final.jar:4.0.20.Final]
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message