drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Hou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-5901) Drill test framework can have successful run even if a random failure occurs
Date Mon, 23 Oct 2017 23:40:00 GMT

    [ https://issues.apache.org/jira/browse/DRILL-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216070#comment-16216070
] 

Robert Hou commented on DRILL-5901:
-----------------------------------

If you look at the nightly run, TPCH-SF100-baseline is shown as green.  So I assume tests
pass, and the nightly run is a success.  If you look into the test run, there is a random
failure that needs to be reported.

> Drill test framework can have successful run even if a random failure occurs
> ----------------------------------------------------------------------------
>
>                 Key: DRILL-5901
>                 URL: https://issues.apache.org/jira/browse/DRILL-5901
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Tools, Build & Test
>    Affects Versions: 1.11.0
>            Reporter: Robert Hou
>
> From Jenkins:
> http://10.10.104.91:8080/view/Nightly/job/TPCH-SF100-baseline/574/console
> Random Failures:
> /root/drillAutomation/framework-master/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query17.sql
> Query: 
> SELECT
>   SUM(L.L_EXTENDEDPRICE) / 7.0 AS AVG_YEARLY
> FROM
>   lineitem L,
>   part P
> WHERE
>   P.P_PARTKEY = L.L_PARTKEY
>   AND P.P_BRAND = 'BRAND#13'
>   AND P.P_CONTAINER = 'JUMBO CAN'
>   AND L.L_QUANTITY < (
>     SELECT
>       0.2 * AVG(L2.L_QUANTITY)
>     FROM
>       lineitem L2
>     WHERE
>       L2.L_PARTKEY = P.P_PARTKEY
>   )
> Failed with exception
> java.sql.SQLException: SYSTEM ERROR: IllegalStateException: Memory was leaked by query.
Memory leaked: (2097152)
> Allocator(op:8:2:6:ParquetRowGroupScan) 1000000/0/7675904/10000000000 (res/actual/peak/limit)
> Fragment 8:2
> [Error Id: f21a2560-7259-4e13-88c2-9bac29e2930a on atsqa6c88.qa.lab:31010]
>   (java.lang.IllegalStateException) Memory was leaked by query. Memory leaked: (2097152)
> Allocator(op:8:2:6:ParquetRowGroupScan) 1000000/0/7675904/10000000000 (res/actual/peak/limit)
>     org.apache.drill.exec.memory.BaseAllocator.close():519
>     org.apache.drill.exec.ops.AbstractOperatorExecContext.close():86
>     org.apache.drill.exec.ops.OperatorContextImpl.close():108
>     org.apache.drill.exec.ops.FragmentContext.suppressingClose():435
>     org.apache.drill.exec.ops.FragmentContext.close():424
>     org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources():324
>     org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup():155
>     org.apache.drill.exec.work.fragment.FragmentExecutor.run():267
>     org.apache.drill.common.SelfCleaningRunnable.run():38
>     java.util.concurrent.ThreadPoolExecutor.runWorker():1145
>     java.util.concurrent.ThreadPoolExecutor$Worker.run():615
>     java.lang.Thread.run():744
> 	at org.apache.drill.jdbc.impl.DrillCursor.nextRowInternally(DrillCursor.java:489)
> 	at org.apache.drill.jdbc.impl.DrillCursor.loadInitialSchema(DrillCursor.java:561)
> 	at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:1895)
> 	at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:61)
> 	at oadd.org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:473)
> 	at org.apache.drill.jdbc.impl.DrillMetaImpl.prepareAndExecute(DrillMetaImpl.java:1100)
> 	at oadd.org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:477)
> 	at org.apache.drill.jdbc.impl.DrillConnectionImpl.prepareAndExecuteInternal(DrillConnectionImpl.java:181)
> 	at oadd.org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:110)
> 	at oadd.org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:130)
> 	at org.apache.drill.jdbc.impl.DrillStatementImpl.executeQuery(DrillStatementImpl.java:112)
> 	at org.apache.drill.test.framework.DrillTestJdbc.executeQuery(DrillTestJdbc.java:206)
> 	at org.apache.drill.test.framework.DrillTestJdbc.run(DrillTestJdbc.java:115)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:744)
> Caused by: oadd.org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
IllegalStateException: Memory was leaked by query. Memory leaked: (2097152)
> Allocator(op:8:2:6:ParquetRowGroupScan) 1000000/0/7675904/10000000000 (res/actual/peak/limit)
> Fragment 8:2
> [Error Id: f21a2560-7259-4e13-88c2-9bac29e2930a on atsqa6c88.qa.lab:31010]
>   (java.lang.IllegalStateException) Memory was leaked by query. Memory leaked: (2097152)
> Allocator(op:8:2:6:ParquetRowGroupScan) 1000000/0/7675904/10000000000 (res/actual/peak/limit)
>     org.apache.drill.exec.memory.BaseAllocator.close():519
>     org.apache.drill.exec.ops.AbstractOperatorExecContext.close():86
>     org.apache.drill.exec.ops.OperatorContextImpl.close():108
>     org.apache.drill.exec.ops.FragmentContext.suppressingClose():435
>     org.apache.drill.exec.ops.FragmentContext.close():424
>     org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources():324
>     org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup():155
>     org.apache.drill.exec.work.fragment.FragmentExecutor.run():267
>     org.apache.drill.common.SelfCleaningRunnable.run():38
>     java.util.concurrent.ThreadPoolExecutor.runWorker():1145
>     java.util.concurrent.ThreadPoolExecutor$Worker.run():615
>     java.lang.Thread.run():744
> 	at oadd.org.apache.drill.exec.rpc.user.QueryResultHandler.resultArrived(QueryResultHandler.java:123)
> 	at oadd.org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:465)
> 	at oadd.org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:102)
> 	at oadd.org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:274)
> 	at oadd.org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:244)
> 	at oadd.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
> 	at oadd.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
> 	at oadd.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
> 	at oadd.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
> 	at oadd.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
> 	at oadd.io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
> 	at oadd.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1294)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
> 	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
> 	at oadd.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:911)
> 	at oadd.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
> 	at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645)
> 	at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
> 	at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
> 	at oadd.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
> 	at oadd.io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
> 	... 1 more
> ----------------------------------------------------------------------------------------------------------------
> Summary
> ----------------------------------------------------------------------------------------------------------------
> Random Failures:
> ----------------------------------------------------------------------------------------------------------------
> /root/drillAutomation/framework-master/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query17.sql
> ----------------------------------------------------------------------------------------------------------------
> Passing tests: 365
> Execution Failures: 0
> Data Verification Failures: 0
> Plan Verification Failures: 0
> Timeouts: 0
> Canceled: 0
> Random Failures: 1
> > TEARING DOWN..
> version	commit_id	commit_message	commit_time	build_email	build_time
> 1.12.0-SNAPSHOT	b0c4e0486d6d4620b04a1bb8198e959d433b4840	DRILL-5876: Use openssl profile
to include netty-tcnative dependency with the platform specific classifier	20.10.2017 @ 16:52:35
PDT	Unknown	20.10.2017 @ 16:55:44 PDT
> hostname	user_port	control_port	data_port	current	version
> atsqa6c88.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
> atsqa6c82.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
> atsqa6c86.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
> atsqa6c87.qa.lab	31010	31011	31012	true	1.12.0-SNAPSHOT
> atsqa6c85.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
> atsqa6c83.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
> atsqa6c81.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
> atsqa6c80.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
> ok	summary
> true	ALL updated.
> Session: 0x15d324dfe10ee1e closed
> EventThread shut down
> Session: 0x15d324dfe10ee1f closed
> EventThread shut down
> Running command: /root/drillAutomation/framework-master/framework/scripts/restart_drill_script
> ----------------------------------------------------------------------------------------------------------------
> FINISHED AT Mon Oct 23 10:39:07 PDT 2017
> TOTAL DURATION: 36.21 min
> ----------------------------------------------------------------------------------------------------------------
> ----------------------------------------------------------------------------------------------------------------
> [PostBuildScript] - Execution post build scripts.
> [TPCH-SF100-baseline] $ /bin/sh -xe /tmp/hudson5203439872152590056.sh
> + TAG=jenkins-TPCH-SF100-baseline-574
> + mkdir /home/MAPRTECH/drill/logs/archive/jenkins-TPCH-SF100-baseline-574
> + clush -a 'mkdir /home/MAPRTECH/drill/logs/archive/jenkins-TPCH-SF100-baseline-574/$HOSTNAME'
> + clush -a 'mv /var/log/drill/* /home/MAPRTECH/drill/logs/archive/jenkins-TPCH-SF100-baseline-574/$HOSTNAME'
> Warning: you have no plugins providing access control for builds, so falling back to
legacy behavior of permitting any downstream builds to be triggered
> Triggering a new build of Advanced-Baseline
> Triggering a new build of md-1115
> Finished: SUCCESS



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message