drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Hou (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5901) Drill test framework can have successful run even if a random failure occurs
Date Mon, 23 Oct 2017 23:28:00 GMT
Robert Hou created DRILL-5901:
---------------------------------

             Summary: Drill test framework can have successful run even if a random failure
occurs
                 Key: DRILL-5901
                 URL: https://issues.apache.org/jira/browse/DRILL-5901
             Project: Apache Drill
          Issue Type: Bug
          Components: Tools, Build & Test
    Affects Versions: 1.11.0
            Reporter: Robert Hou


Random Failures:
/root/drillAutomation/framework-master/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query17.sql
Query: 
SELECT
  SUM(L.L_EXTENDEDPRICE) / 7.0 AS AVG_YEARLY
FROM
  lineitem L,
  part P
WHERE
  P.P_PARTKEY = L.L_PARTKEY
  AND P.P_BRAND = 'BRAND#13'
  AND P.P_CONTAINER = 'JUMBO CAN'
  AND L.L_QUANTITY < (
    SELECT
      0.2 * AVG(L2.L_QUANTITY)
    FROM
      lineitem L2
    WHERE
      L2.L_PARTKEY = P.P_PARTKEY
  )
Failed with exception
java.sql.SQLException: SYSTEM ERROR: IllegalStateException: Memory was leaked by query. Memory
leaked: (2097152)
Allocator(op:8:2:6:ParquetRowGroupScan) 1000000/0/7675904/10000000000 (res/actual/peak/limit)


Fragment 8:2

[Error Id: f21a2560-7259-4e13-88c2-9bac29e2930a on atsqa6c88.qa.lab:31010]

  (java.lang.IllegalStateException) Memory was leaked by query. Memory leaked: (2097152)
Allocator(op:8:2:6:ParquetRowGroupScan) 1000000/0/7675904/10000000000 (res/actual/peak/limit)

    org.apache.drill.exec.memory.BaseAllocator.close():519
    org.apache.drill.exec.ops.AbstractOperatorExecContext.close():86
    org.apache.drill.exec.ops.OperatorContextImpl.close():108
    org.apache.drill.exec.ops.FragmentContext.suppressingClose():435
    org.apache.drill.exec.ops.FragmentContext.close():424
    org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources():324
    org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup():155
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():267
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1145
    java.util.concurrent.ThreadPoolExecutor$Worker.run():615
    java.lang.Thread.run():744

	at org.apache.drill.jdbc.impl.DrillCursor.nextRowInternally(DrillCursor.java:489)
	at org.apache.drill.jdbc.impl.DrillCursor.loadInitialSchema(DrillCursor.java:561)
	at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:1895)
	at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:61)
	at oadd.org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:473)
	at org.apache.drill.jdbc.impl.DrillMetaImpl.prepareAndExecute(DrillMetaImpl.java:1100)
	at oadd.org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:477)
	at org.apache.drill.jdbc.impl.DrillConnectionImpl.prepareAndExecuteInternal(DrillConnectionImpl.java:181)
	at oadd.org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:110)
	at oadd.org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:130)
	at org.apache.drill.jdbc.impl.DrillStatementImpl.executeQuery(DrillStatementImpl.java:112)
	at org.apache.drill.test.framework.DrillTestJdbc.executeQuery(DrillTestJdbc.java:206)
	at org.apache.drill.test.framework.DrillTestJdbc.run(DrillTestJdbc.java:115)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:744)
Caused by: oadd.org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: IllegalStateException:
Memory was leaked by query. Memory leaked: (2097152)
Allocator(op:8:2:6:ParquetRowGroupScan) 1000000/0/7675904/10000000000 (res/actual/peak/limit)


Fragment 8:2

[Error Id: f21a2560-7259-4e13-88c2-9bac29e2930a on atsqa6c88.qa.lab:31010]

  (java.lang.IllegalStateException) Memory was leaked by query. Memory leaked: (2097152)
Allocator(op:8:2:6:ParquetRowGroupScan) 1000000/0/7675904/10000000000 (res/actual/peak/limit)

    org.apache.drill.exec.memory.BaseAllocator.close():519
    org.apache.drill.exec.ops.AbstractOperatorExecContext.close():86
    org.apache.drill.exec.ops.OperatorContextImpl.close():108
    org.apache.drill.exec.ops.FragmentContext.suppressingClose():435
    org.apache.drill.exec.ops.FragmentContext.close():424
    org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources():324
    org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup():155
    org.apache.drill.exec.work.fragment.FragmentExecutor.run():267
    org.apache.drill.common.SelfCleaningRunnable.run():38
    java.util.concurrent.ThreadPoolExecutor.runWorker():1145
    java.util.concurrent.ThreadPoolExecutor$Worker.run():615
    java.lang.Thread.run():744

	at oadd.org.apache.drill.exec.rpc.user.QueryResultHandler.resultArrived(QueryResultHandler.java:123)
	at oadd.org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:465)
	at oadd.org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:102)
	at oadd.org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:274)
	at oadd.org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:244)
	at oadd.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
	at oadd.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
	at oadd.io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
	at oadd.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
	at oadd.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
	at oadd.io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
	at oadd.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1294)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
	at oadd.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
	at oadd.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:911)
	at oadd.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
	at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645)
	at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
	at oadd.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
	at oadd.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
	at oadd.io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
	... 1 more
----------------------------------------------------------------------------------------------------------------

Summary
----------------------------------------------------------------------------------------------------------------

Random Failures:
----------------------------------------------------------------------------------------------------------------

/root/drillAutomation/framework-master/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query17.sql
----------------------------------------------------------------------------------------------------------------


Passing tests: 365
Execution Failures: 0
Data Verification Failures: 0
Plan Verification Failures: 0
Timeouts: 0
Canceled: 0
Random Failures: 1

> TEARING DOWN..
version	commit_id	commit_message	commit_time	build_email	build_time
1.12.0-SNAPSHOT	b0c4e0486d6d4620b04a1bb8198e959d433b4840	DRILL-5876: Use openssl profile to
include netty-tcnative dependency with the platform specific classifier	20.10.2017 @ 16:52:35
PDT	Unknown	20.10.2017 @ 16:55:44 PDT

hostname	user_port	control_port	data_port	current	version
atsqa6c88.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
atsqa6c82.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
atsqa6c86.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
atsqa6c87.qa.lab	31010	31011	31012	true	1.12.0-SNAPSHOT
atsqa6c85.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
atsqa6c83.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
atsqa6c81.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT
atsqa6c80.qa.lab	31010	31011	31012	false	1.12.0-SNAPSHOT

ok	summary
true	ALL updated.

Session: 0x15d324dfe10ee1e closed
EventThread shut down
Session: 0x15d324dfe10ee1f closed
EventThread shut down
Running command: /root/drillAutomation/framework-master/framework/scripts/restart_drill_script
----------------------------------------------------------------------------------------------------------------

FINISHED AT Mon Oct 23 10:39:07 PDT 2017
TOTAL DURATION: 36.21 min
----------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------

[PostBuildScript] - Execution post build scripts.
[TPCH-SF100-baseline] $ /bin/sh -xe /tmp/hudson5203439872152590056.sh
+ TAG=jenkins-TPCH-SF100-baseline-574
+ mkdir /home/MAPRTECH/drill/logs/archive/jenkins-TPCH-SF100-baseline-574
+ clush -a 'mkdir /home/MAPRTECH/drill/logs/archive/jenkins-TPCH-SF100-baseline-574/$HOSTNAME'
+ clush -a 'mv /var/log/drill/* /home/MAPRTECH/drill/logs/archive/jenkins-TPCH-SF100-baseline-574/$HOSTNAME'
Warning: you have no plugins providing access control for builds, so falling back to legacy
behavior of permitting any downstream builds to be triggered
Triggering a new build of Advanced-Baseline
Triggering a new build of md-1115
Finished: SUCCESS



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message