drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steven Phillips (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (DRILL-3063) TestQueriesOnLargeFile leaks memory with 16M limit
Date Fri, 15 May 2015 06:51:59 GMT

     [ https://issues.apache.org/jira/browse/DRILL-3063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Steven Phillips resolved DRILL-3063.
------------------------------------
    Resolution: Fixed

fixedi n e58a306

> TestQueriesOnLargeFile leaks memory with 16M limit
> --------------------------------------------------
>
>                 Key: DRILL-3063
>                 URL: https://issues.apache.org/jira/browse/DRILL-3063
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Flow
>            Reporter: Chris Westin
>            Assignee: Chris Westin
>            Priority: Critical
>             Fix For: 1.0.0
>
>
> I ran the TestQueriesOnLargeFile unit test with a limited memory environment, limiting
direct memory to 16M. At the end of the test, the shutdown hook reports a memory leak.
> Here is the test launch configuration:
> -Xms512m
> -Xmx3g
> -Ddrill.exec.http.enabled=false
> -Ddrill.exec.sys.store.provider.local.write=false
> -Dorg.apache.drill.exec.server.Drillbit.system_options="org.apache.drill.exec.compile.ClassTransformer.scalar_replacement=on"
> -XX:MaxPermSize=256M -XX:MaxDirectMemorySize=3072M
> -XX:+CMSClassUnloadingEnabled -ea
> -Ddrill.exec.memory.top.max=16777216
> Here's what I see at the end:
> 	at org.apache.drill.exec.server.Drillbit$ShutdownThread.run(Drillbit.java:333)
> Caused by: java.lang.IllegalStateException: Failure while closing accountor.  Expected
private and shared pools to be set to initial values.  However, one or more were not.  Stats
are
> 	zone	init	allocated	delta 
> 	private	0	0	0 
> 	shared	16777216	13777216	3000000.
> 	at org.apache.drill.exec.memory.AtomicRemainder.close(AtomicRemainder.java:200)
> 	at org.apache.drill.exec.memory.Accountor.close(Accountor.java:386)
> 	at org.apache.drill.exec.memory.TopLevelAllocator.close(TopLevelAllocator.java:171)
> 	at org.apache.drill.exec.server.BootStrapContext.close(BootStrapContext.java:75)
> 	at com.google.common.io.Closeables.close(Closeables.java:77)
> 	at com.google.common.io.Closeables.closeQuietly(Closeables.java:108)
> 	at org.apache.drill.exec.server.Drillbit.close(Drillbit.java:292)
> 	at org.apache.drill.exec.server.Drillbit$ShutdownThread.run(Drillbit.java:330)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message