arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andong Zhan <andong.z...@snowflake.com.INVALID>
Subject [Java] How to use RootAllocator in a low memory setting?
Date Tue, 10 Sep 2019 17:06:22 GMT
Hi folks,

When I run this simple code with JVM setting: "-Xmx64m"


import org.apache.arrow.memory.RootAllocator;


public class TestArrow

{

  public static void main(String args[]) throws Exception

  {

    new RootAllocator(Integer.MAX_VALUE);

  }

}


and got the following error


Picked up JAVA_TOOL_OPTIONS:
-Djavax.net.ssl.trustStore=/etc/pki/ca-trust/extracted/java/cacerts

Exception in thread "main" java.lang.ExceptionInInitializerError

at
org.apache.arrow.memory.BaseAllocator.createEmpty(BaseAllocator.java:263)

at org.apache.arrow.memory.BaseAllocator.<init>(BaseAllocator.java:89)

at org.apache.arrow.memory.RootAllocator.<init>(RootAllocator.java:34)

at org.apache.arrow.memory.RootAllocator.<init>(RootAllocator.java:30)

at com.snowflake.TestArrow.main(TestArrow.java:13)


Caused by: java.lang.NullPointerException

at
io.netty.buffer.PooledByteBufAllocatorL$InnerAllocator.<init>(PooledByteBufAllocatorL.java:145)

at
io.netty.buffer.PooledByteBufAllocatorL.<init>(PooledByteBufAllocatorL.java:49)

at
org.apache.arrow.memory.AllocationManager.<clinit>(AllocationManager.java:61)
... 5 more

Process finished with exit code 1


So how to use RootAllocator in such low memory case?

I also post an issue here: https://issues.apache.org/jira/browse/ARROW-6500

Thanks,

Andong

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message