asterixdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From asteri...@googlecode.com
Subject Issue 922 in asterixdb: OOM during creating ngram index
Date Sat, 08 Aug 2015 19:25:56 GMT
Status: Accepted
Owner: wangs...@gmail.com
CC: pouria.p...@gmail.com
Labels: Type-Defect Priority-Medium

New issue 922 by buyingyi@gmail.com: OOM during creating ngram index
https://code.google.com/p/asterixdb/issues/detail?id=922

Use the generated twitter message dataset.
13.75 GB per partition, 4 partitions per machine,  6GB heap size,  256MB  
in-memory components for each index.

Asterix Configuration
nc.java.opts                             :-Xmx6144m   
-XX:MinHeapFreeRatio=5  -XX:MaxHeapFreeRatio=15
cc.java.opts                             :-Xmx4096m -XX:MinHeapFreeRatio=5   
-XX:MaxHeapFreeRatio=15
max.wait.active.cluster                  :60
storage.buffercache.pagesize             :131072
storage.buffercache.size                 :1073741824
storage.buffercache.maxopenfiles         :214748364
storage.memorycomponent.pagesize         :131072
storage.memorycomponent.numpages         :2048
storage.metadata.memorycomponent.numpages:64
storage.memorycomponent.numcomponents    :2
storage.memorycomponent.globalbudget     :2147483648

DDL:
create index tNGramIdx on TwitterMessages(message-text) type ngram(2);

Error:
java.lang.OutOfMemoryError: unable to create new native thread


-- 
You received this message because this project is configured to send all  
issue notifications to this address.
You may adjust your notification preferences at:
https://code.google.com/hosting/settings

Mime
View raw message