kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yuyong.zhai <yuyong.z...@ele.me>
Subject merge cube java.lang.OutOfMemoryError: Requested array size exceeds VM limit
Date Fri, 18 Aug 2017 10:30:45 GMT
when i merge my cube,default 7 segments,job error with java.lang.OutOfMemoryError: Requested
array size exceeds VM limit,
print
[cid:8EBCE645BB97492C66F173ECBEA2B8D4]
2017-08-18 14:45:16,210 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] dict.DictionaryManager:437
: +++++++++++++store array size:1650188645

kylin jvm info:

-Dproc_-Xmx64000M -XX:OnOutOfMemoryError=kill -9 %p -Xmx1000m -XX:+UseConcMarkSweepGC -Dhbase.log.dir=/home/master/platform/hbase/logs
-Dhbase.log.file=hbase.log -Dhbase.home.dir=/home/master/platform/hbase -Dhbase.id.str= -Dhbase.root.logger=INFO,console
-Djava.library.path=/home/master/platform/hadoop/lib/native:/home/master/platform/hadoop/lib/native
-Dhbase.security.logger=INFO,NullAppender -Xmx32000M -Xss1024K -XX:MaxPermSize=128M -verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/data/apache-kylin-2.0.0-bin/logs/kylin.gc.7463
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Dlog4j.configuration=file:/data/apache-kylin-2.0.0-bin/conf/kylin-server-log4j.properties
-Dorg.apache.tomcat.util.buf.UDecoder.ALLOW_ENCODED_SLASH=true -Dorg.apache.catalina.connector.CoyoteAdapter.ALLOW_BACKSLASH=true

cube info:
this cube  contain 5 bitmap,
run count distinct on hive(7 day data)

11571535 7425566 5639088 3123302 2500838



how to solution?

2017-08-18 14:45:15,410 DEBUG [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] dict.DictionaryGenerator:99
: Dictionary class: org.apache.kylin.dict.TrieDictionaryForest
2017-08-18 14:45:15,413 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] dict.DictionaryManager:185
: 12 existing dictionaries of the same column
2017-08-18 14:45:15,414 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] dict.DictionaryManager:428
: Saving dictionary at /dict/ST.ST_LOG_APP_USER_FUNNEL_RESULT_DAY_INC/LEVEL_1/96b55650-6abd-40d8-b9ef-c93c9bc17a5a.dict
2017-08-18 14:45:16,210 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] dict.DictionaryManager:437
: +++++++++++++store array size:1650188645
2017-08-18 14:45:20,120 ERROR [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] execution.AbstractExecutable:126
: error running Executable: MergeDictionaryStep{id=c37847e3-1546-47ed-9a3c-ba52f429ae52-00,
name=Merge Cuboid Dictionary, state=RUNNING}
2017-08-18 14:45:20,120 DEBUG [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] dao.ExecutableDao:217
: updating job output, id: c37847e3-1546-47ed-9a3c-ba52f429ae52-00
2017-08-18 14:45:20,122 DEBUG [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] dao.ExecutableDao:217
: updating job output, id: c37847e3-1546-47ed-9a3c-ba52f429ae52-00
2017-08-18 14:45:20,123 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] execution.ExecutableManager:389
: job id:c37847e3-1546-47ed-9a3c-ba52f429ae52-00 from RUNNING to ERROR
2017-08-18 14:45:20,124 ERROR [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] execution.AbstractExecutable:126
: error running Executable: CubingJob{id=c37847e3-1546-47ed-9a3c-ba52f429ae52, name=Funnel_Result_city
- 20170809000000_20170818000000 - MERGE - GMT+08:00 2017-08-18 14:38:03, state=RUNNING}
2017-08-18 14:45:20,124 DEBUG [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] dao.ExecutableDao:217
: updating job output, id: c37847e3-1546-47ed-9a3c-ba52f429ae52
2017-08-18 14:45:20,125 DEBUG [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] dao.ExecutableDao:217
: updating job output, id: c37847e3-1546-47ed-9a3c-ba52f429ae52
2017-08-18 14:45:20,126 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] execution.ExecutableManager:389
: job id:c37847e3-1546-47ed-9a3c-ba52f429ae52 from RUNNING to ERROR
2017-08-18 14:45:20,132 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] execution.AbstractExecutable:285
: prepare to send email to:[wanting.zhang@ele.me]
2017-08-18 14:45:20,132 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] execution.AbstractExecutable:286
: job name:Funnel_Result_city - 20170809000000_20170818000000 - MERGE - GMT+08:00 2017-08-18
14:38:03
2017-08-18 14:45:20,132 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] execution.AbstractExecutable:287
: submitter:ADMIN
2017-08-18 14:45:20,132 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] execution.AbstractExecutable:288
: notify list:[wanting.zhang@ele.me]
2017-08-18 14:45:20,132 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] util.MailService:85
: Email service is disabled; this mail will not be delivered: [ERROR] - [QA] - [UserClass]
- Funnel_Result_city
2017-08-18 14:45:20,132 INFO  [Job c37847e3-1546-47ed-9a3c-ba52f429ae52-165] util.MailService:86
: To enable mail service, set 'kylin.job.notification-enabled=true' in kylin.properties
2017-08-18 14:45:20,132 ERROR [pool-9-thread-2] threadpool.DefaultScheduler:146 : ExecuteException
job:c37847e3-1546-47ed-9a3c-ba52f429ae52
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException:
java.lang.OutOfMemoryError: Requested array size exceeds VM limit
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:134)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:142)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kylin.job.exception.ExecuteException: java.lang.OutOfMemoryError: Requested
array size exceeds VM limit
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:134)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
... 4 more
Caused by: java.lang.OutOfMemoryError: Requested array size exceeds VM limit
at java.util.Arrays.copyOf(Arrays.java:2271)
at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:113)
at java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:93)
at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:140)
at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1793)
at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1769)
at org.apache.commons.io.IOUtils.copy(IOUtils.java:1744)
at org.apache.kylin.storage.hbase.HBaseResourceStore.putResourceImpl(HBaseResourceStore.java:237)
at org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:216)
at org.apache.kylin.dict.DictionaryManager.save(DictionaryManager.java:438)
at org.apache.kylin.dict.DictionaryManager.saveNewDict(DictionaryManager.java:208)
at org.apache.kylin.dict.DictionaryManager.trySaveNewDict(DictionaryManager.java:175)
at org.apache.kylin.dict.DictionaryManager.mergeDictionary(DictionaryManager.java:268)
at org.apache.kylin.engine.mr.steps.MergeDictionaryStep.mergeDictionaries(MergeDictionaryStep.java:146)
at org.apache.kylin.engine.mr.steps.MergeDictionaryStep.makeDictForNewSegment(MergeDictionaryStep.java:136)
at org.apache.kylin.engine.mr.steps.MergeDictionaryStep.doWork(MergeDictionaryStep.java:68)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
... 6 more

Mime
View raw message