kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 仇同心 <qiutong...@jd.com>
Subject create dictionary error
Date Fri, 10 Feb 2017 05:29:39 GMT
Hi,all
     Building operation error on the of  Step Name: Build Dimension Dictionary:

    java.lang.RuntimeException: Failed to create dictionary on DMT.DMT_KYLIN_JDMALL_ORDR_DTL_I_D.SALE_ORD_ID
         at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:325)
         at org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:185)
         at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:50)
         at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
         at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:56)
         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
         at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
         at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
         at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
         at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
         at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
         at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Too big dictionary, dictionary cannot be bigger than
2GB
         at org.apache.kylin.dict.TrieDictionaryBuilder.buildTrieBytes(TrieDictionaryBuilder.java:421)
         at org.apache.kylin.dict.TrieDictionaryBuilder.build(TrieDictionaryBuilder.java:408)
         at org.apache.kylin.dict.DictionaryGenerator$StringDictBuilder.build(DictionaryGenerator.java:165)
         at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:81)
         at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:73)
         at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:321)
         ... 14 more

  The  Cardinality of  “SALE_ORD_ID”  is 157644463,but This column was not selected for
the dimension.

  In addition, I'm very confused here to build a data dictionary is full amount to build or
data to construct according to the selected time range?


Thank you~





Mime
View raw message