kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "梅振楠" <meizhen...@zuoyebang.com>
Subject 回复:Re: when create htable ,occur error
Date Thu, 13 Dec 2018 13:21:17 GMT
kylin  2.5.1  
the engin is mapreduce

--------------原始邮件--------------
发件人:"Chao Long "<wayne.l@qq.com>;
发送时间:2018年12月13日(星期四) 晚上9:18
收件人:"user" <user@kylin.apache.org>;
主题:Re: when  create htable ,occur error
-----------------------------------

 Hi, 
  What's your Kylin version and which build engine you use?


------------------
Best Regards,
Chao Long


 
------------------ Original ------------------
From:  "梅振楠"<meizhennan@zuoyebang.com>;
Date:  Thu, Dec 13, 2018 09:10 PM
To:  "user"<user@kylin.apache.org>;

Subject:  when  create htable ,occur error



hi,all


when Create HTable ,i get this errors. 
resume this cube, do not  work.
how can i resolve the problem .
----------------------------------------------------


2018-12-13 20:49:50,439 INFO  [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871]
common.HadoopShellExecutable:59 : parameters of the HadoopShellExecutable:  -cubename kuaidui_offline_action_crm_cube
-segmentid e26a43d4-879a-6219-7edf-8b2528851207 -partitions hdfs://ns1/kylin/kylin_metadata/kylin-feed250d-4bbc-242f-ab6f-aa8317aacd87/kuaidui_offline_action_crm_cube/rowkey_stats/part-r-00000
-cuboidMode CURRENT -hbaseConfPath hdfs://ns1/kylin/kylin_metadata/kylin-feed250d-4bbc-242f-ab6f-aa8317aacd87/hbase-conf.xml
2018-12-13 20:49:50,533 ERROR [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871]
common.HadoopShellExecutable:65 : error execute HadoopShellExecutable{id=feed250d-4bbc-242f-ab6f-aa8317aacd87-05,
name=Create HTable, state=RUNNING}
java.lang.NullPointerException
	at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207)
	at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165)
	at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100)
	at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2018-12-13 20:49:50,550 INFO  [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871]
execution.ExecutableManager:434 : job id:feed250d-4bbc-242f-ab6f-aa8317aacd87-05 from RUNNING
to ERROR
2018-12-13 20:49:50,552 ERROR [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871]
execution.AbstractExecutable:165 : error running Executable: CubingJob{id=feed250d-4bbc-242f-ab6f-aa8317aacd87,
name=BUILD CUBE - kuaidui_offline_action_crm_cube - 20181201000000_20181202000000 - GMT+08:00
2018-12-13 20:25:57, state=RUNNING}
2018-12-13 20:49:50,561 DEBUG [pool-12-thread-1] cachesync.Broadcaster:113 : Servers in the
cluster: [localhost:7070]
2018-12-13 20:49:50,562 DEBUG [pool-12-thread-1] cachesync.Broadcaster:123 : Announcing new
broadcast to all: BroadcastEvent{entity=execute_output, event=update, cacheKey=feed250d-4bbc-242f-ab6f-aa8317aacd87}
2018-12-13 20:49:50,566 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:247 : Broadcasting
UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87
2018-12-13 20:49:50,569 INFO  [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871]
execution.ExecutableManager:434 : job id:feed250d-4bbc-242f-ab6f-aa8317aacd87 from RUNNING
to ERROR
2018-12-13 20:49:50,569 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:281 : Done broadcasting
UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87
2018-12-13 20:49:50,569 DEBUG [pool-12-thread-1] cachesync.Broadcaster:113 : Servers in the
cluster: [localhost:7070]
2018-12-13 20:49:50,569 DEBUG [pool-12-thread-1] cachesync.Broadcaster:123 : Announcing new
broadcast to all: BroadcastEvent{entity=execute_output, event=update, cacheKey=feed250d-4bbc-242f-ab6f-aa8317aacd87}
2018-12-13 20:49:50,575 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:247 : Broadcasting
UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87
2018-12-13 20:49:50,578 DEBUG [http-bio-7070-exec-4] cachesync.Broadcaster:281 : Done broadcasting
UPDATE, execute_output, feed250d-4bbc-242f-ab6f-aa8317aacd87
2018-12-13 20:49:50,613 INFO  [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871]
execution.AbstractExecutable:343 : prepare to send email to:[meizhennan@zuoyebang.com, liwenjie01@zuoyebang.com]
2018-12-13 20:49:50,614 INFO  [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871]
execution.AbstractExecutable:344 : job name:BUILD CUBE - kuaidui_offline_action_crm_cube -
20181201000000_20181202000000 - GMT+08:00 2018-12-13 20:25:57
2018-12-13 20:49:50,614 INFO  [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871]
execution.AbstractExecutable:345 : submitter:ADMIN
2018-12-13 20:49:50,614 INFO  [Scheduler 190313534 Job feed250d-4bbc-242f-ab6f-aa8317aacd87-871]
execution.AbstractExecutable:346 : notify list:[meizhennan@zuoyebang.com, liwenjie01@zuoyebang.com]
2018-12-13 20:49:52,898 ERROR [pool-10-thread-8] threadpool.DefaultScheduler:115 : ExecuteException
job:feed250d-4bbc-242f-ab6f-aa8317aacd87
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException:
org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.NullPointerException
	at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207)
	at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165)
	at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100)
	at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


result code:2
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.HadoopShellException:
java.lang.NullPointerException
	at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207)
	at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165)
	at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100)
	at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


result code:2
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	... 4 more
Caused by: org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.NullPointerException
	at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:207)
	at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:165)
	at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:100)
	at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


result code:2
	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
	... 6 more
Mime
View raw message