kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shawn Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KYLIN-2470) cube build failed when no records matching the segment time range
Date Mon, 06 Nov 2017 09:43:00 GMT

    [ https://issues.apache.org/jira/browse/KYLIN-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16240073#comment-16240073
] 

Shawn Wang commented on KYLIN-2470:
-----------------------------------

I'm suffering with this issue, the segment building failed because the data is not ready.
Then the job is dropped without "discard" action. Now I can't do anything with the segment,
can't delete, can't refresh, can't rebuild.

For delete: "exception": "Cannot delete segment '20171104000000_20171105235500' as its status
is not READY. Discard the on-going job for it.",
for "refresh": "Segments overlap: tiantian_production[20171104000000_20171105235500] and tiantian_production[20171104000000_20171105235500]".

How can I drop the segment and rebuid it?



> cube build failed when no records matching the segment time range
> -----------------------------------------------------------------
>
>                 Key: KYLIN-2470
>                 URL: https://issues.apache.org/jira/browse/KYLIN-2470
>             Project: Kylin
>          Issue Type: Wish
>    Affects Versions: v1.6.0
>         Environment: hadoop2.7.3 hive2.1.1 hbase1.2.4 apache-kylin-1.6.0-hbase1.x-bin
>            Reporter: zhou degao
>              Labels: newbie
>
> I hope the build will be successful then there is no hive data partitions.
> ERRORS are:
> java.lang.IllegalArgumentException: Map input splits are 0 bytes, something is wrong!
> 	at org.apache.kylin.engine.mr.common.AbstractHadoopJob.getTotalMapInputMB(AbstractHadoopJob.java:555)
> 	at org.apache.kylin.engine.mr.steps.CuboidJob.setReduceTaskNum(CuboidJob.java:175)
> 	at org.apache.kylin.engine.mr.steps.CuboidJob.run(CuboidJob.java:138)
> 	at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92)
> 	at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
> 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
> 	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
> 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
> 	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> 	at java.lang.Thread.run(Thread.java:745)
> result code:2
> In another environment (hadoop2.6.4,hive1.2.1,hbase1.1.3,apache-kylin-1.6.0-hbase1.x-bin)
the cube build is successful if there is no hive data partitions from start time to end time
.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message