kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yichen Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KYLIN-3534) Failed at update cube info step
Date Tue, 04 Sep 2018 08:44:00 GMT

     [ https://issues.apache.org/jira/browse/KYLIN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yichen Zhou updated KYLIN-3534:
-------------------------------
    Description: 
When building cube with spark(full build), I got the following error in the step of "Update
Cube Info":
{quote}2018-09-04 14:49:49,007 INFO [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
steps.UpdateCubeInfoAfterBuildStep:158 : updateSegment step. TRANS_ID minValue:x�3�.�)
maxValue:null
 2018-09-04 14:49:49,008 ERROR [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.AbstractExecutable:165 : error running Executable: UpdateCubeInfoAfterBuildStep\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2-09,
name=Update Cube Info, state=RUNNING}
 2018-09-04 14:49:49,011 INFO [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.ExecutableManager:434 : job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2-09 from RUNNING
to ERROR
 2018-09-04 14:49:49,012 ERROR [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.AbstractExecutable:165 : error running Executable: CubingJob\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2,
name=BUILD CUBE - cube_global_dictionary_spark - FULL_BUILD - GMT+08:00 2018-09-04 11:51:58,
state=RUNNING}
 2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 : Servers in the
cluster: [localhost:7070]
 2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 : Announcing new
broadcast to all: BroadcastEvent\{entity=execute_output, event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2}
 2018-09-04 14:49:49,015 INFO [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.ExecutableManager:434 : job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2 from RUNNING
to ERROR
 2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 : Servers in the
cluster: [localhost:7070]
 2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 : Announcing new
broadcast to all: BroadcastEvent\{entity=execute_output, event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2}
 2018-09-04 14:49:49,015 DEBUG [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.AbstractExecutable:316 : no need to send email, user list is empty
 2018-09-04 14:49:49,017 ERROR [pool-10-thread-10] threadpool.DefaultScheduler:115 : ExecuteException
job:d05156bb-2635-cb2f-ac19-b38f6147fcb2

org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException:java.lang.IllegalStateException
 at org.apache.kylin.cube.DimensionRangeInfo.<init>(DimensionRangeInfo.java:86)
 at org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.updateSegment(UpdateCubeInfoAfterBuildStep.java:166)
 at org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.doWork(UpdateCubeInfoAfterBuildStep.java:85)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
 at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
 at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
{quote}

  was:
When building sample cube with spark(full build), I got the following error in the step of
"Update Cube Info":
{quote}2018-09-04 14:49:49,007 INFO [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
steps.UpdateCubeInfoAfterBuildStep:158 : updateSegment step. TRANS_ID minValue:x�3�.�)
maxValue:null
 2018-09-04 14:49:49,008 ERROR [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.AbstractExecutable:165 : error running Executable: UpdateCubeInfoAfterBuildStep\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2-09,
name=Update Cube Info, state=RUNNING}
 2018-09-04 14:49:49,011 INFO [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.ExecutableManager:434 : job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2-09 from RUNNING
to ERROR
 2018-09-04 14:49:49,012 ERROR [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.AbstractExecutable:165 : error running Executable: CubingJob\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2,
name=BUILD CUBE - cube_global_dictionary_spark - FULL_BUILD - GMT+08:00 2018-09-04 11:51:58,
state=RUNNING}
 2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 : Servers in the
cluster: [localhost:7070]
 2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 : Announcing new
broadcast to all: BroadcastEvent\{entity=execute_output, event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2}
 2018-09-04 14:49:49,015 INFO [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.ExecutableManager:434 : job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2 from RUNNING
to ERROR
 2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 : Servers in the
cluster: [localhost:7070]
 2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 : Announcing new
broadcast to all: BroadcastEvent\{entity=execute_output, event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2}
 2018-09-04 14:49:49,015 DEBUG [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.AbstractExecutable:316 : no need to send email, user list is empty
 2018-09-04 14:49:49,017 ERROR [pool-10-thread-10] threadpool.DefaultScheduler:115 : ExecuteException
job:d05156bb-2635-cb2f-ac19-b38f6147fcb2

org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException:java.lang.IllegalStateException
 at org.apache.kylin.cube.DimensionRangeInfo.<init>(DimensionRangeInfo.java:86)
 at org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.updateSegment(UpdateCubeInfoAfterBuildStep.java:166)
 at org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.doWork(UpdateCubeInfoAfterBuildStep.java:85)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
 at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
 at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
{quote}


> Failed at update cube info step
> -------------------------------
>
>                 Key: KYLIN-3534
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3534
>             Project: Kylin
>          Issue Type: Bug
>            Reporter: Yichen Zhou
>            Priority: Major
>
> When building cube with spark(full build), I got the following error in the step of "Update
Cube Info":
> {quote}2018-09-04 14:49:49,007 INFO [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
steps.UpdateCubeInfoAfterBuildStep:158 : updateSegment step. TRANS_ID minValue:x�3�.�)
maxValue:null
>  2018-09-04 14:49:49,008 ERROR [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.AbstractExecutable:165 : error running Executable: UpdateCubeInfoAfterBuildStep\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2-09,
name=Update Cube Info, state=RUNNING}
>  2018-09-04 14:49:49,011 INFO [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.ExecutableManager:434 : job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2-09 from RUNNING
to ERROR
>  2018-09-04 14:49:49,012 ERROR [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.AbstractExecutable:165 : error running Executable: CubingJob\{id=d05156bb-2635-cb2f-ac19-b38f6147fcb2,
name=BUILD CUBE - cube_global_dictionary_spark - FULL_BUILD - GMT+08:00 2018-09-04 11:51:58,
state=RUNNING}
>  2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 : Servers
in the cluster: [localhost:7070]
>  2018-09-04 14:49:49,014 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 : Announcing
new broadcast to all: BroadcastEvent\{entity=execute_output, event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2}
>  2018-09-04 14:49:49,015 INFO [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.ExecutableManager:434 : job id:d05156bb-2635-cb2f-ac19-b38f6147fcb2 from RUNNING
to ERROR
>  2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:113 : Servers
in the cluster: [localhost:7070]
>  2018-09-04 14:49:49,015 DEBUG [pool-6-thread-1] cachesync.Broadcaster:123 : Announcing
new broadcast to all: BroadcastEvent\{entity=execute_output, event=update, cacheKey=d05156bb-2635-cb2f-ac19-b38f6147fcb2}
>  2018-09-04 14:49:49,015 DEBUG [Scheduler 1888858588 Job d05156bb-2635-cb2f-ac19-b38f6147fcb2-699]
execution.AbstractExecutable:316 : no need to send email, user list is empty
>  2018-09-04 14:49:49,017 ERROR [pool-10-thread-10] threadpool.DefaultScheduler:115 :
ExecuteException job:d05156bb-2635-cb2f-ac19-b38f6147fcb2
> org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException:java.lang.IllegalStateException
>  at org.apache.kylin.cube.DimensionRangeInfo.<init>(DimensionRangeInfo.java:86)
>  at org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.updateSegment(UpdateCubeInfoAfterBuildStep.java:166)
>  at org.apache.kylin.engine.mr.steps.UpdateCubeInfoAfterBuildStep.doWork(UpdateCubeInfoAfterBuildStep.java:85)
>  at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
>  at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
>  at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
>  at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  at java.lang.Thread.run(Thread.java:748)
> {quote}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message