kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peng Xing (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KYLIN-3219) Fix NPE in CubingJob
Date Mon, 05 Feb 2018 08:44:00 GMT

     [ https://issues.apache.org/jira/browse/KYLIN-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Peng Xing updated KYLIN-3219:
-----------------------------
    Description: 
When using spark engine, there is no 'Build Cube In-Mem' step task,
'getTaskByName(ExecutableConstants.STEP_NAME_BUILD_IN_MEM_CUBE).getDuration()' will get NullPointerException

error log:

java.lang.NullPointerException
 at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
 at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
 at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
 at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
 at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
 at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
 at java.lang.Thread.run(Thread.java:745)
2018-01-31 18:15:20,443 ERROR [pool-11-thread-10] threadpool.DefaultScheduler:302 : ExecuteException
job:693e2cd6-c7e7-4ed9-b1d6-e7ad86f5c501
org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
 at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
 at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
 at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
 at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
 at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
 at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
 ... 4 more

  was:
When using spark engine, there is no 'Build Cube In-Mem' step task,

error log:

java.lang.NullPointerException
 at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
 at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
 at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
 at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
 at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
 at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
 at java.lang.Thread.run(Thread.java:745)
2018-01-31 18:15:20,443 ERROR [pool-11-thread-10] threadpool.DefaultScheduler:302 : ExecuteException
job:693e2cd6-c7e7-4ed9-b1d6-e7ad86f5c501
org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
 at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
 at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
 at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
 at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
 at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
 at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
 ... 4 more


> Fix NPE in CubingJob
> --------------------
>
>                 Key: KYLIN-3219
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3219
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>    Affects Versions: v2.3.0
>            Reporter: Peng Xing
>            Assignee: Peng Xing
>            Priority: Minor
>             Fix For: v2.3.0
>
>         Attachments: 0001-KYLIN-3219.patch
>
>
> When using spark engine, there is no 'Build Cube In-Mem' step task,
> 'getTaskByName(ExecutableConstants.STEP_NAME_BUILD_IN_MEM_CUBE).getDuration()' will get
NullPointerException
> error log:
> java.lang.NullPointerException
>  at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
>  at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
>  at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
>  at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
>  at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
>  at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
>  at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
>  at java.lang.Thread.run(Thread.java:745)
> 2018-01-31 18:15:20,443 ERROR [pool-11-thread-10] threadpool.DefaultScheduler:302 : ExecuteException
job:693e2cd6-c7e7-4ed9-b1d6-e7ad86f5c501
> org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
>  at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
>  at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
>  at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
>  at org.apache.kylin.engine.mr.CubingJob.updateMetrics(CubingJob.java:284)
>  at org.apache.kylin.engine.mr.CubingJob.onStatusChange(CubingJob.java:272)
>  at org.apache.kylin.job.execution.DefaultChainedExecutable.onExecuteFinished(DefaultChainedExecutable.java:132)
>  at org.apache.kylin.engine.mr.CubingJob.onExecuteFinished(CubingJob.java:266)
>  at org.apache.kylin.job.execution.AbstractExecutable.onExecuteFinishedWithRetry(AbstractExecutable.java:98)
>  at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:175)
>  ... 4 more



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message