kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KYLIN-3551) Spark job failed with "FileNotFoundException"
Date Mon, 17 Sep 2018 10:58:00 GMT

    [ https://issues.apache.org/jira/browse/KYLIN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16617358#comment-16617358
] 

ASF subversion and git services commented on KYLIN-3551:
--------------------------------------------------------

Commit c06e0a9df7ac3e0100c793928869c9c65ec6dde2 in kylin's branch refs/heads/2.5.0-hadoop3.1
from chao long
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=c06e0a9 ]

KYLIN-3551 Check spark counter output path exists


> Spark job failed with "FileNotFoundException" 
> ----------------------------------------------
>
>                 Key: KYLIN-3551
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3551
>             Project: Kylin
>          Issue Type: Bug
>          Components: Spark Engine
>            Reporter: Shaofeng SHI
>            Assignee: Chao Long
>            Priority: Minor
>             Fix For: v2.5.0
>
>
> java.io.FileNotFoundException: File does not exist: hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default_instance/kylin-a3e39298-8dc3-21f2-cf16-0aa5e451c777/kylin_sales_cube_clone_clone/counter
> 	at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1319)
> 	at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1311)
> 	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> 	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1311)
> 	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1752)
> 	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1776)
> 	at org.apache.kylin.common.util.HadoopUtil.readFromSequenceFile(HadoopUtil.java:218)
> 	at org.apache.kylin.common.util.HadoopUtil.readFromSequenceFile(HadoopUtil.java:233)
> 	at org.apache.kylin.engine.spark.SparkExecutable.doWork(SparkExecutable.java:319)
> 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
> 	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
> 	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
> 	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 	at java.lang.Thread.run(Thread.java:748)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message