flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jörn Franke <jornfra...@gmail.com>
Subject Re: FileNotFound Exception in Cluster Standalone
Date Sat, 05 Aug 2017 14:25:05 GMT
Probably you need to refer to the file on HDFS or manually make it available on each node as
a local file. HDFS is recommended.

If it is already on HDFS then you need to provide an HDFS URL to the file.

> On 5. Aug 2017, at 14:27, Kaepke, Marc <marc.kaepke@haw-hamburg.de> wrote:
> Hi there,
> my really small test job reads an external file and print the input to console.
> Execute it as standalone with a local cluster, everything is fine.
> If I execute the same job as standalone with 1 job manager und 1 task manager, I get
an FileNotFound Exception. As a real distributed cluster. The cluster seems to be fine, because
I can execute another job, which don’t consume a file.
> at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> Caused by: java.io.IOException: Error opening the Input Split file:/home/bigdata/Documents/marc/wiki-vote.txt
[0,1095061]: /home/bigdata/Documents/marc/wiki-vote.txt (No such file or directory)
> at org.apache.flink.api.common.io.FileInputFormat.open(FileInputFormat.java:706)
> at org.apache.flink.api.common.io.DelimitedInputFormat.open(DelimitedInputFormat.java:477)
> at org.apache.flink.api.common.io.GenericCsvInputFormat.open(GenericCsvInputFormat.java:301)
> at org.apache.flink.api.java.io.CsvInputFormat.open(CsvInputFormat.java:48)
> at org.apache.flink.api.java.io.CsvInputFormat.open(CsvInputFormat.java:31)
> at org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:145)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.FileNotFoundException: /home/bigdata/Documents/marc/wiki-vote.txt
(No such file or directory)
> at java.io.FileInputStream.open0(Native Method)
> at java.io.FileInputStream.open(FileInputStream.java:195)
> at java.io.FileInputStream.<init>(FileInputStream.java:138)
> at org.apache.flink.core.fs.local.LocalDataInputStream.<init>(LocalDataInputStream.java:49)
> at org.apache.flink.core.fs.local.LocalFileSystem.open(LocalFileSystem.java:141)
> at org.apache.flink.api.common.io.FileInputFormat$InputSplitOpenThread.run(FileInputFormat.java:866)
> Does someone has an idea to solve it?
> Thanks!
> Marc

View raw message