flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: IOException reading a large file
Date Sat, 09 May 2015 07:12:23 GMT
Probably this is a real disk error, I had an i/o error also copying that
file in another location..I hope my disk is not dying..

On Sat, May 9, 2015 at 8:46 AM, Flavio Pompermaier <pompermaier@okkam.it>
wrote:

> Hi to all,
> I'm trying to read a big file from my local fs, splitting it into two
> everything is fine, instead, reading it all at once I get this error>
>
> java.io.IOException: Error of input/output
> at java.io.FileInputStream.readBytes(Native Method)
> at java.io.FileInputStream.read(FileInputStream.java:272)
> at
> org.apache.flink.core.fs.local.LocalDataInputStream.read(LocalDataInputStream.java:76)
> at
> org.apache.flink.api.common.io.DelimitedInputFormat.fillBuffer(DelimitedInputFormat.java:581)
> at
> org.apache.flink.api.common.io.DelimitedInputFormat.readLine(DelimitedInputFormat.java:487)
> at
> org.apache.flink.api.common.io.DelimitedInputFormat.nextRecord(DelimitedInputFormat.java:453)
> at
> org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:173)
> at
> org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:223)
> at java.lang.Thread.run(Thread.java:745)
>
> Do you know which could be the cause?
>
> Best,
> Flavio
>
>

Mime
View raw message