flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Waury <robert.wa...@googlemail.com>
Subject Re: Job fails with FileNotFoundException from blobStore
Date Thu, 05 Feb 2015 10:23:27 GMT
Hi,

I can reproduce the error on my cluster.

Unfortunately I can't check whether the parent directories were created on
the different nodes since I have no way of accessing them. I start all the
jobs from a gateway.

Cheers,
Robert




On Thu, Feb 5, 2015 at 11:01 AM, Ufuk Celebi <uce@apache.org> wrote:

> Hey Robert,
>
> is this error reproducible?
>
> I've looked into the blob store and the error occurs when the blob cache
> tries to *create* a local file before requesting it from the job manager.
>
> I will add a check to the blob store to ensure that the parent directories
> have been created. Other than that, I currently have no clue what the
> problem might be.
>
> Can you verify whether the parent directory has been created on your
> machines? You could do this before you submit the tasks. I will add the
> respective log messages to the blob cache and push to 0.8/master.
>
> – Ufuk
>
> On 05 Feb 2015, at 09:27, Robert Waury <robert.waury@googlemail.com>
> wrote:
>
> > I compiled from the release-0.8 branch.
> >
> > On Thu, Feb 5, 2015 at 8:55 AM, Stephan Ewen <sewen@apache.org> wrote:
> > Hey Robert!
> >
> > On which version are you? 0.8 or 0.9- SNAPSHOT?
> >
> > Am 04.02.2015 14:49 schrieb "Robert Waury" <robert.waury@googlemail.com
> >:
> >
> > Hi,
> >
> > I'm suddenly getting FileNotFoundExceptions because the blobStore cannot
> find files in /tmp
> >
> > The job used work in the exact same setup (same versions, same cluster,
> same input files).
> >
> > Flink version: 0.8 release
> > HDFS: 2.3.0-cdh5.1.2
> >
> > Flink trace:
> > http://pastebin.com/SKdwp6Yt
> >
> > Any idea what could be the reason behind this?
> >
> > Cheers,
> > Robert
> >
>
>

Mime
View raw message